-- Logs begin at Mon 2022-10-10 17:57:05 UTC, end at Mon 2022-10-10 19:08:37 UTC. -- Oct 10 18:38:36.193907 n-d-860863-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 10 18:38:36.203063 n-d-860863-1 devstack@n-api.service[111436]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 10 18:38:36.205069 n-d-860863-1 devstack@n-api.service[111436]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 18:38:36 2022] *** Oct 10 18:38:36.205069 n-d-860863-1 devstack@n-api.service[111436]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 18:38:36.205069 n-d-860863-1 devstack@n-api.service[111436]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 18:38:36.205069 n-d-860863-1 devstack@n-api.service[111436]: nodename: n-d-860863-1 Oct 10 18:38:36.205069 n-d-860863-1 devstack@n-api.service[111436]: machine: x86_64 Oct 10 18:38:36.205069 n-d-860863-1 devstack@n-api.service[111436]: clock source: unix Oct 10 18:38:36.205069 n-d-860863-1 devstack@n-api.service[111436]: pcre jit disabled Oct 10 18:38:36.205069 n-d-860863-1 devstack@n-api.service[111436]: detected number of CPU cores: 4 Oct 10 18:38:36.205069 n-d-860863-1 devstack@n-api.service[111436]: current working directory: / Oct 10 18:38:36.205069 n-d-860863-1 devstack@n-api.service[111436]: detected binary path: /usr/bin/uwsgi-core Oct 10 18:38:36.205069 n-d-860863-1 devstack@n-api.service[111436]: your processes number limit is 47680 Oct 10 18:38:36.205069 n-d-860863-1 devstack@n-api.service[111436]: your memory page size is 4096 bytes Oct 10 18:38:36.205906 n-d-860863-1 devstack@n-api.service[111436]: detected max file descriptor number: 2048 Oct 10 18:38:36.205906 n-d-860863-1 devstack@n-api.service[111436]: lock engine: pthread robust mutexes Oct 10 18:38:36.205906 n-d-860863-1 devstack@n-api.service[111436]: thunder lock: enabled Oct 10 18:38:36.205906 n-d-860863-1 devstack@n-api.service[111436]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 10 18:38:36.205906 n-d-860863-1 devstack@n-api.service[111436]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 18:38:36.243996 n-d-860863-1 devstack@n-api.service[111436]: Python main interpreter initialized at 0x55e0eb1159c0 Oct 10 18:38:36.243996 n-d-860863-1 devstack@n-api.service[111436]: python threads support enabled Oct 10 18:38:36.243996 n-d-860863-1 devstack@n-api.service[111436]: your server socket listen backlog is limited to 100 connections Oct 10 18:38:36.243996 n-d-860863-1 devstack@n-api.service[111436]: your mercy for graceful operations on workers is 90 seconds Oct 10 18:38:36.244308 n-d-860863-1 devstack@n-api.service[111436]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 18:38:36.244387 n-d-860863-1 devstack@n-api.service[111436]: *** Operational MODE: preforking *** Oct 10 18:38:36.244667 n-d-860863-1 devstack@n-api.service[111436]: *** uWSGI is running in multiple interpreter mode *** Oct 10 18:38:36.244667 n-d-860863-1 devstack@n-api.service[111436]: spawned uWSGI master process (pid: 111436) Oct 10 18:38:36.244849 n-d-860863-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 10 18:38:36.245512 n-d-860863-1 devstack@n-api.service[111436]: spawned uWSGI worker 1 (pid: 111437, cores: 1) Oct 10 18:38:36.245712 n-d-860863-1 devstack@n-api.service[111436]: spawned uWSGI worker 2 (pid: 111438, cores: 1) Oct 10 18:38:36.245869 n-d-860863-1 devstack@n-api.service[111436]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 18:38:36.898750 n-d-860863-1 devstack@n-api.service[111437]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 18:38:36.899318 n-d-860863-1 devstack@n-api.service[111438]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 18:38:37.973915 n-d-860863-1 devstack@n-api.service[111438]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 18:38:37.973915 n-d-860863-1 devstack@n-api.service[111438]: from cryptography.utils import int_from_bytes Oct 10 18:38:37.974592 n-d-860863-1 devstack@n-api.service[111438]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 18:38:37.974592 n-d-860863-1 devstack@n-api.service[111438]: from cryptography.utils import int_from_bytes Oct 10 18:38:37.974716 n-d-860863-1 devstack@n-api.service[111437]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 18:38:37.974716 n-d-860863-1 devstack@n-api.service[111437]: from cryptography.utils import int_from_bytes Oct 10 18:38:37.974716 n-d-860863-1 devstack@n-api.service[111437]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 18:38:37.974716 n-d-860863-1 devstack@n-api.service[111437]: from cryptography.utils import int_from_bytes Oct 10 18:38:40.460855 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 18:38:40.461445 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 18:38:40.461534 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 18:38:40.461868 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 18:38:40.461957 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 18:38:40.462030 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 18:38:40.462251 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 18:38:40.462344 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 18:38:40.462594 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.462704 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 18:38:40.462882 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 18:38:40.462971 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.463226 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.463310 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.463546 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.463654 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.463875 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.463964 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.464184 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.464273 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.464500 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.464631 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.464841 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.464928 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.465163 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.465260 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.465420 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.465507 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.465733 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.465820 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.466049 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.466145 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860863-1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.466364 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.466451 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.466668 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.466757 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860863-1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.466977 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.467077 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.467314 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.467402 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.467623 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.467711 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.467943 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.468030 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.468245 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.468338 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.468585 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.468770 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.468906 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.469210 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.469410 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.469554 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.469726 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.469867 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.470037 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.470166 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.470346 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.470444 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.470681 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.470779 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.470997 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.471085 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.471308 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.471438 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.471624 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.471719 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.471930 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.472017 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.472257 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.472354 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860863-1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.472593 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.472727 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.472942 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.473047 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860863-1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.473254 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.473348 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.473593 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.473686 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.473905 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.474011 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.474251 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.474341 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.474569 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.474664 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.474902 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.474990 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.475208 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.475297 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.475529 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.475616 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.475839 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.475928 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.476151 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.476245 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.476470 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.476601 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.476796 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.476890 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.477104 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.477206 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.477409 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.477499 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.477717 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.477804 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.478019 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.478119 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.478321 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.478409 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.478568 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.478657 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.478873 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.478970 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.479160 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.479248 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.479469 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.479565 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.479843 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.479952 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.480038 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.480119 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.480268 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.480413 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.480612 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.480706 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.480934 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.481035 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.481242 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.481409 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.481549 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.481638 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.481854 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.481943 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.482161 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.482256 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.482463 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.482550 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.482798 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.482886 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.483112 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.483213 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.483418 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.483506 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.483723 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.483810 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.484031 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.484119 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.484346 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.484433 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.484673 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.484762 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.484991 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.485081 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.485301 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.485387 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.485617 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.485705 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.485925 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.486014 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.486251 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.486349 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.486562 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.486648 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.486870 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.486966 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.487185 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.487274 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.487497 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.487592 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.487801 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.487888 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.488105 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.488203 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.488409 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.488510 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.488745 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.488833 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.489055 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.489143 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.489361 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.489460 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.489615 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.489703 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.489920 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.490049 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.490222 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.490334 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.490523 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.490620 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.490821 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.490909 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.491126 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.491222 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.491429 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.491517 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.491727 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.491822 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.492029 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.492118 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.492327 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.492414 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.492654 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.492745 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.492961 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.493058 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.493266 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.493354 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.493567 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.493655 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.493866 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.493956 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.494169 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.494266 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.494474 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.494580 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.494771 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.494865 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.495075 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.495168 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.495382 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.495488 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.495683 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.495785 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.495986 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.496091 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.496288 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.496383 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.496617 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.496712 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.496929 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.497030 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.497228 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.497328 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.497531 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.497621 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.497835 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.497922 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.498137 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.498225 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.498986 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.499081 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.499300 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.499387 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.499602 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.499703 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.499906 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.500013 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.500211 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.500299 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.500509 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.500673 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.500836 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.500926 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.501142 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.501230 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.501444 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.501540 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.501745 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.501833 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.502047 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.502144 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.502346 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.502443 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.502646 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.502754 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.502948 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.503035 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.503243 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.503331 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.503540 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.503628 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.503834 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.503922 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.504134 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.504221 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.504435 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.504524 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.504766 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.504857 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.505070 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.505167 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.505371 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.505459 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.505680 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.505766 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.505988 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.506084 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.506307 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:38:40.506396 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.506640 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.506737 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.506948 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.507035 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.507277 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.507365 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.507597 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.507692 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.507909 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.508005 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.508219 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.508308 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.508530 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.508712 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.508872 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.508961 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.509180 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.509270 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.509490 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.509586 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.509798 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.509886 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.510105 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.510192 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.510418 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.510527 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.510740 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.510829 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.511053 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.511147 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.511367 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.511463 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.511681 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.511771 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.511990 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.512086 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.512304 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.512392 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.512645 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.512736 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.512964 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.513062 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.513275 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.513377 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.513595 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.513688 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.513908 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.514016 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.514807 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.514958 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.515134 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.515221 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.515453 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.515550 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.515764 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.515852 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.516076 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.516165 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.516386 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.516483 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.516725 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.516815 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.517041 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.517137 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.517352 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.517492 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.517670 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.517766 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.517982 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.518070 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.518301 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.518397 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.518609 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.518697 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.518919 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.519007 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.519227 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.519324 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.519537 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.519626 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.519845 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.519934 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.520156 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.520243 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.520468 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.520575 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.520814 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.520902 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.521127 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.521217 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.521438 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.521539 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.521751 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.521838 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.522057 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.522145 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.522365 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.522453 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.522675 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.522764 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.523230 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.523332 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.523531 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.523620 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.523831 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.523928 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.524135 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.524221 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.524433 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.524521 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.524770 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.524911 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.525079 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.525169 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.525402 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.525497 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.525733 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.525832 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.526044 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.526133 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.526349 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.526443 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.526660 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.526786 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.526971 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.527063 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.527271 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.527361 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.527581 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.527686 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.527885 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.527973 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.528184 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.528271 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.528496 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.528612 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.528829 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.528917 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.529134 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.529231 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.529454 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.529544 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.529786 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.529873 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.530105 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.530201 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.530410 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.530498 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.530715 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.530802 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.531024 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.531122 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.531334 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.531422 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.531639 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.531727 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.531951 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.532115 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.532257 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.532345 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.532584 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.532676 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.532903 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.533000 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.533215 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.533310 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.533521 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.533609 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.533841 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.533938 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.534162 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.534252 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.534475 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.534564 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.534777 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.534867 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.535082 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.535171 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.535383 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.535471 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.535683 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.535780 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.535984 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.536079 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.536287 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.536374 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.536604 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.536695 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.536907 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.536996 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.537209 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.537296 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.537505 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.537594 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.537806 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.537902 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.538108 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.538203 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.538414 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.538554 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.538711 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.538799 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.539012 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.539109 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.539326 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.539453 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.539622 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.539743 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.539928 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.540052 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.540266 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.540381 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.540594 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.540687 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.540920 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.541026 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.541240 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.541329 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.541563 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.541691 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.541887 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.542002 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.542229 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.542357 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.542518 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.542634 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.542829 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.542946 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.543142 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.543258 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.543454 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.543571 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.543763 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.543887 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.544078 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.544191 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.544383 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.544497 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.544728 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.544854 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.545049 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.545173 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.545373 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.545497 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.545678 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.545809 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.545990 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.546107 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.546740 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.546853 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.546963 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.547071 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.547178 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.547285 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.547402 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.547518 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.547518 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.547746 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.547855 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.547962 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.548133 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.548251 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.548441 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.548580 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.548776 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.548906 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.549082 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.549204 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.549397 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.549511 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.549701 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.549816 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.550017 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.550131 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.550320 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.550433 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.550636 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.550759 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.550938 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.551053 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.551250 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.551367 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.551552 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.551656 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.551863 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.551953 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.552165 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.552278 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.552479 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.552600 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.552817 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.552905 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.553125 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.553215 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.553442 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.553539 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.553747 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.553838 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.554053 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.554142 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.554361 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.554458 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.554663 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.554752 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.554964 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.555053 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.555274 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.555361 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.555560 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.555659 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.555861 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.555949 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.556169 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.556260 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.556470 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.556624 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.556806 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.556894 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.557108 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.557197 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.557409 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.557499 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.557709 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.557807 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.558011 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.558098 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.558318 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.558407 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.558623 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.558720 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.558941 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.559028 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.559257 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.559345 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.559559 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.559657 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.559861 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.559950 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.560177 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.560265 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.560481 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.560666 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.560810 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.561402 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.561656 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.561748 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.561960 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.562058 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.562267 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.562362 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.562579 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.562672 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.562882 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.562978 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.563197 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.563292 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.563514 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.563611 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.563821 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.563910 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.564132 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.564220 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.564439 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.564527 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.564770 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.564859 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.565083 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.565177 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.565394 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.565500 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.565697 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.565788 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.566006 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.566102 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.566314 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.566410 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.566621 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.566709 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.566931 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.567020 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.567241 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.567345 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.567546 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.567640 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.567854 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.567942 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.568165 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.568260 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.568462 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.568568 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.568795 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.568897 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.569110 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.569208 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.569421 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.569682 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.569771 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.570012 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.570300 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.570390 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.570637 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.570731 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.570956 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.571043 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.571282 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.571384 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.571607 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.571695 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.571933 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.572039 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.572247 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.572336 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.572579 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.572672 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.572878 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.572968 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.573183 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.573284 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.573485 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.573575 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.573792 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.573881 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.574096 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.574192 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.574394 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.574483 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.574697 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.574786 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.575002 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.575090 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.575301 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.575404 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.575605 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.575704 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.575903 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.575994 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.576205 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.576294 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.576528 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.577120 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.577369 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.577470 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.577680 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.577768 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.577985 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.578082 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.578307 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.578410 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.578616 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.578705 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.578919 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.579008 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.579221 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.579319 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.579523 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.579612 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.579834 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.579921 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.580141 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.580238 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.580471 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.580577 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.580807 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.580895 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.581146 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.581236 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.581452 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.581541 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.581754 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.581843 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.582074 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.582164 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.582377 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.582473 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.582679 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.582769 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.582979 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.583068 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.583282 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.583369 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.583583 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.583683 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.583882 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.583970 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.584188 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.584275 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.584493 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.584617 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.584827 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.584915 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.585134 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.585223 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.585437 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.585617 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.585751 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.585837 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.586029 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.586126 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.586337 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.586433 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.586641 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.586729 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.586941 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.587037 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.587241 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.587330 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.587543 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.587638 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.587845 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.587932 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.588143 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.588233 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.588450 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.588577 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.588774 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.588862 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.589084 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.589173 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.589381 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.589469 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.589682 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.589771 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.589981 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.590072 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.590283 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.590371 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.590588 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.590686 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.590884 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.590971 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.591194 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.591280 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.591497 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.591596 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.591795 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.591927 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.592096 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.592192 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.592430 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.592526 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.592753 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.592842 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.593055 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.593143 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.593358 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.593458 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.593662 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.593752 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.593970 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.594057 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.594268 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.594357 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.594573 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.594662 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.594874 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.594964 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.595177 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.595267 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.595480 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.595567 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.595783 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.595870 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.596083 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.596172 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.596379 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.596466 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.596700 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.596790 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.597002 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.597099 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.597303 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.597390 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.597608 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.597705 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.597911 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.598005 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.598214 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.598303 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.598516 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.598613 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.598815 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.598904 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.599119 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.599208 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.599425 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.599523 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.599774 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.599864 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.600074 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.600162 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.600387 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.600484 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.600734 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.600835 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.601046 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.601136 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.601355 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.601445 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.601665 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.601762 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.601968 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.602056 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.602279 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.602368 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.602584 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.602672 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.602894 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.602986 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.603194 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.603284 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.603493 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.603581 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.603796 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.603883 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.604103 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.604192 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.604408 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.604504 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.604750 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.604849 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.605065 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.605155 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.605379 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.605467 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.605679 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.605777 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.605987 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.606076 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.606295 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.606384 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.606603 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.606698 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.606907 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.606994 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.607215 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.607303 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.607520 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.607616 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.608351 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.608452 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.608686 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.608777 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.608998 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.609097 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.609306 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.609395 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.609612 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.609702 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.609920 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.610008 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.610223 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.610310 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.610524 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.610613 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.610830 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.610918 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.611136 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.611230 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.611434 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.611523 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.611741 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.611831 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.612042 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.612131 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.612350 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.612445 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.612673 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.612762 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.612987 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.613086 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.613290 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.613393 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.613683 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.613778 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.613985 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.614073 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.614290 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.614453 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.614599 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.614688 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.614907 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.614995 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.615214 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.615310 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.615515 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.615604 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.615826 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.615914 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.616133 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.616242 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.616510 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.616674 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.616850 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.616947 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.617151 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.617248 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.617451 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.617540 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.617759 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.617853 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.618065 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.618162 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.618362 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.618450 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.618661 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.618757 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.618962 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.619116 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.619271 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.619366 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.619569 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.619656 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.619883 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.619980 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.620190 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.620278 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.620513 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.620729 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.620897 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.620985 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.621255 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.621350 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.621564 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.621666 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.621901 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.621989 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.622221 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.622335 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.622540 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.622630 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.622860 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.622958 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.623162 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.623255 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.624039 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.624141 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.624351 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.624449 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.624696 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.624786 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.625017 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.625104 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.625325 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.625488 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.625638 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.625728 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.625944 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.626032 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.626258 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.626347 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.626567 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.626713 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.626875 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.626964 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.627194 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.627284 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.627506 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.627602 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.627831 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.627920 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.628201 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.628290 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.628521 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.628636 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.628866 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.628966 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.629172 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.629262 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.629473 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.629577 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.629781 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.629879 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.630083 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.630171 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.630383 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.630477 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.630693 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.630790 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.630995 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.631091 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.631308 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.631397 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.631614 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.631712 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.631916 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.632005 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.632218 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.632351 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.632520 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.632639 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.632849 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.632937 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.633153 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.633241 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.633469 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.633567 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.633771 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.633860 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.634084 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.634179 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.634395 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.634484 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.634697 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.634793 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.635017 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.635106 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.635321 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.635409 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.635621 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.635710 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.635924 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.636014 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.636226 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.636316 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.636526 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.636671 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.636863 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.636962 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.637206 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.637295 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.637512 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.637610 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.637833 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.637932 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.638156 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.638244 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.638481 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.638569 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.638793 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.638890 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.639134 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.639221 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.639445 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.639534 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.639760 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.639859 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.640078 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.640166 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.640377 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.640477 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.640702 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.640794 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.641015 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.641105 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.641320 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.641415 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.641624 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.641719 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.641927 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.642014 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.642230 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.642319 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.642530 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.642627 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.642830 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.642919 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.643130 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.643218 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.643438 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.643527 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.643736 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.643824 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.644054 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.644152 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.644358 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.644446 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.644688 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.644779 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.644993 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.645092 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.645296 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.645385 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.645599 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.645686 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.645905 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.646002 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.646240 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.646377 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.646543 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.646631 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.646862 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.646959 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.647173 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.647269 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.647485 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.647573 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.647799 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.648138 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.648364 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.648454 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.648703 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.648792 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.649017 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.649107 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.649331 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.649427 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.649638 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.649734 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.649954 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.650049 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.650264 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.650358 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.650581 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.650677 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.650900 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.651099 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.651222 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.651424 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.651738 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.651834 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.652050 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.652146 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.652362 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.652488 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.652701 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.652808 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.653018 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.653113 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.653324 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.653455 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.653633 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.653732 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.653944 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.654031 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.654249 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.654336 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.654559 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.654649 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.654893 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.654984 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.655212 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.655299 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.655534 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.655630 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.655845 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.655934 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.656159 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.656248 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.656471 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.656590 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.656809 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.656906 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.657122 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.657218 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.657437 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.657526 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.657752 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.657841 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.658063 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.658153 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.658378 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.658466 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.658690 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.658779 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.659002 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.659092 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.659312 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.659408 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.659621 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.659709 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.659930 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.660020 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.660238 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.660327 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.660589 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.660682 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.660881 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.660972 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.661192 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.661279 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.661508 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.661605 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.661824 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.661914 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.662137 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.662225 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.662449 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.662547 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.662762 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.662853 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.663076 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.663166 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.663390 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.663593 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.663709 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.663905 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.664232 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.664322 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.664575 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.664668 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.664895 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.664992 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.665209 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.665343 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.665525 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.665615 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.665846 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.665933 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.666149 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.666248 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.666451 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.666586 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.666760 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.666850 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.667069 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.667158 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.667372 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.667470 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.667682 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.667770 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.667988 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.668083 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.668290 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.668416 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.668629 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.668737 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.668939 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.669041 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.669258 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.669469 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.669558 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.669811 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.670093 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.670192 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.670956 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.671045 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.671276 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.671363 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.671593 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.671682 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.671899 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.671995 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.672218 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.672307 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.672525 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.672641 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.672852 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.672941 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.673162 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.673250 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.673469 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.673557 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.673769 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.673856 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.674068 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.674157 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.674375 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.674465 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.674679 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.674767 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.674978 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.675075 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.675285 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.675374 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.675587 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.675676 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.675895 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.675990 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.676199 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.676286 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.676502 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.676608 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.676828 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.676929 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.677138 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.677225 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.677439 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.677526 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.677740 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.677838 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.678043 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.678133 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.678345 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.678434 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.678646 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.678742 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.678945 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.679033 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.679251 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.679340 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.679552 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.679649 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.679862 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.679951 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.680168 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.680263 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.680480 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.680595 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.680814 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.680912 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.681135 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.681224 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.681437 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.681527 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.681745 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.681834 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.682057 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.682145 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.682363 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.682452 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.682677 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.682764 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.682984 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.683080 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.683294 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.683383 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.683604 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.683700 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.683920 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.684081 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.684268 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.684452 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.684607 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.684813 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.685136 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.685234 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.685467 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.685554 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.685791 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.685887 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.686656 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.686797 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.686967 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.687056 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.687274 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.687363 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.687580 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.687669 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.687888 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.687977 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.688199 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.688288 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.688509 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.688654 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.688841 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.688930 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.689151 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.689250 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.689458 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.689548 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.689767 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.689855 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.690073 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.690170 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.690382 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.690470 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.690686 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.690774 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.690995 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.691093 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.691303 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.691392 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.691610 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.691705 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.691915 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.692015 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.692222 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.692310 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.692545 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.692636 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.692876 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.693003 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.693192 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.693281 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.693508 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.693597 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.693825 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.693922 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.694135 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.694226 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.694444 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.694534 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.694750 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.694840 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.695056 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.695146 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.695363 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.695451 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.695674 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.695765 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.695983 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.696072 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.696287 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.696385 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.696635 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.696947 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.697035 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.697297 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.697618 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.697716 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.697937 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.698025 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.698244 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.698339 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.698565 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.698663 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.698878 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.698966 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.699184 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.699279 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.699503 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.699593 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.699811 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.699901 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.700131 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.700219 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.700446 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.700572 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.700801 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.700889 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.701121 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.701224 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.701425 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.701534 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.701767 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.701857 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.702072 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.702169 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.702376 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.702464 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.702683 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.702773 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.702989 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.703075 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.703292 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.703380 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.703592 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.703681 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.703894 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.704000 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.704194 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.704282 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.704495 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.704601 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.704820 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.704911 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.705123 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.705210 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.705423 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.705519 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.705722 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.705814 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.706024 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.706114 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.706324 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.706413 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.706627 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.706717 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.706927 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.707016 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.707227 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.707328 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.707528 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.707617 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.707824 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.707913 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.708126 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.708229 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.708426 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.708523 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.708752 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.708842 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.709052 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.709153 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.709352 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.709440 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.709656 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.709747 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.709986 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.710090 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.710304 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.710392 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.710613 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.710702 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.710975 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.711080 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.711238 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.711331 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.711558 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.711646 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.711869 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.711968 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.712178 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.712273 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.712485 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.712593 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.712827 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.712916 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.713134 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.713222 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.713445 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.713536 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.713756 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.713848 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.714064 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.714153 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.714368 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.714463 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.714675 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.714769 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.714982 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.715070 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.715294 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.715395 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.715598 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.715686 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.715920 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.716018 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.716223 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.716320 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.716585 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.716678 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.716877 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.716966 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.717227 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.717332 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.717559 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.717649 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.717871 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.717965 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.718177 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.718266 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.718484 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.718574 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.718793 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.718882 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.719100 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.719190 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.719408 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.719533 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.719713 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.719809 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.720022 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.720121 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.720329 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.720417 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.720667 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.720772 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.720991 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.721080 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.721309 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.721398 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.721635 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.721734 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.721953 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.722041 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.722261 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.722350 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.722585 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.722683 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.722898 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.722995 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.723239 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.723327 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.723551 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.723639 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.723864 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.723952 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.724175 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.724264 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.724477 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.724621 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.724744 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 18:38:40.724835 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.725130 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:38:40.725376 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 18:38:40.877435 n-d-860863-1 devstack@n-api.service[111438]: INFO dbcounter [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Registered counter for database nova_api Oct 10 18:38:40.878456 n-d-860863-1 devstack@n-api.service[111437]: INFO dbcounter [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] Registered counter for database nova_api Oct 10 18:38:40.898882 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_db.sqlalchemy.engines [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:38:40.900957 n-d-860863-1 devstack@n-api.service[111437]: DEBUG oslo_db.sqlalchemy.engines [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:38:40.905528 n-d-860863-1 devstack@n-api.service[111438]: DEBUG dbcounter [-] [111438] Writer thread running {{(pid=111438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:38:40.907479 n-d-860863-1 devstack@n-api.service[111437]: DEBUG dbcounter [-] [111437] Writer thread running {{(pid=111437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:38:40.961196 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.context [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1649e55c-2282-4aa8-b943-d6661d4bffa2(cell1) {{(pid=111438) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 18:38:40.963311 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.context [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1649e55c-2282-4aa8-b943-d6661d4bffa2(cell1) {{(pid=111437) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 18:38:40.965020 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:38:40.965491 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:38:40.967049 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:38:40.967200 n-d-860863-1 devstack@n-api.service[111437]: DEBUG oslo_concurrency.lockutils [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:38:40.967673 n-d-860863-1 devstack@n-api.service[111437]: DEBUG oslo_concurrency.lockutils [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:38:40.967816 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:38:40.968302 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:38:40.969298 n-d-860863-1 devstack@n-api.service[111437]: DEBUG oslo_concurrency.lockutils [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:38:40.970021 n-d-860863-1 devstack@n-api.service[111437]: DEBUG oslo_concurrency.lockutils [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:38:40.970246 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:38:40.970468 n-d-860863-1 devstack@n-api.service[111437]: DEBUG oslo_concurrency.lockutils [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:38:40.972194 n-d-860863-1 devstack@n-api.service[111438]: INFO dbcounter [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Registered counter for database nova_cell0 Oct 10 18:38:40.972429 n-d-860863-1 devstack@n-api.service[111437]: DEBUG oslo_concurrency.lockutils [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:38:40.974408 n-d-860863-1 devstack@n-api.service[111437]: INFO dbcounter [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] Registered counter for database nova_cell0 Oct 10 18:38:40.976212 n-d-860863-1 devstack@n-api.service[111438]: INFO dbcounter [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Registered counter for database nova_cell1 Oct 10 18:38:40.978360 n-d-860863-1 devstack@n-api.service[111437]: INFO dbcounter [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] Registered counter for database nova_cell1 Oct 10 18:38:40.984083 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_db.sqlalchemy.engines [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:38:40.986365 n-d-860863-1 devstack@n-api.service[111437]: DEBUG oslo_db.sqlalchemy.engines [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:38:40.988768 n-d-860863-1 devstack@n-api.service[111438]: DEBUG dbcounter [-] [111438] Writer thread running {{(pid=111438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:38:40.989055 n-d-860863-1 devstack@n-api.service[111437]: DEBUG oslo_db.sqlalchemy.engines [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:38:40.992610 n-d-860863-1 devstack@n-api.service[111437]: DEBUG dbcounter [-] [111437] Writer thread running {{(pid=111437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:38:40.993238 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_db.sqlalchemy.engines [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:38:41.129202 n-d-860863-1 devstack@n-api.service[111438]: DEBUG dbcounter [-] [111438] Writer thread running {{(pid=111438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:38:41.130784 n-d-860863-1 devstack@n-api.service[111437]: DEBUG dbcounter [-] [111437] Writer thread running {{(pid=111437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:38:41.137760 n-d-860863-1 devstack@n-api.service[111438]: INFO dbcounter [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Registered counter for database nova_cell0 Oct 10 18:38:41.139907 n-d-860863-1 devstack@n-api.service[111437]: INFO dbcounter [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] Registered counter for database nova_cell0 Oct 10 18:38:41.146657 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_db.sqlalchemy.engines [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:38:41.150450 n-d-860863-1 devstack@n-api.service[111437]: DEBUG oslo_db.sqlalchemy.engines [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:38:41.151736 n-d-860863-1 devstack@n-api.service[111438]: DEBUG dbcounter [-] [111438] Writer thread running {{(pid=111438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:38:41.155679 n-d-860863-1 devstack@n-api.service[111437]: DEBUG dbcounter [-] [111437] Writer thread running {{(pid=111437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:38:41.610400 n-d-860863-1 devstack@n-api.service[111438]: WARNING keystonemiddleware.auth_token [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 18:38:41.617667 n-d-860863-1 devstack@n-api.service[111438]: WARNING keystonemiddleware.auth_token [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 18:38:41.641856 n-d-860863-1 devstack@n-api.service[111437]: WARNING keystonemiddleware.auth_token [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 18:38:41.649394 n-d-860863-1 devstack@n-api.service[111437]: WARNING keystonemiddleware.auth_token [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 18:38:41.958751 n-d-860863-1 devstack@n-api.service[111438]: WARNING keystonemiddleware.auth_token [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 18:38:41.964758 n-d-860863-1 devstack@n-api.service[111438]: WARNING keystonemiddleware.auth_token [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 18:38:41.970257 n-d-860863-1 devstack@n-api.service[111438]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e0eb1159c0 pid: 111438 (default app) Oct 10 18:38:41.972305 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:38:41.973514 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001741 Oct 10 18:38:41.973913 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Mon Oct 10 18:38:41 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:38:41.988477 n-d-860863-1 devstack@n-api.service[111437]: WARNING keystonemiddleware.auth_token [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 18:38:41.994473 n-d-860863-1 devstack@n-api.service[111437]: WARNING keystonemiddleware.auth_token [None req-5ad34d96-b156-4ad1-8caf-0888b03a5123 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 18:38:42.000330 n-d-860863-1 devstack@n-api.service[111437]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e0eb1159c0 pid: 111437 (default app) Oct 10 18:40:05.240271 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:40:05.241320 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 10 18:40:05.241727 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 931 bytes} [Mon Oct 10 18:40:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:40:05.254148 n-d-860863-1 devstack@n-api.service[111437]: DEBUG dbcounter [-] [111437] Writing DB stats nova_api:SELECT=3 {{(pid=111437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:40:05.255085 n-d-860863-1 devstack@n-api.service[111437]: DEBUG dbcounter [-] [111437] Writing DB stats nova_cell0:SELECT=3 {{(pid=111437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:40:05.256093 n-d-860863-1 devstack@n-api.service[111437]: DEBUG dbcounter [-] [111437] Writing DB stats nova_cell1:SELECT=3 {{(pid=111437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:40:05.258047 n-d-860863-1 devstack@n-api.service[111437]: DEBUG dbcounter [-] [111437] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:40:06.121863 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-291de1ed-2fcb-4f14-be28-97fb47fb3ba9 admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:40:06.155227 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-291de1ed-2fcb-4f14-be28-97fb47fb3ba9 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.906157 Oct 10 18:40:06.155966 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1292 bytes} [Mon Oct 10 18:40:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:40:08.742041 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:40:08.742740 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-ac61f50c-88db-4fcf-833b-ec84df07d3ca None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001388 Oct 10 18:40:08.743300 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 931 bytes} [Mon Oct 10 18:40:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:40:09.211386 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-619e0937-5d38-44c3-86dc-9286a03e8a2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "disk": 1, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:09.317946 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-619e0937-5d38-44c3-86dc-9286a03e8a2c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.568067 Oct 10 18:40:09.318504 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1283 bytes} [Mon Oct 10 18:40:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 18:40:09.332019 n-d-860863-1 devstack@n-api.service[111438]: DEBUG dbcounter [-] [111438] Writing DB stats nova_api:SELECT=3 {{(pid=111438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:40:09.332857 n-d-860863-1 devstack@n-api.service[111438]: DEBUG dbcounter [-] [111438] Writing DB stats nova_cell1:SELECT=3 {{(pid=111438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:40:09.335017 n-d-860863-1 devstack@n-api.service[111438]: DEBUG dbcounter [-] [111438] Writing DB stats nova_cell0:SELECT=3 {{(pid=111438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:40:09.336355 n-d-860863-1 devstack@n-api.service[111438]: DEBUG dbcounter [-] [111438] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:40:09.542764 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-799fce78-71ea-4ed4-b853-45dfa886a451 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:09.636628 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-799fce78-71ea-4ed4-b853-45dfa886a451 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.309651 Oct 10 18:40:09.637260 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1336 bytes} [Mon Oct 10 18:40:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:40:12.332353 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-619e0937-5d38-44c3-86dc-9286a03e8a2c admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:40:12.334035 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-619e0937-5d38-44c3-86dc-9286a03e8a2c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002121 Oct 10 18:40:12.334521 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 931 bytes} [Mon Oct 10 18:40:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:40:13.175320 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-c4f848bc-35dc-455f-b41a-b672d421f402 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5}} {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:13.312244 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-c4f848bc-35dc-455f-b41a-b672d421f402 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.971543 Oct 10 18:40:13.313366 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1283 bytes} [Mon Oct 10 18:40:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:40:13.326320 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-27cfa9fe-6f26-467a-8055-6003bf495919 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:13.462815 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-27cfa9fe-6f26-467a-8055-6003bf495919 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141058 Oct 10 18:40:13.464483 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1336 bytes} [Mon Oct 10 18:40:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:40:16.419355 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-c4f848bc-35dc-455f-b41a-b672d421f402 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:40:16.420380 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-c4f848bc-35dc-455f-b41a-b672d421f402 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 10 18:40:16.421106 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 931 bytes} [Mon Oct 10 18:40:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:40:16.922069 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-07a9c437-3ce3-400d-9e21-da180618cdcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0}} {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:16.984388 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-07a9c437-3ce3-400d-9e21-da180618cdcc admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.557046 Oct 10 18:40:16.990621 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1283 bytes} [Mon Oct 10 18:40:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:40:16.998266 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-eb76c33d-0fd6-4e5f-8d14-6338487baedd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:17.057836 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-eb76c33d-0fd6-4e5f-8d14-6338487baedd admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064100 Oct 10 18:40:17.066810 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1336 bytes} [Mon Oct 10 18:40:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:40:19.679682 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-07a9c437-3ce3-400d-9e21-da180618cdcc admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:40:19.680746 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-07a9c437-3ce3-400d-9e21-da180618cdcc admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 10 18:40:19.681441 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 931 bytes} [Mon Oct 10 18:40:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:40:20.140471 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-80a9d5b8-ec86-44db-999e-71279c9a22a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:20.224082 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-80a9d5b8-ec86-44db-999e-71279c9a22a5 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.535578 Oct 10 18:40:20.224665 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1283 bytes} [Mon Oct 10 18:40:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 18:40:20.237433 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-cd640eea-dcc6-4d2d-972c-6efae2dec73c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:20.322118 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-cd640eea-dcc6-4d2d-972c-6efae2dec73c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087358 Oct 10 18:40:20.322118 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1336 bytes} [Mon Oct 10 18:40:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:40:23.002033 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-80a9d5b8-ec86-44db-999e-71279c9a22a5 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:40:23.003249 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-80a9d5b8-ec86-44db-999e-71279c9a22a5 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001659 Oct 10 18:40:23.003796 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 931 bytes} [Mon Oct 10 18:40:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:40:23.470978 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-47fcfa02-42a2-491a-994c-4117bd53605b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G"}} {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:23.566893 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-47fcfa02-42a2-491a-994c-4117bd53605b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.556973 Oct 10 18:40:23.567775 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1283 bytes} [Mon Oct 10 18:40:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 18:40:23.580229 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-c1c521bd-7dcf-4c25-a9b6-2a3f820fcfde admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:23.656642 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-c1c521bd-7dcf-4c25-a9b6-2a3f820fcfde admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079970 Oct 10 18:40:23.657438 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1336 bytes} [Mon Oct 10 18:40:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:40:26.369786 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-47fcfa02-42a2-491a-994c-4117bd53605b admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:40:26.371120 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-47fcfa02-42a2-491a-994c-4117bd53605b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001900 Oct 10 18:40:26.371729 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 931 bytes} [Mon Oct 10 18:40:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:40:26.816332 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-7e3acea0-7849-4180-bf41-230632dab444 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:40:26.847455 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-7e3acea0-7849-4180-bf41-230632dab444 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.468374 Oct 10 18:40:26.848468 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1292 bytes} [Mon Oct 10 18:40:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:40:30.003017 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-47fcfa02-42a2-491a-994c-4117bd53605b admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:40:30.004363 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-47fcfa02-42a2-491a-994c-4117bd53605b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001893 Oct 10 18:40:30.004939 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 931 bytes} [Mon Oct 10 18:40:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:40:30.420670 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-7ce6f9c3-933b-49fc-86bc-dca6ed52ec3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "id": "1"}} {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:30.499719 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-7ce6f9c3-933b-49fc-86bc-dca6ed52ec3a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.487057 Oct 10 18:40:30.500292 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1283 bytes} [Mon Oct 10 18:40:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 18:40:30.512935 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-722eb47c-fa14-4aed-a8a5-69b38cfb3d3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:30.603041 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-722eb47c-fa14-4aed-a8a5-69b38cfb3d3e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093858 Oct 10 18:40:30.603621 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1333 bytes} [Mon Oct 10 18:40:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:40:33.238841 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-7ce6f9c3-933b-49fc-86bc-dca6ed52ec3a admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:40:33.239839 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-7ce6f9c3-933b-49fc-86bc-dca6ed52ec3a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 10 18:40:33.240239 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 931 bytes} [Mon Oct 10 18:40:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:40:33.648338 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-450748a1-7660-4093-9787-0e50ac756a12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "id": "2"}} {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:33.729943 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-450748a1-7660-4093-9787-0e50ac756a12 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.483507 Oct 10 18:40:33.731079 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1283 bytes} [Mon Oct 10 18:40:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:40:33.743176 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-258f154d-fee7-4226-b299-9b8fce9693a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:33.822026 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-258f154d-fee7-4226-b299-9b8fce9693a2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082019 Oct 10 18:40:33.822533 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1333 bytes} [Mon Oct 10 18:40:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:40:36.392988 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-450748a1-7660-4093-9787-0e50ac756a12 admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:40:36.394180 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-450748a1-7660-4093-9787-0e50ac756a12 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 10 18:40:36.394468 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 931 bytes} [Mon Oct 10 18:40:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:40:36.837319 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-1828f4a2-f5ec-4036-accd-12c6dd5a7ec9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "name": "m1.medium", "ram": 4096, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:37.642924 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-1828f4a2-f5ec-4036-accd-12c6dd5a7ec9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.241449 Oct 10 18:40:37.643495 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1283 bytes} [Mon Oct 10 18:40:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 18:40:37.656521 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-57af2a03-3fb7-45be-afb8-816de258be94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:37.663592 n-d-860863-1 devstack@n-api.service[111437]: DEBUG dbcounter [-] [111437] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:40:37.730095 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-57af2a03-3fb7-45be-afb8-816de258be94 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077835 Oct 10 18:40:37.730728 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1333 bytes} [Mon Oct 10 18:40:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:40:40.341298 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-1828f4a2-f5ec-4036-accd-12c6dd5a7ec9 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:40:40.343057 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-1828f4a2-f5ec-4036-accd-12c6dd5a7ec9 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002217 Oct 10 18:40:40.343465 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 931 bytes} [Mon Oct 10 18:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:40:40.802536 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-310441a4-e600-4666-92a6-b2c92ec8f5eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:40.870015 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-310441a4-e600-4666-92a6-b2c92ec8f5eb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.520244 Oct 10 18:40:40.870575 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1283 bytes} [Mon Oct 10 18:40:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:40:40.882604 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-bdca1ed8-0fb7-4c93-9bc2-33086912c555 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:40.962218 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-bdca1ed8-0fb7-4c93-9bc2-33086912c555 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083061 Oct 10 18:40:40.962850 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1333 bytes} [Mon Oct 10 18:40:40 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:40:43.571318 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-310441a4-e600-4666-92a6-b2c92ec8f5eb admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:40:43.572381 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-310441a4-e600-4666-92a6-b2c92ec8f5eb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 10 18:40:43.572828 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 931 bytes} [Mon Oct 10 18:40:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:40:44.009442 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-4ce3e2c1-aa73-4533-b110-41f392e88ad2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160, "name": "m1.xlarge"}} {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:44.017550 n-d-860863-1 devstack@n-api.service[111438]: DEBUG dbcounter [-] [111438] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:40:44.124921 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-4ce3e2c1-aa73-4533-b110-41f392e88ad2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.545739 Oct 10 18:40:44.125862 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1283 bytes} [Mon Oct 10 18:40:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:40:44.138769 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-fae77d15-f264-4726-8f3b-97e26bd523e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:40:44.237662 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-fae77d15-f264-4726-8f3b-97e26bd523e8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103196 Oct 10 18:40:44.252563 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1333 bytes} [Mon Oct 10 18:40:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:41:03.690699 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-4ce3e2c1-aa73-4533-b110-41f392e88ad2 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:03.691706 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-4ce3e2c1-aa73-4533-b110-41f392e88ad2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 10 18:41:03.692107 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 931 bytes} [Mon Oct 10 18:41:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:41:03.702555 n-d-860863-1 devstack@n-api.service[111437]: DEBUG dbcounter [-] [111437] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:41:04.084059 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-b0d4e693-5dec-4c34-a8e0-ae6c8d35f65d admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:04.102484 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-b0d4e693-5dec-4c34-a8e0-ae6c8d35f65d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404415 Oct 10 18:41:04.103013 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1292 bytes} [Mon Oct 10 18:41:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:41:05.390885 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-4ce3e2c1-aa73-4533-b110-41f392e88ad2 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:05.395029 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-4ce3e2c1-aa73-4533-b110-41f392e88ad2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 10 18:41:05.395029 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Oct 10 18:41:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:41:05.921197 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-6a3d6433-d17a-4269-ac31-f5081d207545 admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:05.926605 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.wsgi [None req-6a3d6433-d17a-4269-ac31-f5081d207545 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-6a3d6433-d17a-4269-ac31-f5081d207545 admin admin] Request method failure captured: Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: Accept: application/json Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: Accept-Encoding: gzip, deflate Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: Connection: keep-alive Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: Content-Length: 0 Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: Host: 10.222.0.43 Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: Openstack-Api-Version: compute 2.92 Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: Openstack-System-Scope: None Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: User-Agent: python-novaclient Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: X-Auth-Token: gAAAAABjRGdBsTmMgYO7j6FWixk7pr4tSUrNr_IJcJ7PAXPVhXFgScMvbexi__1IGHgUCYKS3OiXn6p_clMAOs5TX1DbNMTQZEwh9-3PXwVOj5b4X0TaeHHnieDbiX6LUO6rBrsXMYMHnmphEquk7JBlP2nqheiDxEGzCKRsPZUKKFjVZMPxnnw Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: X-Domain-Id: None Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: X-Domain-Name: None Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: X-Identity-Status: Confirmed Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: X-Is-Admin-Project: True Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: X-Project-Domain-Id: default Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: X-Project-Domain-Name: Default Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: X-Project-Id: db73e4dde3df4b6887c8f821dd5ef31e Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: X-Project-Name: admin Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: X-Role: member,reader,admin Oct 10 18:41:05.929858 n-d-860863-1 devstack@n-api.service[111437]: X-Roles: member,reader,admin Oct 10 18:41:05.931605 n-d-860863-1 devstack@n-api.service[111437]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_db73e4dde3df4b6887c8f821dd5ef31e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/db73e4dde3df4b6887c8f821dd5ef31e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db73e4dde3df4b6887c8f821dd5ef31e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db73e4dde3df4b6887c8f821dd5ef31e"}]}] Oct 10 18:41:05.931605 n-d-860863-1 devstack@n-api.service[111437]: X-Tenant: admin Oct 10 18:41:05.931605 n-d-860863-1 devstack@n-api.service[111437]: X-Tenant-Id: db73e4dde3df4b6887c8f821dd5ef31e Oct 10 18:41:05.931605 n-d-860863-1 devstack@n-api.service[111437]: X-Tenant-Name: admin Oct 10 18:41:05.931605 n-d-860863-1 devstack@n-api.service[111437]: X-User: admin Oct 10 18:41:05.931605 n-d-860863-1 devstack@n-api.service[111437]: X-User-Domain-Id: default Oct 10 18:41:05.931605 n-d-860863-1 devstack@n-api.service[111437]: X-User-Domain-Name: Default Oct 10 18:41:05.931605 n-d-860863-1 devstack@n-api.service[111437]: X-User-Id: 8106f6bfa9e7436c8e6abf1d84db9e42 Oct 10 18:41:05.931605 n-d-860863-1 devstack@n-api.service[111437]: X-User-Name: admin Oct 10 18:41:05.931605 n-d-860863-1 devstack@n-api.service[111437]: method: > Oct 10 18:41:05.931605 n-d-860863-1 devstack@n-api.service[111437]: exception: Flavor 42 could not be found. Oct 10 18:41:05.931605 n-d-860863-1 devstack@n-api.service[111437]: action_args: {'id': '42'} Oct 10 18:41:05.931605 n-d-860863-1 devstack@n-api.service[111437]: {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:41:05.931605 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:41:05.932745 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:05.934740 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-6a3d6433-d17a-4269-ac31-f5081d207545 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:41:05.936153 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-6a3d6433-d17a-4269-ac31-f5081d207545 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.381644 Oct 10 18:41:05.936153 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Oct 10 18:41:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 383 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 18:41:05.941879 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-a91fa08b-f0bd-4016-a5a9-c564dcdfacd0 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:05.964084 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-a91fa08b-f0bd-4016-a5a9-c564dcdfacd0 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026105 Oct 10 18:41:05.966201 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Oct 10 18:41:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:41:05.992367 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-f6f21eac-84d6-4e10-936a-69cf80408d2b admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:06.015065 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-f6f21eac-84d6-4e10-936a-69cf80408d2b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027097 Oct 10 18:41:06.015597 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Oct 10 18:41:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:41:06.025235 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-cd325882-68d7-4a38-87a9-b12e4696b420 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:06.030715 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.wsgi [None req-cd325882-68d7-4a38-87a9-b12e4696b420 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-cd325882-68d7-4a38-87a9-b12e4696b420 admin admin] Request method failure captured: Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: Accept: application/json Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: Accept-Encoding: gzip, deflate Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: Connection: keep-alive Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: Content-Length: 0 Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: Host: 10.222.0.43 Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: Openstack-Api-Version: compute 2.92 Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: Openstack-System-Scope: None Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: User-Agent: python-novaclient Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: X-Auth-Token: gAAAAABjRGdBsTmMgYO7j6FWixk7pr4tSUrNr_IJcJ7PAXPVhXFgScMvbexi__1IGHgUCYKS3OiXn6p_clMAOs5TX1DbNMTQZEwh9-3PXwVOj5b4X0TaeHHnieDbiX6LUO6rBrsXMYMHnmphEquk7JBlP2nqheiDxEGzCKRsPZUKKFjVZMPxnnw Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: X-Domain-Id: None Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: X-Domain-Name: None Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: X-Identity-Status: Confirmed Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: X-Is-Admin-Project: True Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: X-Project-Domain-Id: default Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: X-Project-Domain-Name: Default Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: X-Project-Id: db73e4dde3df4b6887c8f821dd5ef31e Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: X-Project-Name: admin Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: X-Role: member,reader,admin Oct 10 18:41:06.033969 n-d-860863-1 devstack@n-api.service[111438]: X-Roles: member,reader,admin Oct 10 18:41:06.035600 n-d-860863-1 devstack@n-api.service[111438]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_db73e4dde3df4b6887c8f821dd5ef31e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/db73e4dde3df4b6887c8f821dd5ef31e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db73e4dde3df4b6887c8f821dd5ef31e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db73e4dde3df4b6887c8f821dd5ef31e"}]}] Oct 10 18:41:06.035600 n-d-860863-1 devstack@n-api.service[111438]: X-Tenant: admin Oct 10 18:41:06.035600 n-d-860863-1 devstack@n-api.service[111438]: X-Tenant-Id: db73e4dde3df4b6887c8f821dd5ef31e Oct 10 18:41:06.035600 n-d-860863-1 devstack@n-api.service[111438]: X-Tenant-Name: admin Oct 10 18:41:06.035600 n-d-860863-1 devstack@n-api.service[111438]: X-User: admin Oct 10 18:41:06.035600 n-d-860863-1 devstack@n-api.service[111438]: X-User-Domain-Id: default Oct 10 18:41:06.035600 n-d-860863-1 devstack@n-api.service[111438]: X-User-Domain-Name: Default Oct 10 18:41:06.035600 n-d-860863-1 devstack@n-api.service[111438]: X-User-Id: 8106f6bfa9e7436c8e6abf1d84db9e42 Oct 10 18:41:06.035600 n-d-860863-1 devstack@n-api.service[111438]: X-User-Name: admin Oct 10 18:41:06.035600 n-d-860863-1 devstack@n-api.service[111438]: method: > Oct 10 18:41:06.035600 n-d-860863-1 devstack@n-api.service[111438]: exception: Flavor 42 could not be found. Oct 10 18:41:06.035600 n-d-860863-1 devstack@n-api.service[111438]: action_args: {'id': '42'} Oct 10 18:41:06.035600 n-d-860863-1 devstack@n-api.service[111438]: {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:41:06.035600 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:41:06.036623 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:06.045205 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-cd325882-68d7-4a38-87a9-b12e4696b420 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:41:06.046516 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-cd325882-68d7-4a38-87a9-b12e4696b420 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014198 Oct 10 18:41:06.046516 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Oct 10 18:41:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 10 18:41:07.252821 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-f6f21eac-84d6-4e10-936a-69cf80408d2b admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:07.253865 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-f6f21eac-84d6-4e10-936a-69cf80408d2b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Oct 10 18:41:07.254258 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Oct 10 18:41:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:41:07.770210 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-f99a23c9-4789-4450-90c7-3aa9b0e77ab8 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:07.775597 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.wsgi [None req-f99a23c9-4789-4450-90c7-3aa9b0e77ab8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-f99a23c9-4789-4450-90c7-3aa9b0e77ab8 admin admin] Request method failure captured: Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: Accept: application/json Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: Accept-Encoding: gzip, deflate Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: Connection: keep-alive Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: Content-Length: 0 Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: Host: 10.222.0.43 Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: Openstack-Api-Version: compute 2.92 Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: Openstack-System-Scope: None Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: User-Agent: python-novaclient Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: X-Auth-Token: gAAAAABjRGdDWK5prSQtjrEPB2WSse9rCFPKgV5KIGoQ39OYbNhBx5GuH6C9P_rDv4yCG6oe5JYmFZhUijtMst8ZyGCsrDzHXa3ajx5oBqWc3FpPdcUXdiYNXh0vYki91d5TtwbeClfpdxiiV6_XTwvd_rFrsEjdBM5OKRWvzT3bSQbC8VVrSZ8 Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: X-Domain-Id: None Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: X-Domain-Name: None Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: X-Identity-Status: Confirmed Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: X-Is-Admin-Project: True Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: X-Project-Domain-Id: default Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: X-Project-Domain-Name: Default Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: X-Project-Id: db73e4dde3df4b6887c8f821dd5ef31e Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: X-Project-Name: admin Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: X-Role: member,reader,admin Oct 10 18:41:07.777152 n-d-860863-1 devstack@n-api.service[111438]: X-Roles: member,reader,admin Oct 10 18:41:07.779362 n-d-860863-1 devstack@n-api.service[111438]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_db73e4dde3df4b6887c8f821dd5ef31e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/db73e4dde3df4b6887c8f821dd5ef31e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db73e4dde3df4b6887c8f821dd5ef31e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db73e4dde3df4b6887c8f821dd5ef31e"}]}] Oct 10 18:41:07.779362 n-d-860863-1 devstack@n-api.service[111438]: X-Tenant: admin Oct 10 18:41:07.779362 n-d-860863-1 devstack@n-api.service[111438]: X-Tenant-Id: db73e4dde3df4b6887c8f821dd5ef31e Oct 10 18:41:07.779362 n-d-860863-1 devstack@n-api.service[111438]: X-Tenant-Name: admin Oct 10 18:41:07.779362 n-d-860863-1 devstack@n-api.service[111438]: X-User: admin Oct 10 18:41:07.779362 n-d-860863-1 devstack@n-api.service[111438]: X-User-Domain-Id: default Oct 10 18:41:07.779362 n-d-860863-1 devstack@n-api.service[111438]: X-User-Domain-Name: Default Oct 10 18:41:07.779362 n-d-860863-1 devstack@n-api.service[111438]: X-User-Id: 8106f6bfa9e7436c8e6abf1d84db9e42 Oct 10 18:41:07.779362 n-d-860863-1 devstack@n-api.service[111438]: X-User-Name: admin Oct 10 18:41:07.779362 n-d-860863-1 devstack@n-api.service[111438]: method: > Oct 10 18:41:07.779362 n-d-860863-1 devstack@n-api.service[111438]: exception: Flavor 84 could not be found. Oct 10 18:41:07.779362 n-d-860863-1 devstack@n-api.service[111438]: action_args: {'id': '84'} Oct 10 18:41:07.779362 n-d-860863-1 devstack@n-api.service[111438]: {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:41:07.779362 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:41:07.780416 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:07.781866 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-f99a23c9-4789-4450-90c7-3aa9b0e77ab8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:41:07.783199 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-f99a23c9-4789-4450-90c7-3aa9b0e77ab8 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389917 Oct 10 18:41:07.783199 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Oct 10 18:41:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 18:41:07.788864 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-51db48fc-acf3-4e54-a56e-ef2fabe67d2d admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:07.803506 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-51db48fc-acf3-4e54-a56e-ef2fabe67d2d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018179 Oct 10 18:41:07.804025 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Oct 10 18:41:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:41:07.813218 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-202b861b-9778-4c6c-bd29-98a9706a9cc8 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:07.829004 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-202b861b-9778-4c6c-bd29-98a9706a9cc8 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019270 Oct 10 18:41:07.829524 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Oct 10 18:41:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:41:07.838490 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-6951872c-787f-4b0a-adca-c137c9641467 admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:07.843954 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.wsgi [None req-6951872c-787f-4b0a-adca-c137c9641467 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-6951872c-787f-4b0a-adca-c137c9641467 admin admin] Request method failure captured: Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: Accept: application/json Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: Accept-Encoding: gzip, deflate Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: Connection: keep-alive Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: Content-Length: 0 Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: Host: 10.222.0.43 Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: Openstack-Api-Version: compute 2.92 Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: Openstack-System-Scope: None Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: User-Agent: python-novaclient Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: X-Auth-Token: gAAAAABjRGdDWK5prSQtjrEPB2WSse9rCFPKgV5KIGoQ39OYbNhBx5GuH6C9P_rDv4yCG6oe5JYmFZhUijtMst8ZyGCsrDzHXa3ajx5oBqWc3FpPdcUXdiYNXh0vYki91d5TtwbeClfpdxiiV6_XTwvd_rFrsEjdBM5OKRWvzT3bSQbC8VVrSZ8 Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: X-Domain-Id: None Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: X-Domain-Name: None Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: X-Identity-Status: Confirmed Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: X-Is-Admin-Project: True Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: X-Project-Domain-Id: default Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: X-Project-Domain-Name: Default Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: X-Project-Id: db73e4dde3df4b6887c8f821dd5ef31e Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: X-Project-Name: admin Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: X-Role: member,reader,admin Oct 10 18:41:07.845482 n-d-860863-1 devstack@n-api.service[111437]: X-Roles: member,reader,admin Oct 10 18:41:07.847046 n-d-860863-1 devstack@n-api.service[111437]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_db73e4dde3df4b6887c8f821dd5ef31e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/db73e4dde3df4b6887c8f821dd5ef31e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db73e4dde3df4b6887c8f821dd5ef31e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db73e4dde3df4b6887c8f821dd5ef31e"}]}] Oct 10 18:41:07.847046 n-d-860863-1 devstack@n-api.service[111437]: X-Tenant: admin Oct 10 18:41:07.847046 n-d-860863-1 devstack@n-api.service[111437]: X-Tenant-Id: db73e4dde3df4b6887c8f821dd5ef31e Oct 10 18:41:07.847046 n-d-860863-1 devstack@n-api.service[111437]: X-Tenant-Name: admin Oct 10 18:41:07.847046 n-d-860863-1 devstack@n-api.service[111437]: X-User: admin Oct 10 18:41:07.847046 n-d-860863-1 devstack@n-api.service[111437]: X-User-Domain-Id: default Oct 10 18:41:07.847046 n-d-860863-1 devstack@n-api.service[111437]: X-User-Domain-Name: Default Oct 10 18:41:07.847046 n-d-860863-1 devstack@n-api.service[111437]: X-User-Id: 8106f6bfa9e7436c8e6abf1d84db9e42 Oct 10 18:41:07.847046 n-d-860863-1 devstack@n-api.service[111437]: X-User-Name: admin Oct 10 18:41:07.847046 n-d-860863-1 devstack@n-api.service[111437]: method: > Oct 10 18:41:07.847046 n-d-860863-1 devstack@n-api.service[111437]: exception: Flavor 84 could not be found. Oct 10 18:41:07.847046 n-d-860863-1 devstack@n-api.service[111437]: action_args: {'id': '84'} Oct 10 18:41:07.847046 n-d-860863-1 devstack@n-api.service[111437]: {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:41:07.847046 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:41:07.848131 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:07.849351 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-6951872c-787f-4b0a-adca-c137c9641467 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:41:07.850414 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-6951872c-787f-4b0a-adca-c137c9641467 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011820 Oct 10 18:41:07.850414 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Oct 10 18:41:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 10 18:41:09.055208 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-202b861b-9778-4c6c-bd29-98a9706a9cc8 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:09.056204 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-202b861b-9778-4c6c-bd29-98a9706a9cc8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Oct 10 18:41:09.056629 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Oct 10 18:41:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:41:09.565989 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-549394e8-a7d7-4d0e-be4e-eb701456a3ed admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:09.571645 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.wsgi [None req-549394e8-a7d7-4d0e-be4e-eb701456a3ed admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-549394e8-a7d7-4d0e-be4e-eb701456a3ed admin admin] Request method failure captured: Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: Accept: application/json Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: Accept-Encoding: gzip, deflate Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: Connection: keep-alive Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: Content-Length: 0 Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: Host: 10.222.0.43 Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: Openstack-Api-Version: compute 2.92 Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: Openstack-System-Scope: None Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: User-Agent: python-novaclient Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: X-Auth-Token: gAAAAABjRGdEOrF_PFTvxJd7SR2lRSXZ1DR0umnfU3sfAmCShzh5CUol6RYsEHqsJfMuqBwRUBgTCsat47nUttrRvsDPNKBU64O_a1VkTSEkhs2s624qwtWzV1JgynCr2lbpzp16MTtvp7J2oH2rRX4l9lbzhMsCA5NyuCixMvUpFykeMbCSkL8 Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: X-Domain-Id: None Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: X-Domain-Name: None Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: X-Identity-Status: Confirmed Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: X-Is-Admin-Project: True Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: X-Project-Domain-Id: default Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: X-Project-Domain-Name: Default Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: X-Project-Id: db73e4dde3df4b6887c8f821dd5ef31e Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: X-Project-Name: admin Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: X-Role: member,reader,admin Oct 10 18:41:09.573164 n-d-860863-1 devstack@n-api.service[111437]: X-Roles: member,reader,admin Oct 10 18:41:09.575288 n-d-860863-1 devstack@n-api.service[111437]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_db73e4dde3df4b6887c8f821dd5ef31e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/db73e4dde3df4b6887c8f821dd5ef31e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db73e4dde3df4b6887c8f821dd5ef31e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db73e4dde3df4b6887c8f821dd5ef31e"}]}] Oct 10 18:41:09.575288 n-d-860863-1 devstack@n-api.service[111437]: X-Tenant: admin Oct 10 18:41:09.575288 n-d-860863-1 devstack@n-api.service[111437]: X-Tenant-Id: db73e4dde3df4b6887c8f821dd5ef31e Oct 10 18:41:09.575288 n-d-860863-1 devstack@n-api.service[111437]: X-Tenant-Name: admin Oct 10 18:41:09.575288 n-d-860863-1 devstack@n-api.service[111437]: X-User: admin Oct 10 18:41:09.575288 n-d-860863-1 devstack@n-api.service[111437]: X-User-Domain-Id: default Oct 10 18:41:09.575288 n-d-860863-1 devstack@n-api.service[111437]: X-User-Domain-Name: Default Oct 10 18:41:09.575288 n-d-860863-1 devstack@n-api.service[111437]: X-User-Id: 8106f6bfa9e7436c8e6abf1d84db9e42 Oct 10 18:41:09.575288 n-d-860863-1 devstack@n-api.service[111437]: X-User-Name: admin Oct 10 18:41:09.575288 n-d-860863-1 devstack@n-api.service[111437]: method: > Oct 10 18:41:09.575288 n-d-860863-1 devstack@n-api.service[111437]: exception: Flavor 451 could not be found. Oct 10 18:41:09.575288 n-d-860863-1 devstack@n-api.service[111437]: action_args: {'id': '451'} Oct 10 18:41:09.575288 n-d-860863-1 devstack@n-api.service[111437]: {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:41:09.575288 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:41:09.576251 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: ERROR nova.api.openstack.wsgi Oct 10 18:41:09.577686 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-549394e8-a7d7-4d0e-be4e-eb701456a3ed admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:41:09.578974 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-549394e8-a7d7-4d0e-be4e-eb701456a3ed admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.384549 Oct 10 18:41:09.578974 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Oct 10 18:41:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 10 18:41:09.585783 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-71157aae-e2fb-4aca-b5c2-e0efab1a9337 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:09.605200 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-71157aae-e2fb-4aca-b5c2-e0efab1a9337 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022945 Oct 10 18:41:09.605789 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Oct 10 18:41:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:41:09.615192 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-25394aad-71ff-4abd-bb31-fe1ae72cda66 admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:09.630604 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-25394aad-71ff-4abd-bb31-fe1ae72cda66 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018839 Oct 10 18:41:09.631142 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Oct 10 18:41:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:41:09.641249 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-1ddeb95d-25e6-4864-8de5-a92ab4e8e567 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:09.646244 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.wsgi [None req-1ddeb95d-25e6-4864-8de5-a92ab4e8e567 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-1ddeb95d-25e6-4864-8de5-a92ab4e8e567 admin admin] Request method failure captured: Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: Accept: application/json Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: Accept-Encoding: gzip, deflate Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: Connection: keep-alive Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: Content-Length: 0 Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: Host: 10.222.0.43 Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: Openstack-Api-Version: compute 2.92 Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: Openstack-System-Scope: None Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: User-Agent: python-novaclient Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: X-Auth-Token: gAAAAABjRGdEOrF_PFTvxJd7SR2lRSXZ1DR0umnfU3sfAmCShzh5CUol6RYsEHqsJfMuqBwRUBgTCsat47nUttrRvsDPNKBU64O_a1VkTSEkhs2s624qwtWzV1JgynCr2lbpzp16MTtvp7J2oH2rRX4l9lbzhMsCA5NyuCixMvUpFykeMbCSkL8 Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: X-Domain-Id: None Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: X-Domain-Name: None Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: X-Identity-Status: Confirmed Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: X-Is-Admin-Project: True Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: X-Openstack-Nova-Api-Version: 2.92 Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: X-Project-Domain-Id: default Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: X-Project-Domain-Name: Default Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: X-Project-Id: db73e4dde3df4b6887c8f821dd5ef31e Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: X-Project-Name: admin Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: X-Role: member,reader,admin Oct 10 18:41:09.647742 n-d-860863-1 devstack@n-api.service[111438]: X-Roles: member,reader,admin Oct 10 18:41:09.649764 n-d-860863-1 devstack@n-api.service[111438]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_db73e4dde3df4b6887c8f821dd5ef31e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/db73e4dde3df4b6887c8f821dd5ef31e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db73e4dde3df4b6887c8f821dd5ef31e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/db73e4dde3df4b6887c8f821dd5ef31e"}]}] Oct 10 18:41:09.649764 n-d-860863-1 devstack@n-api.service[111438]: X-Tenant: admin Oct 10 18:41:09.649764 n-d-860863-1 devstack@n-api.service[111438]: X-Tenant-Id: db73e4dde3df4b6887c8f821dd5ef31e Oct 10 18:41:09.649764 n-d-860863-1 devstack@n-api.service[111438]: X-Tenant-Name: admin Oct 10 18:41:09.649764 n-d-860863-1 devstack@n-api.service[111438]: X-User: admin Oct 10 18:41:09.649764 n-d-860863-1 devstack@n-api.service[111438]: X-User-Domain-Id: default Oct 10 18:41:09.649764 n-d-860863-1 devstack@n-api.service[111438]: X-User-Domain-Name: Default Oct 10 18:41:09.649764 n-d-860863-1 devstack@n-api.service[111438]: X-User-Id: 8106f6bfa9e7436c8e6abf1d84db9e42 Oct 10 18:41:09.649764 n-d-860863-1 devstack@n-api.service[111438]: X-User-Name: admin Oct 10 18:41:09.649764 n-d-860863-1 devstack@n-api.service[111438]: method: > Oct 10 18:41:09.649764 n-d-860863-1 devstack@n-api.service[111438]: exception: Flavor 451 could not be found. Oct 10 18:41:09.649764 n-d-860863-1 devstack@n-api.service[111438]: action_args: {'id': '451'} Oct 10 18:41:09.649764 n-d-860863-1 devstack@n-api.service[111438]: {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:41:09.649764 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:41:09.650696 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: ERROR nova.api.openstack.wsgi Oct 10 18:41:09.652108 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-1ddeb95d-25e6-4864-8de5-a92ab4e8e567 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:41:09.653464 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-1ddeb95d-25e6-4864-8de5-a92ab4e8e567 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012080 Oct 10 18:41:09.653464 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Oct 10 18:41:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 10 18:41:10.847818 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-25394aad-71ff-4abd-bb31-fe1ae72cda66 admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:10.848874 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-25394aad-71ff-4abd-bb31-fe1ae72cda66 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Oct 10 18:41:10.849269 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Oct 10 18:41:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:41:11.364235 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-e22dabe0-3c0f-4b4d-b4f3-03c601335df4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:41:11.428552 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-e22dabe0-3c0f-4b4d-b4f3-03c601335df4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.442573 Oct 10 18:41:11.429116 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Oct 10 18:41:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:41:12.634783 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-25394aad-71ff-4abd-bb31-fe1ae72cda66 admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:12.635818 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-25394aad-71ff-4abd-bb31-fe1ae72cda66 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 10 18:41:12.636210 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Oct 10 18:41:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:41:13.148252 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-40ce8ebd-e8b6-42e7-9f1f-726073193890 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:41:13.225799 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-40ce8ebd-e8b6-42e7-9f1f-726073193890 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.454918 Oct 10 18:41:13.226336 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Oct 10 18:41:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:41:14.427590 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-25394aad-71ff-4abd-bb31-fe1ae72cda66 admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:14.428658 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-25394aad-71ff-4abd-bb31-fe1ae72cda66 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 10 18:41:14.429052 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Oct 10 18:41:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:41:14.945490 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-e07ab296-50ba-4940-a96d-725be4fb2aac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:41:15.014411 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-e07ab296-50ba-4940-a96d-725be4fb2aac admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.449074 Oct 10 18:41:15.014946 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Oct 10 18:41:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:41:16.224176 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-25394aad-71ff-4abd-bb31-fe1ae72cda66 admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:16.225240 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-25394aad-71ff-4abd-bb31-fe1ae72cda66 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Oct 10 18:41:16.225632 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Oct 10 18:41:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:41:16.747241 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-ce3ed41b-8414-47c0-812e-8e4a986437ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:41:16.826541 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-ce3ed41b-8414-47c0-812e-8e4a986437ec admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.463536 Oct 10 18:41:16.827202 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Oct 10 18:41:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:41:18.018988 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-25394aad-71ff-4abd-bb31-fe1ae72cda66 admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:18.019994 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-25394aad-71ff-4abd-bb31-fe1ae72cda66 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 10 18:41:18.020387 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Oct 10 18:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:41:18.534200 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-a2ce8dda-97d0-4f0b-8442-a03dbec9b4af admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:41:18.555059 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-a2ce8dda-97d0-4f0b-8442-a03dbec9b4af admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.398682 Oct 10 18:41:18.555601 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Mon Oct 10 18:41:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:42:14.712086 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-25394aad-71ff-4abd-bb31-fe1ae72cda66 admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:42:14.713690 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-25394aad-71ff-4abd-bb31-fe1ae72cda66 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 10 18:42:14.714089 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 931 bytes} [Mon Oct 10 18:42:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:42:14.724740 n-d-860863-1 devstack@n-api.service[111438]: DEBUG dbcounter [-] [111438] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:42:15.098970 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-02b319b3-c408-4634-997e-8a451374589a admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:42:15.118936 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-02b319b3-c408-4634-997e-8a451374589a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398654 Oct 10 18:42:15.119462 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1292 bytes} [Mon Oct 10 18:42:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:42:15.140348 n-d-860863-1 devstack@n-api.service[111437]: DEBUG dbcounter [-] [111437] Writing DB stats nova_api:SELECT=14 {{(pid=111437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:42:15.143986 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-aa95c7fe-e8e5-46a7-bd70-b2f44443131a admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:42:15.151882 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-aa95c7fe-e8e5-46a7-bd70-b2f44443131a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012971 Oct 10 18:42:15.152387 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1283 bytes} [Mon Oct 10 18:42:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:42:15.163601 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-70d9dfc9-d551-47be-b6f1-aa7ae65a17cd admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:42:15.170951 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-70d9dfc9-d551-47be-b6f1-aa7ae65a17cd admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010884 Oct 10 18:42:15.171464 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1286 bytes} [Mon Oct 10 18:42:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:42:15.182669 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-faebf2d1-a092-4d47-9c83-bd4ac12223b1 admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:42:15.189589 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-faebf2d1-a092-4d47-9c83-bd4ac12223b1 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010634 Oct 10 18:42:15.190088 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1286 bytes} [Mon Oct 10 18:42:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:42:15.201505 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-0aedfd6a-75d1-4095-a86b-fd9132159b29 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:42:15.208625 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-0aedfd6a-75d1-4095-a86b-fd9132159b29 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011027 Oct 10 18:42:15.209186 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1283 bytes} [Mon Oct 10 18:42:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:47:50.992056 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-faebf2d1-a092-4d47-9c83-bd4ac12223b1 admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:47:50.993099 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-faebf2d1-a092-4d47-9c83-bd4ac12223b1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 10 18:47:50.993494 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Oct 10 18:47:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:47:51.138225 n-d-860863-1 devstack@n-api.service[111438]: DEBUG dbcounter [-] [111438] Writing DB stats nova_api:SELECT=6 {{(pid=111438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:47:51.276716 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-abe02a11-c346-4c71-8689-5546679098d6 admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:47:51.281455 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-abe02a11-c346-4c71-8689-5546679098d6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:47:51.281932 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-abe02a11-c346-4c71-8689-5546679098d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:47:51.282390 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-abe02a11-c346-4c71-8689-5546679098d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:47:51.283103 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-abe02a11-c346-4c71-8689-5546679098d6 admin admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:47:51.283552 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-abe02a11-c346-4c71-8689-5546679098d6 admin admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:47:51.283970 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-abe02a11-c346-4c71-8689-5546679098d6 admin admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:47:51.322137 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-abe02a11-c346-4c71-8689-5546679098d6 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.185335 Oct 10 18:47:51.322698 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Oct 10 18:47:51 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:47:52.388256 n-d-860863-1 devstack@n-api.service[111437]: DEBUG nova.api.openstack.wsgi [None req-faebf2d1-a092-4d47-9c83-bd4ac12223b1 admin admin] Calling method '>' {{(pid=111437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:47:52.389390 n-d-860863-1 devstack@n-api.service[111437]: INFO nova.api.openstack.requestlog [None req-faebf2d1-a092-4d47-9c83-bd4ac12223b1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Oct 10 18:47:52.389782 n-d-860863-1 devstack@n-api.service[111437]: [pid: 111437|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Oct 10 18:47:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:47:52.580679 n-d-860863-1 devstack@n-api.service[111438]: DEBUG nova.api.openstack.wsgi [None req-f9ee1d7f-9f05-47d0-8119-fb2bfb2feead admin admin] Calling method '>' {{(pid=111438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:47:52.584083 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-f9ee1d7f-9f05-47d0-8119-fb2bfb2feead admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:47:52.584596 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-f9ee1d7f-9f05-47d0-8119-fb2bfb2feead admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:47:52.585028 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-f9ee1d7f-9f05-47d0-8119-fb2bfb2feead admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:47:52.585739 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-f9ee1d7f-9f05-47d0-8119-fb2bfb2feead admin admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:47:52.586191 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-f9ee1d7f-9f05-47d0-8119-fb2bfb2feead admin admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:47:52.586636 n-d-860863-1 devstack@n-api.service[111438]: DEBUG oslo_concurrency.lockutils [None req-f9ee1d7f-9f05-47d0-8119-fb2bfb2feead admin admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:47:52.609470 n-d-860863-1 devstack@n-api.service[111438]: INFO nova.api.openstack.requestlog [None req-f9ee1d7f-9f05-47d0-8119-fb2bfb2feead admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.081002 Oct 10 18:47:52.609956 n-d-860863-1 devstack@n-api.service[111438]: [pid: 111438|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Oct 10 18:47:52 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:48:37.916315 n-d-860863-1 devstack@n-api.service[111436]: Mon Oct 10 18:48:37 2022 - graceful shutdown triggered... Oct 10 18:48:37.916638 n-d-860863-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 10 18:48:37.917428 n-d-860863-1 devstack@n-api.service[111437]: Gracefully killing worker 1 (pid: 111437)... Oct 10 18:48:37.917859 n-d-860863-1 devstack@n-api.service[111438]: Gracefully killing worker 2 (pid: 111438)... Oct 10 18:48:38.043167 n-d-860863-1 devstack@n-api.service[111437]: DEBUG dbcounter [-] [111437] Writing DB stats nova_api:SELECT=4 {{(pid=111437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:48:38.918499 n-d-860863-1 devstack@n-api.service[111436]: worker 1 buried after 1 seconds Oct 10 18:48:38.919044 n-d-860863-1 devstack@n-api.service[111436]: worker 2 buried after 1 seconds Oct 10 18:48:38.919044 n-d-860863-1 devstack@n-api.service[111436]: goodbye to uWSGI. Oct 10 18:48:38.920096 n-d-860863-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 10 18:48:38.920788 n-d-860863-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 10 18:48:38.923575 n-d-860863-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 10 18:48:38.941112 n-d-860863-1 devstack@n-api.service[127276]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 10 18:48:38.960471 n-d-860863-1 devstack@n-api.service[127276]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 10 18:48:38 2022] *** Oct 10 18:48:38.960471 n-d-860863-1 devstack@n-api.service[127276]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 10 18:48:38.960471 n-d-860863-1 devstack@n-api.service[127276]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 10 18:48:38.960471 n-d-860863-1 devstack@n-api.service[127276]: nodename: n-d-860863-1 Oct 10 18:48:38.960471 n-d-860863-1 devstack@n-api.service[127276]: machine: x86_64 Oct 10 18:48:38.960471 n-d-860863-1 devstack@n-api.service[127276]: clock source: unix Oct 10 18:48:38.960471 n-d-860863-1 devstack@n-api.service[127276]: pcre jit disabled Oct 10 18:48:38.960471 n-d-860863-1 devstack@n-api.service[127276]: detected number of CPU cores: 4 Oct 10 18:48:38.960471 n-d-860863-1 devstack@n-api.service[127276]: current working directory: / Oct 10 18:48:38.960471 n-d-860863-1 devstack@n-api.service[127276]: detected binary path: /usr/bin/uwsgi-core Oct 10 18:48:38.960471 n-d-860863-1 devstack@n-api.service[127276]: your processes number limit is 47680 Oct 10 18:48:38.961698 n-d-860863-1 devstack@n-api.service[127276]: your memory page size is 4096 bytes Oct 10 18:48:38.961698 n-d-860863-1 devstack@n-api.service[127276]: detected max file descriptor number: 2048 Oct 10 18:48:38.961698 n-d-860863-1 devstack@n-api.service[127276]: lock engine: pthread robust mutexes Oct 10 18:48:38.961698 n-d-860863-1 devstack@n-api.service[127276]: thunder lock: enabled Oct 10 18:48:38.961698 n-d-860863-1 devstack@n-api.service[127276]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 10 18:48:38.961698 n-d-860863-1 devstack@n-api.service[127276]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 10 18:48:39.000907 n-d-860863-1 devstack@n-api.service[127276]: Python main interpreter initialized at 0x55f8048b49c0 Oct 10 18:48:39.000907 n-d-860863-1 devstack@n-api.service[127276]: python threads support enabled Oct 10 18:48:39.000907 n-d-860863-1 devstack@n-api.service[127276]: your server socket listen backlog is limited to 100 connections Oct 10 18:48:39.000907 n-d-860863-1 devstack@n-api.service[127276]: your mercy for graceful operations on workers is 90 seconds Oct 10 18:48:39.001362 n-d-860863-1 devstack@n-api.service[127276]: mapped 403077 bytes (393 KB) for 2 cores Oct 10 18:48:39.001362 n-d-860863-1 devstack@n-api.service[127276]: *** Operational MODE: preforking *** Oct 10 18:48:39.001584 n-d-860863-1 devstack@n-api.service[127276]: *** uWSGI is running in multiple interpreter mode *** Oct 10 18:48:39.001584 n-d-860863-1 devstack@n-api.service[127276]: spawned uWSGI master process (pid: 127276) Oct 10 18:48:39.001809 n-d-860863-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 10 18:48:39.002946 n-d-860863-1 devstack@n-api.service[127276]: spawned uWSGI worker 1 (pid: 127288, cores: 1) Oct 10 18:48:39.002946 n-d-860863-1 devstack@n-api.service[127276]: spawned uWSGI worker 2 (pid: 127289, cores: 1) Oct 10 18:48:39.002946 n-d-860863-1 devstack@n-api.service[127276]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 10 18:48:39.660618 n-d-860863-1 devstack@n-api.service[127289]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 18:48:39.667541 n-d-860863-1 devstack@n-api.service[127288]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 10 18:48:40.850886 n-d-860863-1 devstack@n-api.service[127289]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 18:48:40.850886 n-d-860863-1 devstack@n-api.service[127289]: from cryptography.utils import int_from_bytes Oct 10 18:48:40.851496 n-d-860863-1 devstack@n-api.service[127289]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 18:48:40.851496 n-d-860863-1 devstack@n-api.service[127289]: from cryptography.utils import int_from_bytes Oct 10 18:48:40.858573 n-d-860863-1 devstack@n-api.service[127288]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 18:48:40.858573 n-d-860863-1 devstack@n-api.service[127288]: from cryptography.utils import int_from_bytes Oct 10 18:48:40.859080 n-d-860863-1 devstack@n-api.service[127288]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 10 18:48:40.859080 n-d-860863-1 devstack@n-api.service[127288]: from cryptography.utils import int_from_bytes Oct 10 18:48:43.279041 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 18:48:43.279687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 18:48:43.279796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 18:48:43.280124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 18:48:43.280386 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 18:48:43.280810 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.281186 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.281530 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.281851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.282189 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.282512 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.282842 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.283168 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.283501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.283766 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.284087 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.284602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860863-1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.284941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.285258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.285576 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.285906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.286216 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.286546 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.286871 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.287391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.288691 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.288691 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.288691 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.289007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.289129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.289446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.289773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.290089 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.290422 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.290739 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.291150 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860863-1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.291478 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.291798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.292116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.292568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.292897 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.293210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.293528 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.293858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.294171 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.294504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.294831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.295155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.295479 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.295789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.296105 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.296419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.296801 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.297213 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 10 18:48:43.297709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.297811 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 10 18:48:43.297899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.297899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.298069 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 10 18:48:43.298167 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.298384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 10 18:48:43.298499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.298641 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 10 18:48:43.298748 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.299030 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.299124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.299288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.299389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.299543 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.299677 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.299866 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.300004 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.300192 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.300340 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.300508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.300675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.300845 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.300987 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.301159 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.301307 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.301475 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.301642 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.301787 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.301907 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.302097 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.302229 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.302418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.302690 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860863-1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.302799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.303023 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.303138 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.303337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.303450 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.303653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.303747 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.303963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.304065 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.304274 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.304379 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.304630 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.304740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.304948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.305048 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.305264 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.305465 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.305611 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.305782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.305936 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.306136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.306256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.306404 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.306557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.306748 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.306884 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.307068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.307198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.307384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.307508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.307708 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.307809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.308021 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.308129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.308351 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.308459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.308703 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.308815 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.309022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.309123 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860863-1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.309331 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.309428 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.309644 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.309752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.309967 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.310070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.310279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.310379 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.310591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.310693 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.310903 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.310997 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.311214 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.311316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.311529 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.311632 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.311842 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.311946 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.312153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.312254 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.313084 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.313213 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.313389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.313490 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.313703 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.313797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.314015 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.314117 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.314329 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.314424 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.314639 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.314740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.314948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.315042 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.315274 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.315375 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.315590 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.315681 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.315851 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.315951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.316143 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.316259 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.316474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.316613 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.316825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.316918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.317150 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.317252 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.317403 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.317497 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.317657 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.317774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.317985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.318090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.318309 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.318402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.318623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.318716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.318938 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.319047 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.319258 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.319370 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.319567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.319672 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.319880 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.319984 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.320183 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.320274 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.320493 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.320636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.320828 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.320929 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.321140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.321248 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.321449 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.321556 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.321760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.321860 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.322068 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.322162 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.322375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.322479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.322683 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.322787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.322991 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.323099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.323347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.323438 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.323588 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.323681 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.323910 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.324002 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.324235 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.324332 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.324589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.324688 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.324881 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.324975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.325190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.325284 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.325499 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.325591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.325814 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.325909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.326139 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.326236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.326566 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.326685 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.326773 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.326874 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.327036 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.327214 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.327331 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.327461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.327640 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.327787 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.328023 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.328725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.328905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.329042 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.329184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.329344 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.329559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.329693 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.329831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.329963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.330103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.330248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.330391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.330522 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.330653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.330837 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.330981 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.331170 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.331313 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.331492 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.331634 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.331816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.331961 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.332142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.332278 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.332451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.332636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.332783 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.332926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.333095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.333379 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.333525 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.333668 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.333800 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.333948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.334087 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.334220 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.334365 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.334498 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.334639 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.334771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.334933 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.335076 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.335247 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.335384 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.335562 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.335706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.335891 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.336041 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.336203 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.336340 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.336513 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.336683 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.336906 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.337054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.337193 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.337326 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.337464 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.337596 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.337766 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.337912 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.338073 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.338217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.338387 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.338531 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.338708 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.338859 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.339036 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.339174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.339314 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.339454 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.339599 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.339816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.339960 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.340101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.340239 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.340371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.340510 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.340696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.340849 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.341024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.341159 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.341346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.341481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.341698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.341840 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.341972 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.342103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.342286 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.342428 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.342605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.342748 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.342917 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.343050 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.343228 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.343376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 10 18:48:43.343672 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.343809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.343941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.344073 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.344211 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.344344 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.344485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.344670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.344820 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.344960 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.345139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.345284 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.345483 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.345624 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.345799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.345934 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.346118 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.346260 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.346435 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.346569 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.346753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.346902 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.347121 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.347265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.347401 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.347532 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.347670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.347801 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.347976 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.348118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.348306 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.348439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.348646 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.348788 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.348960 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.349132 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.349289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.349421 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.349599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.349739 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.349982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.350125 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.350257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.350388 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.350519 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.350650 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.350823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.350965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.351139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.351282 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.351452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.351595 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.351788 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.351931 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.352106 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.352249 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.352422 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.352610 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.352791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.352927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.354124 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.354289 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.354433 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.354577 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.354577 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.354826 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.354959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.355089 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.355089 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.355357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.355357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.355613 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.355753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.355901 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.356033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.356164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.356287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.356418 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.356586 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.356714 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.356863 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.357004 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.357151 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.357368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.357504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.357635 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.357789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.357930 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.358074 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.358205 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.358337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.358469 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.358614 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.358754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.358886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.359017 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.359194 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.359340 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.359484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.359617 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.359750 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.359880 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.360109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.360255 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.360388 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.360528 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.360697 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.360838 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.360977 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.361118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.361257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.361396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.361536 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.361674 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.361813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.361955 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.362093 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.362225 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.362356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.362488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.362629 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.362774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.362907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.363045 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.363177 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.363358 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.363493 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.363621 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.363742 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.363861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.363975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.364087 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.364231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.364424 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.364625 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.364763 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.364909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.365052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.365199 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.365348 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.365489 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.365621 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.365760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.365900 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.366070 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.366206 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.366389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.366522 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.366702 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.366843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.367024 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.367166 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.367429 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.367581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.367722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.367871 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.368012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.368144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.368276 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.368415 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.368573 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.368721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.368883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.369024 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.369204 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.369338 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.369511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.369656 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.369836 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.369972 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.370206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.370348 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.370493 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.370702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.370844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.370975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.371107 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.371245 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.371386 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.371518 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.371690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.371825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.371998 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.372133 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.372298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.372459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.372623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.372758 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.372928 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.373066 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.373238 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.373374 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.373549 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.373684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.373861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.374005 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.374173 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.374309 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.374487 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.374624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.374799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.375432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.375641 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.375746 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.375949 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.376065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.376262 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.376395 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.376591 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.376695 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.376905 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.377063 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.377225 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.377371 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.378152 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.378291 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.378425 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.378565 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.378711 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.378853 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.378986 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.379118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.379288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.379423 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.379570 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.379702 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.379834 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.379972 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.380112 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.380266 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.380494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.380660 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.380802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.380943 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.381075 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.381214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.381355 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.381496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.381636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.381767 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.381898 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.382027 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.382172 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.382311 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.382450 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.382589 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.382721 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.382861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.383000 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.383138 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.383270 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.383401 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.383541 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.383679 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.383810 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.383940 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.384070 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.384200 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.384367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.384520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.384761 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.384905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.385044 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.385184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.385316 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.385457 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.385597 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.385729 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.385867 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.385999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.386142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.386275 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.386435 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.386584 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.386753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.386888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.387084 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.387314 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.387457 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.387589 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.387729 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.387861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.388006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.388144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.388354 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.388498 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.388665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.388800 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.388945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.389084 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.389367 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.389505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.389712 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.389856 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.390027 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.390173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.390346 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.390558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.391265 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.391474 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.391618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.391760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.391899 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.392046 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.392179 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.392310 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.392449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.392666 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.392823 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.392970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.393103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.393235 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.393373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.393548 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.393698 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.393862 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.393997 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.394179 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.394322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.394490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.394638 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.394791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.395002 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.395138 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.395276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.395408 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.395548 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.395688 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.395830 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.395995 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.396132 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.396308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.396453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.396647 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.396791 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.396971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.397107 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.397282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.397425 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.397601 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.397742 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.397912 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.398047 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.398243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.398414 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.398628 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.398769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.398919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.399109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.399253 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.399429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.399429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.399680 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.399811 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.399951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.400333 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.400477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.400662 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.400807 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.401018 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.401173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.401326 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.401540 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.401675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.401806 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.401945 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.402137 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.402264 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.402426 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.402564 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.402704 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.402927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.403097 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.403214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.403336 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.403460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.403575 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.403770 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.403922 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.404053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.404174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.404368 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.404491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.404713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.404837 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.405051 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.405180 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.405343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.405474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.405671 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.405788 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.405954 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.406109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.406292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.406416 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.406619 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.406750 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.406938 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.407261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.407392 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.407550 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.407671 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.408582 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.408705 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.408803 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.408884 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.409224 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.409326 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.409421 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.409530 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.409631 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.409721 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.409808 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.409932 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.410022 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.410168 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.410259 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.410361 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.410460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.410549 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.410734 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.410845 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.411048 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.411143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.411353 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.411453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.411662 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.411813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.411974 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.412077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.412287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.412389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.412617 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.412729 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.412932 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.413033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.413239 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.413331 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.413547 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.413649 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.413856 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.413950 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.414178 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.414279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.414490 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.414586 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.414800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.414899 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.415109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.415198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.415437 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.415538 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.415748 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.415844 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.416057 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.416165 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.416372 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.416474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.416705 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.416812 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.417015 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.417122 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.417326 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.417416 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.417636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.417736 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.417949 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.418137 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.418303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.418473 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.418625 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.418893 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.419057 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.419243 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.419483 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.419686 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.419847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.419995 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.420142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.420304 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.420461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.420635 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.420797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.420945 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.421101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.421354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.421354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.421638 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.421821 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.422067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.422229 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.422378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.422533 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.422688 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.423416 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.423575 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.423738 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.423894 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.424048 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.424196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.424342 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.424501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.424760 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.424920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.425067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.425231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.425451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.425619 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.425775 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.425930 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.426078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.426231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.426390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.426558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.426815 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.426975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.427131 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.427300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.427490 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.427682 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.427852 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.428031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.428184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.428367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.428518 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.428704 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.428873 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.429023 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.429170 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.429316 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.429488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.429800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.429956 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.430104 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.430258 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.430413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.430575 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.430724 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.430878 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.431036 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.431182 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.431328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.431484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.431631 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.431786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.431934 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.432106 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.432341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.432501 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.432686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.432846 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.433002 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.433169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.433326 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.433480 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.433635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.433791 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.433948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.434096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.434096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.434391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.434391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.434667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.434821 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.434978 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.435138 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.435285 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.435457 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.435686 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.435838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.435993 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.436155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.436321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.436469 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.436638 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.436797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.436958 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.437123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.437270 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.438031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.438258 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.438258 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.438601 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.438702 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.438786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.438877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.438963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.438963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.438963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.438963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.439262 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.439339 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.439339 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.439339 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.439544 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.439627 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.439863 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.439954 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.440031 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.440116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.440231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.440322 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.440519 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.440636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.440914 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.441055 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.441265 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.441390 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.441605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.441709 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.441921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.442018 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.442347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.442586 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.442683 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.442916 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.443022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.443236 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.443342 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.443555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.443657 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.443889 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.444062 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.444213 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.444309 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.444569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.444679 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.444875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.444979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.445209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.445311 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.445543 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.445654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.445858 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.445953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.446177 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.446271 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.446488 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.446588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.446801 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.446903 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.447120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.447223 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.447439 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.447542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.447760 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.447856 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.448108 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.448215 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.448426 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.448530 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.448778 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.448875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.449121 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.449259 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.449462 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.449598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.449779 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.449883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.450092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.450207 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.450403 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.450526 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.450715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.450820 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.451029 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.451136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.451343 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.451515 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.451659 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.451779 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.451970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.452067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.452280 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.452524 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.452725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.452898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.453070 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.453794 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.453968 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.454129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.454244 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.454444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.454549 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.454777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.454875 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.455100 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.455215 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.455432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.455542 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.455763 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.455865 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.456076 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.456173 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.456390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.456494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.456841 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.456951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.457163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.457259 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.457485 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.457589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.457805 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.457900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.458120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.458237 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.458432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.458555 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.458748 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.458865 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.459078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.459194 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.459389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.459541 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.459694 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.459849 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.459994 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.460102 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.460317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.460474 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.460697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.460813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.460949 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.461057 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.461374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.461480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.461689 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.461788 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.461999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.462104 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.462310 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.462532 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.462637 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.462860 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.463030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.463197 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.463372 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.463512 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.463663 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.463806 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.463948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.464121 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.464267 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.464429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.464645 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.464742 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.464831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.465066 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.465169 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.465377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.465674 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.465777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.466012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.466118 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.466328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.466430 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.466642 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.466757 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.466949 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.467057 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.467318 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.467419 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.467691 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.468028 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.468330 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.468444 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.468749 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.468854 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.469073 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.469166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.469408 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.469514 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.469735 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.469822 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.470061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.470170 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.470392 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.470488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.470715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.470800 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.471034 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.471132 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.471345 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.471439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.471657 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.471743 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.471972 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.472064 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.472296 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.472396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.472704 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.472816 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.473030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.473135 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.473462 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.473557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.473704 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.473878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.474013 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.474204 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.474460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.474654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.474813 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.474968 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.475202 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.475300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.475446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.475593 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.475749 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.475905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.476060 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.476330 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.476482 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.476714 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.476865 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.477020 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.477178 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.477325 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.477480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.477638 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.477793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.477960 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.478109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.478254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.478345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.478421 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.478616 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.478917 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.479134 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.479290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.479470 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.479636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.479871 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.480038 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.480192 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.480505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.480697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.480858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.480994 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.481180 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.481337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.481500 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.481672 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.481820 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.481997 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.482140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.482313 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.482459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.482643 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.482779 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.483097 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.483413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.483527 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.483734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.483832 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.484070 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.484310 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.484439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.484577 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.484793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.484919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.485120 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.485226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.485440 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.485559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.485761 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.485881 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.486240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.486430 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.486587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.486682 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.487022 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.487184 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.487344 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.487494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.487639 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.487790 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.487938 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.488098 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.488253 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.488401 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.488588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.488747 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.488896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.489053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.489201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.489357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.489510 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.489618 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.489735 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.489845 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.490064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.490158 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.490422 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.490529 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.490699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.490837 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.491006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.491105 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.491343 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.491438 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.491638 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.491725 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.491950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.492182 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.492434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.492557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.492800 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.492904 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.493124 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.493265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.493440 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.493595 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.493757 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.493909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.494085 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.494284 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.494437 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.494584 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.494750 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.494913 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.495065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.495245 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.495390 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.495563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.495709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.495876 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.496021 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.496191 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.496338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.496509 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.496690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.496852 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.496950 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.497138 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.497235 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.497452 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.497548 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.497763 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.497859 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.498076 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.498186 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.498409 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.498511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.498727 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.498833 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.499038 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.499147 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.499360 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.499467 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.499680 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.499781 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.500514 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.500644 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.500870 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.500986 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.501182 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.501277 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.501502 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.501606 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.501815 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.501910 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.502137 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.502238 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.502453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.502550 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.502771 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.502895 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.503214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.503334 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.503435 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.503521 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.503697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.503801 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.504012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.504117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.504325 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.504411 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.504660 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.504768 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.504973 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.505083 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.505289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.505385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.505604 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.505699 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.505928 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.506090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.506261 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.506355 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.506576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.506671 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.506890 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.506995 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.507205 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.507461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.507642 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.507802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.508030 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.508192 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.508349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.508498 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.508750 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.508887 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.509050 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.509218 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.509376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.509500 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.509698 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.509798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.510032 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.510130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.511089 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.511199 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.511288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.511376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.511454 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.511618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.511709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.511794 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.511878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.511963 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.512048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.512131 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.512208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.512289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.512470 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.512596 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.512856 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.512966 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.513119 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.513430 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.513430 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.513628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.513734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.514897 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.515022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.515120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.515222 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.515321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.515419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.515565 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.516147 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.516247 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.516346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.516436 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.516530 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.516660 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.516753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.516836 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.517088 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.517398 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.517728 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.517930 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.518105 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.518207 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.518355 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.518575 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.518743 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.518989 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.519090 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.519241 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.519390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.519541 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.519694 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.519844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.519987 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.520145 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.520290 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.520445 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.520650 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.520899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.521040 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.521214 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.521353 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.521545 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.521691 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.521867 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.521973 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.522161 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.522304 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.522451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.522603 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.522745 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.522901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.523046 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.523193 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.523363 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.523655 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.523807 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.523963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.524104 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.524250 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.524402 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.524556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.524720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.524878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.525029 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.525423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.525552 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.525657 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.525860 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.525964 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.526186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.526290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.526493 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.526596 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.526800 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.526912 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.527113 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.527209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.527422 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.527517 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.527746 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.527842 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.528058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.528152 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.528365 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.528473 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.528714 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.528811 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.529034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.529204 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.529347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.529568 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.529666 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.529906 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.530001 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.530231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.530344 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.530549 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.530644 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.531443 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.531559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.531659 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.531749 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.531847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.531944 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.532041 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.532140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.532252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.532352 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.532443 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.532589 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.532767 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.532891 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.533078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.533216 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.533387 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.533495 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.533733 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.533828 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.533989 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.534099 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.534300 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.534390 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.534620 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.534736 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.534918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.535022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.535226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.535321 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.535535 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.535641 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.535842 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.535939 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.536149 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.536245 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.536458 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.536582 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.536826 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.536933 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.537166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.537261 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.537519 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.537627 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.537833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.537939 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.538152 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.538248 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.538473 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.539784 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.539882 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.539961 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.540037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.540112 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.540196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.540283 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.540283 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.540429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.540505 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.540722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.540806 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.540897 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.540981 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.541058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.541147 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.541231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.541317 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.541400 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.541627 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.541721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.541963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.542056 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.542286 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.542390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.542595 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.542687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.542910 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.543004 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.543233 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.543328 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.543546 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.543639 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.543890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.543977 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.544168 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.544253 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.544568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.544678 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.544830 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.545153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.545488 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.545821 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.546137 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.546470 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.547336 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.547692 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.551268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.551268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.551268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.551268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.551268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.551268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.551268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 18:48:43.556583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.556583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.556583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.556583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.556583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.556583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.556583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.556583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.557220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.557220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.557220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.557220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.557492 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.558292 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.558623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.558943 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.559263 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.559579 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.559895 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.560209 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.560521 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.560882 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.561194 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.561627 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.561942 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.562256 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.563464 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.563639 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.564121 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.564396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.564862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.565186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.565519 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.565842 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.566171 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.566485 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.566814 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.567142 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.567464 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.567885 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.568238 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.568563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.568898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.569220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.569565 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.569884 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.570202 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.570540 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.570958 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.571279 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.571733 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.572062 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.572414 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.572763 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.573117 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.573540 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.573858 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.574307 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.574633 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.574953 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.575269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.575588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.575904 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.576221 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.576559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.576893 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.577228 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.577561 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.578015 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.578359 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.578696 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.579047 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.579366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.579712 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.580045 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.580361 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.580700 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.581013 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 10 18:48:43.581257 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 10 18:48:43.612334 n-d-860863-1 devstack@n-api.service[127288]: INFO dbcounter [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] Registered counter for database nova_api Oct 10 18:48:43.633689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_db.sqlalchemy.engines [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:48:43.640746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writer thread running {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:48:43.646764 n-d-860863-1 devstack@n-api.service[127289]: INFO dbcounter [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] Registered counter for database nova_api Oct 10 18:48:43.668112 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_db.sqlalchemy.engines [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:48:43.675980 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writer thread running {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:48:43.698743 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.context [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1649e55c-2282-4aa8-b943-d6661d4bffa2(cell1) {{(pid=127288) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 18:48:43.702832 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:48:43.703361 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:48:43.704941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:48:43.705727 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:48:43.706178 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:48:43.708190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:48:43.710231 n-d-860863-1 devstack@n-api.service[127288]: INFO dbcounter [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] Registered counter for database nova_cell0 Oct 10 18:48:43.714359 n-d-860863-1 devstack@n-api.service[127288]: INFO dbcounter [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] Registered counter for database nova_cell1 Oct 10 18:48:43.721550 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_db.sqlalchemy.engines [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:48:43.725158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_db.sqlalchemy.engines [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:48:43.734724 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writer thread running {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:48:43.735924 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.context [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1649e55c-2282-4aa8-b943-d6661d4bffa2(cell1) {{(pid=127289) load_cells /opt/stack/nova/nova/context.py:464}} Oct 10 18:48:43.736183 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writer thread running {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:48:43.740182 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:48:43.740683 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:48:43.742234 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:48:43.742977 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:48:43.743421 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:48:43.745461 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:48:43.747727 n-d-860863-1 devstack@n-api.service[127289]: INFO dbcounter [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] Registered counter for database nova_cell0 Oct 10 18:48:43.752592 n-d-860863-1 devstack@n-api.service[127289]: INFO dbcounter [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] Registered counter for database nova_cell1 Oct 10 18:48:43.760357 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_db.sqlalchemy.engines [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:48:43.761857 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_db.sqlalchemy.engines [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:48:43.768826 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writer thread running {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:48:43.770138 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writer thread running {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:48:43.886414 n-d-860863-1 devstack@n-api.service[127288]: INFO dbcounter [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] Registered counter for database nova_cell0 Oct 10 18:48:43.893732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_db.sqlalchemy.engines [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:48:43.898158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writer thread running {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:48:43.921373 n-d-860863-1 devstack@n-api.service[127289]: INFO dbcounter [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] Registered counter for database nova_cell0 Oct 10 18:48:43.928838 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_db.sqlalchemy.engines [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 10 18:48:43.933374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writer thread running {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 10 18:48:44.220908 n-d-860863-1 devstack@n-api.service[127288]: WARNING keystonemiddleware.auth_token [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 18:48:44.228195 n-d-860863-1 devstack@n-api.service[127288]: WARNING keystonemiddleware.auth_token [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 18:48:44.256554 n-d-860863-1 devstack@n-api.service[127289]: WARNING keystonemiddleware.auth_token [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 18:48:44.263791 n-d-860863-1 devstack@n-api.service[127289]: WARNING keystonemiddleware.auth_token [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 18:48:44.573416 n-d-860863-1 devstack@n-api.service[127288]: WARNING keystonemiddleware.auth_token [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 18:48:44.580017 n-d-860863-1 devstack@n-api.service[127288]: WARNING keystonemiddleware.auth_token [None req-65fefade-ea57-40d0-b0f9-9a40a453f28f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 18:48:44.585394 n-d-860863-1 devstack@n-api.service[127288]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f8048b49c0 pid: 127288 (default app) Oct 10 18:48:44.610308 n-d-860863-1 devstack@n-api.service[127289]: WARNING keystonemiddleware.auth_token [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 10 18:48:44.616365 n-d-860863-1 devstack@n-api.service[127289]: WARNING keystonemiddleware.auth_token [None req-fab42ba4-11e2-4e20-89eb-93f8d37abc83 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 10 18:48:44.621728 n-d-860863-1 devstack@n-api.service[127289]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f8048b49c0 pid: 127289 (default app) Oct 10 18:49:26.101731 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:26.103078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:26.104139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:26.105248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:27.839425 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0168ff6c-b929-494a-acc5-b9aac5c91fb1 tempest-FlavorsV255TestJSON-283426598 tempest-FlavorsV255TestJSON-283426598-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1202895362", "id": 959744373, "os-flavor-access:is_public": "True"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:27.856857 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:27.861699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:27.865178 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:27.866734 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:28.031573 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0168ff6c-b929-494a-acc5-b9aac5c91fb1 tempest-FlavorsV255TestJSON-283426598 tempest-FlavorsV255TestJSON-283426598-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 1.944697 Oct 10 18:49:28.032511 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1/1] 10.222.0.43 () {62 vars in 1188 bytes} [Mon Oct 10 18:49:26 2022] POST /compute/v2.1/flavors => generated 446 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:49:28.492511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a85f4d17-0451-4387-9805-005d140aaa81 tempest-FlavorsV255TestJSON-616026959 tempest-FlavorsV255TestJSON-616026959-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:28.538904 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a85f4d17-0451-4387-9805-005d140aaa81 tempest-FlavorsV255TestJSON-616026959 tempest-FlavorsV255TestJSON-616026959-project] 10.222.0.43 "GET /compute/v2.1/flavors/959744373" status: 200 len: 446 microversion: 2.55 time: 0.470798 Oct 10 18:49:28.538904 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 2/2] 10.222.0.43 () {60 vars in 1196 bytes} [Mon Oct 10 18:49:28 2022] GET /compute/v2.1/flavors/959744373 => generated 446 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:49:28.841592 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-65fd2bc5-bb5d-473f-95f1-2d6c3419d5e6 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Calling method '.version_select at 0x7f318f93ee50>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:28.862210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-65fd2bc5-bb5d-473f-95f1-2d6c3419d5e6 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1649e55c-2282-4aa8-b943-d6661d4bffa2(cell1) {{(pid=127288) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 10 18:49:28.864716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fd2bc5-bb5d-473f-95f1-2d6c3419d5e6 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:28.865370 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fd2bc5-bb5d-473f-95f1-2d6c3419d5e6 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:28.866863 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fd2bc5-bb5d-473f-95f1-2d6c3419d5e6 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:28.906821 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fd2bc5-bb5d-473f-95f1-2d6c3419d5e6 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:28.907560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fd2bc5-bb5d-473f-95f1-2d6c3419d5e6 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:28.908141 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fd2bc5-bb5d-473f-95f1-2d6c3419d5e6 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:28.929556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fd2bc5-bb5d-473f-95f1-2d6c3419d5e6 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:28.930230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fd2bc5-bb5d-473f-95f1-2d6c3419d5e6 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:28.930807 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65fd2bc5-bb5d-473f-95f1-2d6c3419d5e6 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:28.940103 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-65fd2bc5-bb5d-473f-95f1-2d6c3419d5e6 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.423641 Oct 10 18:49:28.952092 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 3/3] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:49:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:29.012520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3edd66b1-660c-47f5-a0aa-0c6b04c18dd4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '.version_select at 0x7f318fa724c0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:29.034837 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3edd66b1-660c-47f5-a0aa-0c6b04c18dd4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1649e55c-2282-4aa8-b943-d6661d4bffa2(cell1) {{(pid=127289) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 10 18:49:29.035587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3edd66b1-660c-47f5-a0aa-0c6b04c18dd4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:29.036067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3edd66b1-660c-47f5-a0aa-0c6b04c18dd4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:29.036502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3edd66b1-660c-47f5-a0aa-0c6b04c18dd4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:29.091488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3edd66b1-660c-47f5-a0aa-0c6b04c18dd4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:29.095235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3edd66b1-660c-47f5-a0aa-0c6b04c18dd4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:29.095707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3edd66b1-660c-47f5-a0aa-0c6b04c18dd4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:29.121757 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3edd66b1-660c-47f5-a0aa-0c6b04c18dd4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:29.122862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3edd66b1-660c-47f5-a0aa-0c6b04c18dd4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:29.124376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3edd66b1-660c-47f5-a0aa-0c6b04c18dd4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:29.139550 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3edd66b1-660c-47f5-a0aa-0c6b04c18dd4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.290443 Oct 10 18:49:29.141194 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1/4] 10.222.0.43 () {58 vars in 1167 bytes} [Mon Oct 10 18:49:27 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:49:29.179229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1ba5ba17-71cb-4fbe-8ac5-178165d04df1 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Calling method '.version_select at 0x7f318f93eee0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:29.182990 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba5ba17-71cb-4fbe-8ac5-178165d04df1 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:29.183479 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba5ba17-71cb-4fbe-8ac5-178165d04df1 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:29.183909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba5ba17-71cb-4fbe-8ac5-178165d04df1 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:29.221287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba5ba17-71cb-4fbe-8ac5-178165d04df1 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:29.221840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba5ba17-71cb-4fbe-8ac5-178165d04df1 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:29.222296 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba5ba17-71cb-4fbe-8ac5-178165d04df1 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:29.240746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba5ba17-71cb-4fbe-8ac5-178165d04df1 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:29.241707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba5ba17-71cb-4fbe-8ac5-178165d04df1 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:29.242337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba5ba17-71cb-4fbe-8ac5-178165d04df1 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:29.254386 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1ba5ba17-71cb-4fbe-8ac5-178165d04df1 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.299300 Oct 10 18:49:29.254796 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 4/5] 10.222.0.43 () {60 vars in 1208 bytes} [Mon Oct 10 18:49:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:49:29.327285 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1160528523", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:29.515096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bb8b5d40-9126-4afb-a6ef-bb696b2eddda tempest-FlavorMetadataValidation-1493875714 tempest-FlavorMetadataValidation-1493875714-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1042256944", "id": 1694984227, "os-flavor-access:is_public": "True"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:29.614052 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bb8b5d40-9126-4afb-a6ef-bb696b2eddda tempest-FlavorMetadataValidation-1493875714 tempest-FlavorMetadataValidation-1493875714-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.357917 Oct 10 18:49:29.614930 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 5/6] 10.222.0.43 () {62 vars in 1188 bytes} [Mon Oct 10 18:49:29 2022] POST /compute/v2.1/flavors => generated 471 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:49:29.619657 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ddd675d0-1db3-4e21-8aba-3998a80f0c37 tempest-FlavorsV255TestJSON-283426598 tempest-FlavorsV255TestJSON-283426598-project-admin] Action: 'update', calling method: .version_select at 0x7f318fe29b80>, body: {"flavor": {"description": "new"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:29.720218 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ddd675d0-1db3-4e21-8aba-3998a80f0c37 tempest-FlavorsV255TestJSON-283426598 tempest-FlavorsV255TestJSON-283426598-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/959744373" status: 200 len: 447 microversion: 2.55 time: 0.104017 Oct 10 18:49:29.722985 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 6/7] 10.222.0.43 () {62 vars in 1216 bytes} [Mon Oct 10 18:49:29 2022] PUT /compute/v2.1/flavors/959744373 => generated 447 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:49:29.908965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] validate_networks() for None {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:49:29.974684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cd8b6038-e839-4e93-bbe5-312790a7d575 tempest-HypervisorAdminNegativeUnderV252Test-326302239 tempest-HypervisorAdminNegativeUnderV252Test-326302239-project] Calling method '.version_select at 0x7f318f8a53a0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:29.978301 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cd8b6038-e839-4e93-bbe5-312790a7d575 tempest-HypervisorAdminNegativeUnderV252Test-326302239 tempest-HypervisorAdminNegativeUnderV252Test-326302239-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'b5b3e9356256479594ce3dd86ce51b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57c9f45f8bb488897078a9d9f64dc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cd8b6038-e839-4e93-bbe5-312790a7d575 tempest-HypervisorAdminNegativeUnderV252Test-326302239 tempest-HypervisorAdminNegativeUnderV252Test-326302239-project] Request method failure captured: Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-hypervisors/n-h1-860863-1/search HTTP/1.1 Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk0Vj2mERMrRbwCyF6DUJpNTQfOhYhhY2eGKfofYC-n1vFM8OlrGOYFG9wGH6OICwxbG2-QTKAKIcRiJpQ0Xb0nFTkp6y40fWr1eyDkJ4QY48Qnk5ITOGs35ULctfqrkIF4y3Oqqd2RhvWOVQmWjd-ldYbUc48yGGEa5Kt6VZd0uN8 Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: a57c9f45f8bb488897078a9d9f64dc1b Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-326302239 Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:49:29.982380 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:49:29.985449 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a57c9f45f8bb488897078a9d9f64dc1b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a57c9f45f8bb488897078a9d9f64dc1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a57c9f45f8bb488897078a9d9f64dc1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a57c9f45f8bb488897078a9d9f64dc1b"}]}] Oct 10 18:49:29.985449 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-326302239 Oct 10 18:49:29.985449 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: a57c9f45f8bb488897078a9d9f64dc1b Oct 10 18:49:29.985449 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-326302239 Oct 10 18:49:29.985449 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-326302239-project Oct 10 18:49:29.985449 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:49:29.985449 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:49:29.985449 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: b5b3e9356256479594ce3dd86ce51b6d Oct 10 18:49:29.985449 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-326302239-project Oct 10 18:49:29.985449 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:49:29.985449 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 10 18:49:29.985449 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'n-h1-860863-1'} Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:49:29.986146 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 10 18:49:29.987150 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:29.990287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cd8b6038-e839-4e93-bbe5-312790a7d575 tempest-HypervisorAdminNegativeUnderV252Test-326302239 tempest-HypervisorAdminNegativeUnderV252Test-326302239-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:49:29.991490 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cd8b6038-e839-4e93-bbe5-312790a7d575 tempest-HypervisorAdminNegativeUnderV252Test-326302239 tempest-HypervisorAdminNegativeUnderV252Test-326302239-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/n-h1-860863-1/search" status: 403 len: 117 microversion: 2.1 time: 0.269002 Oct 10 18:49:29.992220 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 7/8] 10.222.0.43 () {58 vars in 1209 bytes} [Mon Oct 10 18:49:29 2022] GET /compute/v2.1/os-hypervisors/n-h1-860863-1/search => generated 117 bytes in 270 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:49:30.002937 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-dc7bbfef-577e-4ea8-bc35-ffe778ee2631 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-925990548", "name": "tempest-test_aggregate-2073804395"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:30.027675 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.aggregate [None req-dc7bbfef-577e-4ea8-bc35-ffe778ee2631 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Generated uuid 70251b91-2e47-434e-b664-cbb916e9815d for aggregate {{(pid=127288) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:49:30.199681 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-dc7bbfef-577e-4ea8-bc35-ffe778ee2631 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.201704 Oct 10 18:49:30.200505 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 8/9] 10.222.0.43 () {60 vars in 1165 bytes} [Mon Oct 10 18:49:29 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:30.214149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-013e4c3a-6f44-46b5-9711-4e155be3d2c0 tempest-FlavorMetadataValidation-1493875714 tempest-FlavorMetadataValidation-1493875714-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:30.401667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:49:30.402769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:49:30.403484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:49:30.404055 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:49:30.405301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:49:30.434302 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:30.434302 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:30.435089 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:30.436797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:30.437485 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:30.438149 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:30.477972 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Getting quotas for project 3977c93857c3448a9c51227abad2ecfb. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:49:30.486886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Getting quotas for user 162d1d44a68b4ce69b2eaf4627974335 and project 3977c93857c3448a9c51227abad2ecfb. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:49:30.503624 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:49:30.506993 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:49:30.604385 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-013e4c3a-6f44-46b5-9711-4e155be3d2c0 tempest-FlavorMetadataValidation-1493875714 tempest-FlavorMetadataValidation-1493875714-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1694984227/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.402399 Oct 10 18:49:30.606962 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 9/10] 10.222.0.43 () {62 vars in 1265 bytes} [Mon Oct 10 18:49:30 2022] POST /compute/v2.1/flavors/1694984227/os-extra_specs => generated 62 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:30.611285 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-49eb7917-c249-4081-88a5-c0346ba4bbfc tempest-FlavorsV255TestJSON-616026959 tempest-FlavorsV255TestJSON-616026959-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:30.664428 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-49eb7917-c249-4081-88a5-c0346ba4bbfc tempest-FlavorsV255TestJSON-616026959 tempest-FlavorsV255TestJSON-616026959-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6165 microversion: 2.55 time: 0.057745 Oct 10 18:49:30.666046 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 10/11] 10.222.0.43 () {60 vars in 1187 bytes} [Mon Oct 10 18:49:30 2022] GET /compute/v2.1/flavors/detail => generated 6165 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:49:30.670917 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a7af286b-f3a9-4c1a-9181-35f6271c1f2c tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Calling method '.version_select at 0x7f318f803dc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:30.673094 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7af286b-f3a9-4c1a-9181-35f6271c1f2c tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:30.673796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7af286b-f3a9-4c1a-9181-35f6271c1f2c tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:30.674437 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7af286b-f3a9-4c1a-9181-35f6271c1f2c tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:30.688312 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-a7af286b-f3a9-4c1a-9181-35f6271c1f2c tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a7af286b-f3a9-4c1a-9181-35f6271c1f2c tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Request method failure captured: Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk3WwItVPrVwVpNG6hAuX4HX54ayYqxTowECsY97BtlAvFDg_R4vlk456hlSNNzAC2dpcnPdDLuubf5dTHVfVJpygCYwSZGBsP56iZfWpdenTqN5ttsDOqnzSNYMHKZN9bk5U0_YKi_q-0n8YONXD7iWYdGT09iVdWLc1KZMW5P6pA Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 5ada3c821cc8437cba412668bdb4fbea Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1125001991 Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:49:30.690146 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:49:30.691607 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ada3c821cc8437cba412668bdb4fbea", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ada3c821cc8437cba412668bdb4fbea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ada3c821cc8437cba412668bdb4fbea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ada3c821cc8437cba412668bdb4fbea"}]}] Oct 10 18:49:30.691607 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1125001991 Oct 10 18:49:30.691607 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 5ada3c821cc8437cba412668bdb4fbea Oct 10 18:49:30.691607 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1125001991 Oct 10 18:49:30.691607 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin Oct 10 18:49:30.691607 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:49:30.691607 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:49:30.691607 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: a2636400620d45578bb1d5fd91cd3223 Oct 10 18:49:30.691607 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin Oct 10 18:49:30.691607 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:49:30.691607 n-d-860863-1 devstack@n-api.service[127288]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 10 18:49:30.691607 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:30.692266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:30.698477 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:30.698477 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:49:30.698477 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:49:30.698477 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 10 18:49:30.698477 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:30.698477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a7af286b-f3a9-4c1a-9181-35f6271c1f2c tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:49:30.698477 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a7af286b-f3a9-4c1a-9181-35f6271c1f2c tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.027425 Oct 10 18:49:30.698477 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 11/12] 10.222.0.43 () {58 vars in 1251 bytes} [Mon Oct 10 18:49:30 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:49:30.702556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2d1f7f41-be18-4aae-b0df-2a8248d5d7b0 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:30.721769 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-26d753f0-f7d3-4975-bd2f-f64c9ecf57bc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.579094 Oct 10 18:49:30.728420 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2d1f7f41-be18-4aae-b0df-2a8248d5d7b0 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.031955 Oct 10 18:49:30.729806 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 12/13] 10.222.0.43 () {58 vars in 1143 bytes} [Mon Oct 10 18:49:30 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:30.730482 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 2/14] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:49:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:49:30.736847 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e1deb4b6-579e-458c-ab9b-d8e2587696e9 tempest-FlavorMetadataValidation-1493875714 tempest-FlavorMetadataValidation-1493875714-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:30.855855 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e1deb4b6-579e-458c-ab9b-d8e2587696e9 tempest-FlavorMetadataValidation-1493875714 tempest-FlavorMetadataValidation-1493875714-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1694984227" status: 202 len: 0 microversion: 2.86 time: 0.123849 Oct 10 18:49:30.856434 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 3/15] 10.222.0.43 () {60 vars in 1202 bytes} [Mon Oct 10 18:49:30 2022] DELETE /compute/v2.1/flavors/1694984227 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:49:30.871716 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-acae36e2-9248-4eba-a343-88f042c02f7f tempest-FlavorsV255TestJSON-616026959 tempest-FlavorsV255TestJSON-616026959-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:30.932628 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-acae36e2-9248-4eba-a343-88f042c02f7f tempest-FlavorsV255TestJSON-616026959 tempest-FlavorsV255TestJSON-616026959-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.074866 Oct 10 18:49:30.935400 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 4/16] 10.222.0.43 () {60 vars in 1166 bytes} [Mon Oct 10 18:49:30 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:49:30.942336 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0e73ad11-7c93-43c2-b34b-398ec37e17fb tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Calling method '.version_select at 0x7f318f04b790>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:30.945086 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e73ad11-7c93-43c2-b34b-398ec37e17fb tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:30.945086 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e73ad11-7c93-43c2-b34b-398ec37e17fb tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:30.945891 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e73ad11-7c93-43c2-b34b-398ec37e17fb tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:30.967946 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e73ad11-7c93-43c2-b34b-398ec37e17fb tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:30.968574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e73ad11-7c93-43c2-b34b-398ec37e17fb tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:30.969453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e73ad11-7c93-43c2-b34b-398ec37e17fb tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:30.980786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e73ad11-7c93-43c2-b34b-398ec37e17fb tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:30.981291 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e73ad11-7c93-43c2-b34b-398ec37e17fb tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:30.981733 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e73ad11-7c93-43c2-b34b-398ec37e17fb tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:30.992105 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0e73ad11-7c93-43c2-b34b-398ec37e17fb tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.051418 Oct 10 18:49:30.999601 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1d822dfd-3942-4c7e-be34-2673453d85fd tempest-AZAdminNegativeTestJSON-1082384891 tempest-AZAdminNegativeTestJSON-1082384891-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:31.001071 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 5/17] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:49:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:31.001209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1d822dfd-3942-4c7e-be34-2673453d85fd tempest-AZAdminNegativeTestJSON-1082384891 tempest-AZAdminNegativeTestJSON-1082384891-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '1d93b2a1c2ee4a66bbdcd5a853febec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e37cdb283746d284f8b039f53613bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1d822dfd-3942-4c7e-be34-2673453d85fd tempest-AZAdminNegativeTestJSON-1082384891 tempest-AZAdminNegativeTestJSON-1082384891-project] Request method failure captured: Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk5yUvMYNIKTivmvUdRSe7K8j16QVxburdy2D5MwiaNdEVaAJvPk_tfUs7yAPw9Uf-BIAaO1QQ-rxgQ2YpsEGAyMAWG0LwTGkgj0gqm-vsQtTm22XpCUrecS5Ibx5doqlIHZMd4W3zY1Fy6geqj6UlNqFcSYOFbC3-WsUbQR-sA6yA Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 67e37cdb283746d284f8b039f53613bb Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1082384891 Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:49:31.003112 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:49:31.004570 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_67e37cdb283746d284f8b039f53613bb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/67e37cdb283746d284f8b039f53613bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/67e37cdb283746d284f8b039f53613bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/67e37cdb283746d284f8b039f53613bb"}]}] Oct 10 18:49:31.004570 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-AZAdminNegativeTestJSON-1082384891 Oct 10 18:49:31.004570 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 67e37cdb283746d284f8b039f53613bb Oct 10 18:49:31.004570 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1082384891 Oct 10 18:49:31.004570 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-AZAdminNegativeTestJSON-1082384891-project Oct 10 18:49:31.004570 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:49:31.004570 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:49:31.004570 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 1d93b2a1c2ee4a66bbdcd5a853febec0 Oct 10 18:49:31.004570 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-AZAdminNegativeTestJSON-1082384891-project Oct 10 18:49:31.004570 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:49:31.004570 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 10 18:49:31.004570 n-d-860863-1 devstack@n-api.service[127288]: action_args: {} Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:49:31.005331 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:31.006265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1d822dfd-3942-4c7e-be34-2673453d85fd tempest-AZAdminNegativeTestJSON-1082384891 tempest-AZAdminNegativeTestJSON-1082384891-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:49:31.007101 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1d822dfd-3942-4c7e-be34-2673453d85fd tempest-AZAdminNegativeTestJSON-1082384891 tempest-AZAdminNegativeTestJSON-1082384891-project] 10.222.0.43 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.273716 Oct 10 18:49:31.011193 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b217c8d0-56c0-4627-8b19-21451f2f94b9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:31.014348 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 13/18] 10.222.0.43 () {58 vars in 1185 bytes} [Mon Oct 10 18:49:30 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 281 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:49:31.014552 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b217c8d0-56c0-4627-8b19-21451f2f94b9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:31.020151 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-06539f85-d2f6-42a6-90c7-16039ee80bf6 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860863-1"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:31.041651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-06539f85-d2f6-42a6-90c7-16039ee80bf6 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:31.043426 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-06539f85-d2f6-42a6-90c7-16039ee80bf6 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:31.043426 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-06539f85-d2f6-42a6-90c7-16039ee80bf6 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:31.208601 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b217c8d0-56c0-4627-8b19-21451f2f94b9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:31.254813 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b217c8d0-56c0-4627-8b19-21451f2f94b9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1220 microversion: 2.1 time: 0.252176 Oct 10 18:49:31.255401 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 6/19] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:31 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1220 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:31.267851 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-781a8d0e-853e-4aab-99f8-190a9e07c389 tempest-FlavorMetadataValidation-1493875714 tempest-FlavorMetadataValidation-1493875714-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:31.330522 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-781a8d0e-853e-4aab-99f8-190a9e07c389 tempest-FlavorMetadataValidation-1493875714 tempest-FlavorMetadataValidation-1493875714-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6232 microversion: 2.86 time: 0.074000 Oct 10 18:49:31.331560 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 7/20] 10.222.0.43 () {60 vars in 1187 bytes} [Mon Oct 10 18:49:31 2022] GET /compute/v2.1/flavors/detail => generated 6232 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:49:31.339717 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dcddec6c-963d-4806-b4de-b470497e4117 tempest-FlavorsV255TestJSON-283426598 tempest-FlavorsV255TestJSON-283426598-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:31.435226 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dcddec6c-963d-4806-b4de-b470497e4117 tempest-FlavorsV255TestJSON-283426598 tempest-FlavorsV255TestJSON-283426598-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/959744373" status: 202 len: 0 microversion: 2.55 time: 0.100309 Oct 10 18:49:31.436414 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 8/21] 10.222.0.43 () {60 vars in 1199 bytes} [Mon Oct 10 18:49:31 2022] DELETE /compute/v2.1/flavors/959744373 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:49:31.442372 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ed1c7dc8-1db5-45a1-8e15-28b29570f0b0 tempest-HypervisorAdminNegativeUnderV252Test-326302239 tempest-HypervisorAdminNegativeUnderV252Test-326302239-project] Calling method '.version_select at 0x7f31902a1820>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:31.446190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ed1c7dc8-1db5-45a1-8e15-28b29570f0b0 tempest-HypervisorAdminNegativeUnderV252Test-326302239 tempest-HypervisorAdminNegativeUnderV252Test-326302239-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'b5b3e9356256479594ce3dd86ce51b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57c9f45f8bb488897078a9d9f64dc1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ed1c7dc8-1db5-45a1-8e15-28b29570f0b0 tempest-HypervisorAdminNegativeUnderV252Test-326302239 tempest-HypervisorAdminNegativeUnderV252Test-326302239-project] Request method failure captured: Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGk0Vj2mERMrRbwCyF6DUJpNTQfOhYhhY2eGKfofYC-n1vFM8OlrGOYFG9wGH6OICwxbG2-QTKAKIcRiJpQ0Xb0nFTkp6y40fWr1eyDkJ4QY48Qnk5ITOGs35ULctfqrkIF4y3Oqqd2RhvWOVQmWjd-ldYbUc48yGGEa5Kt6VZd0uN8 Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: a57c9f45f8bb488897078a9d9f64dc1b Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-326302239 Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:49:31.455609 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:49:31.456855 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a57c9f45f8bb488897078a9d9f64dc1b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a57c9f45f8bb488897078a9d9f64dc1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a57c9f45f8bb488897078a9d9f64dc1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a57c9f45f8bb488897078a9d9f64dc1b"}]}] Oct 10 18:49:31.456855 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-326302239 Oct 10 18:49:31.456855 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: a57c9f45f8bb488897078a9d9f64dc1b Oct 10 18:49:31.456855 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-326302239 Oct 10 18:49:31.456855 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-326302239-project Oct 10 18:49:31.456855 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:49:31.456855 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:49:31.456855 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: b5b3e9356256479594ce3dd86ce51b6d Oct 10 18:49:31.456855 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-326302239-project Oct 10 18:49:31.456855 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:49:31.456855 n-d-860863-1 devstack@n-api.service[127289]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 10 18:49:31.456855 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '1'} Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:49:31.457480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 10 18:49:31.458421 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:31.461182 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ed1c7dc8-1db5-45a1-8e15-28b29570f0b0 tempest-HypervisorAdminNegativeUnderV252Test-326302239 tempest-HypervisorAdminNegativeUnderV252Test-326302239-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:49:31.463071 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ed1c7dc8-1db5-45a1-8e15-28b29570f0b0 tempest-HypervisorAdminNegativeUnderV252Test-326302239 tempest-HypervisorAdminNegativeUnderV252Test-326302239-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.025133 Oct 10 18:49:31.464165 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 9/22] 10.222.0.43 () {58 vars in 1176 bytes} [Mon Oct 10 18:49:31 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:49:31.470018 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8857bf63-50a8-4700-841d-723fcdffa99c tempest-FlavorsV255TestJSON-283426598 tempest-FlavorsV255TestJSON-283426598-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:31.491500 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8857bf63-50a8-4700-841d-723fcdffa99c tempest-FlavorsV255TestJSON-283426598 tempest-FlavorsV255TestJSON-283426598-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.025577 Oct 10 18:49:31.501063 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 10/23] 10.222.0.43 () {60 vars in 1187 bytes} [Mon Oct 10 18:49:31 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:49:31.501063 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-40536235-32c2-443f-b3ad-8f7d2d9a5db2 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Calling method '.version_select at 0x7f318ef79f70>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:31.502349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40536235-32c2-443f-b3ad-8f7d2d9a5db2 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:31.510553 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40536235-32c2-443f-b3ad-8f7d2d9a5db2 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:31.510553 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40536235-32c2-443f-b3ad-8f7d2d9a5db2 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:31.529585 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-40536235-32c2-443f-b3ad-8f7d2d9a5db2 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] HTTP exception thrown: No hypervisor matching '17d99adb-98db-4aec-bc4d-5d5721d2c6a4' could be found. Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-40536235-32c2-443f-b3ad-8f7d2d9a5db2 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Request method failure captured: Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-hypervisors/17d99adb-98db-4aec-bc4d-5d5721d2c6a4/servers HTTP/1.1 Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGk3WwItVPrVwVpNG6hAuX4HX54ayYqxTowECsY97BtlAvFDg_R4vlk456hlSNNzAC2dpcnPdDLuubf5dTHVfVJpygCYwSZGBsP56iZfWpdenTqN5ttsDOqnzSNYMHKZN9bk5U0_YKi_q-0n8YONXD7iWYdGT09iVdWLc1KZMW5P6pA Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 5ada3c821cc8437cba412668bdb4fbea Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1125001991 Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:49:31.531156 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:49:31.532462 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ada3c821cc8437cba412668bdb4fbea", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ada3c821cc8437cba412668bdb4fbea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ada3c821cc8437cba412668bdb4fbea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ada3c821cc8437cba412668bdb4fbea"}]}] Oct 10 18:49:31.532462 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1125001991 Oct 10 18:49:31.532462 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 5ada3c821cc8437cba412668bdb4fbea Oct 10 18:49:31.532462 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1125001991 Oct 10 18:49:31.532462 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin Oct 10 18:49:31.532462 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:49:31.532462 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:49:31.532462 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: a2636400620d45578bb1d5fd91cd3223 Oct 10 18:49:31.532462 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin Oct 10 18:49:31.532462 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:49:31.532462 n-d-860863-1 devstack@n-api.service[127289]: exception: No hypervisor matching '17d99adb-98db-4aec-bc4d-5d5721d2c6a4' could be found. Oct 10 18:49:31.532462 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '17d99adb-98db-4aec-bc4d-5d5721d2c6a4'} Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '17d99adb-98db-4aec-bc4d-5d5721d2c6a4' could be found. Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:31.533480 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:31.534678 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:31.534678 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:31.534678 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:49:31.534678 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:49:31.534678 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '17d99adb-98db-4aec-bc4d-5d5721d2c6a4' could be found. Oct 10 18:49:31.534678 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:31.534678 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-40536235-32c2-443f-b3ad-8f7d2d9a5db2 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] Returning 404 to user: No hypervisor matching '17d99adb-98db-4aec-bc4d-5d5721d2c6a4' could be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:49:31.534678 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-40536235-32c2-443f-b3ad-8f7d2d9a5db2 tempest-HypervisorAdminNegativeUnderV252Test-1125001991 tempest-HypervisorAdminNegativeUnderV252Test-1125001991-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/17d99adb-98db-4aec-bc4d-5d5721d2c6a4/servers" status: 404 len: 123 microversion: 2.1 time: 0.039310 Oct 10 18:49:31.534678 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 11/24] 10.222.0.43 () {58 vars in 1281 bytes} [Mon Oct 10 18:49:31 2022] GET /compute/v2.1/os-hypervisors/17d99adb-98db-4aec-bc4d-5d5721d2c6a4/servers => generated 123 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:49:31.906021 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-06539f85-d2f6-42a6-90c7-16039ee80bf6 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.1 time: 0.892932 Oct 10 18:49:31.916691 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 14/25] 10.222.0.43 () {60 vars in 1191 bytes} [Mon Oct 10 18:49:31 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:32.279396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-858c6086-472c-4497-95f8-ae51c17e72af tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:32.280615 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-858c6086-472c-4497-95f8-ae51c17e72af tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:32.351152 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-858c6086-472c-4497-95f8-ae51c17e72af tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:32.358804 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-858c6086-472c-4497-95f8-ae51c17e72af tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1220 microversion: 2.1 time: 0.084030 Oct 10 18:49:32.359510 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 12/26] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:32 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:32.981209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-311330868", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "availability_zone": "tempest-test_az-925990548"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:33.033722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:33.034544 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:33.035282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:33.036234 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:33.037067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:33.037864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:33.384846 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a51fb932-0f53-4ebb-b85e-fb01840b129c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:33.386431 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a51fb932-0f53-4ebb-b85e-fb01840b129c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:33.396417 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a51fb932-0f53-4ebb-b85e-fb01840b129c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:33.400843 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a51fb932-0f53-4ebb-b85e-fb01840b129c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:33.401745 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a51fb932-0f53-4ebb-b85e-fb01840b129c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:33.402623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a51fb932-0f53-4ebb-b85e-fb01840b129c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:33.403929 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a51fb932-0f53-4ebb-b85e-fb01840b129c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:33.406856 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a51fb932-0f53-4ebb-b85e-fb01840b129c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:33.659541 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] validate_networks() for None {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:49:33.815491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a51fb932-0f53-4ebb-b85e-fb01840b129c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:33.843839 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a51fb932-0f53-4ebb-b85e-fb01840b129c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1237 microversion: 2.1 time: 0.464615 Oct 10 18:49:33.845206 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 13/27] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:33 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1237 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:49:33.994612 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:49:33.995159 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:49:33.995481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:49:33.996065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:49:33.996517 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:49:34.039724 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:34.040818 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:34.041383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:34.044074 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:34.044578 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:34.045061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:34.117716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Getting quotas for project d5880a8cb15d4be881eebd9d7cf9af3b. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:49:34.141373 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Getting quotas for user 7345b87c6a8d473fb93d50260a147c30 and project d5880a8cb15d4be881eebd9d7cf9af3b. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:49:34.161308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:49:34.164302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:49:34.305865 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-983c91dc-a303-41ed-8e39-9097eff5c1e0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.853079 Oct 10 18:49:34.313054 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 15/28] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:49:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:49:34.325369 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-10d7f884-6e31-4c0d-a022-821acec2b2e6 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:34.330106 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-10d7f884-6e31-4c0d-a022-821acec2b2e6 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:34.441655 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-10d7f884-6e31-4c0d-a022-821acec2b2e6 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:34.451957 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-10d7f884-6e31-4c0d-a022-821acec2b2e6 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1241 microversion: 2.1 time: 0.136577 Oct 10 18:49:34.471158 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 14/29] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:34 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:34.867663 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-61a5fd91-71a6-4294-aeda-aa2adf01355b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:34.868612 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-61a5fd91-71a6-4294-aeda-aa2adf01355b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:34.896441 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61a5fd91-71a6-4294-aeda-aa2adf01355b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:34.897387 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61a5fd91-71a6-4294-aeda-aa2adf01355b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:34.897935 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61a5fd91-71a6-4294-aeda-aa2adf01355b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:34.899034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61a5fd91-71a6-4294-aeda-aa2adf01355b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:34.899567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61a5fd91-71a6-4294-aeda-aa2adf01355b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:34.901198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61a5fd91-71a6-4294-aeda-aa2adf01355b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:35.152985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-61a5fd91-71a6-4294-aeda-aa2adf01355b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:35.177281 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-61a5fd91-71a6-4294-aeda-aa2adf01355b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1301 microversion: 2.1 time: 0.313700 Oct 10 18:49:35.180906 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 16/30] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:34 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1301 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:35.484641 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bd4fd478-7e59-4c56-bb1b-a6e96215df61 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:35.485839 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bd4fd478-7e59-4c56-bb1b-a6e96215df61 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:35.583276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bd4fd478-7e59-4c56-bb1b-a6e96215df61 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:35.590894 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bd4fd478-7e59-4c56-bb1b-a6e96215df61 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1241 microversion: 2.1 time: 0.116488 Oct 10 18:49:35.597754 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 15/31] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:35 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:36.204685 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8c2cb34b-cd4f-4ed1-a8e8-05f6b243bf45 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:36.206058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8c2cb34b-cd4f-4ed1-a8e8-05f6b243bf45 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:36.222459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8c2cb34b-cd4f-4ed1-a8e8-05f6b243bf45 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:36.224396 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8c2cb34b-cd4f-4ed1-a8e8-05f6b243bf45 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:36.226067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8c2cb34b-cd4f-4ed1-a8e8-05f6b243bf45 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:36.226860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8c2cb34b-cd4f-4ed1-a8e8-05f6b243bf45 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:36.228878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8c2cb34b-cd4f-4ed1-a8e8-05f6b243bf45 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:36.232301 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8c2cb34b-cd4f-4ed1-a8e8-05f6b243bf45 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:36.500992 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8c2cb34b-cd4f-4ed1-a8e8-05f6b243bf45 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:36.511835 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8c2cb34b-cd4f-4ed1-a8e8-05f6b243bf45 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1299 microversion: 2.1 time: 0.310985 Oct 10 18:49:36.518570 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 17/32] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:36 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1299 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:36.616930 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d8df3ff8-4534-4756-9e9c-d5b781574527 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:36.616930 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d8df3ff8-4534-4756-9e9c-d5b781574527 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:36.631124 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8df3ff8-4534-4756-9e9c-d5b781574527 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:36.633742 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8df3ff8-4534-4756-9e9c-d5b781574527 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:36.637963 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8df3ff8-4534-4756-9e9c-d5b781574527 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:36.641337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8df3ff8-4534-4756-9e9c-d5b781574527 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:36.642077 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8df3ff8-4534-4756-9e9c-d5b781574527 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:36.645240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8df3ff8-4534-4756-9e9c-d5b781574527 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:36.875684 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d8df3ff8-4534-4756-9e9c-d5b781574527 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:36.884431 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d8df3ff8-4534-4756-9e9c-d5b781574527 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1241 microversion: 2.1 time: 0.273897 Oct 10 18:49:36.888474 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 16/33] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:36 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1241 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:37.574485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3a8491e1-8f5a-4716-8d88-cdd2c557791c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:37.576555 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3a8491e1-8f5a-4716-8d88-cdd2c557791c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:37.598715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a8491e1-8f5a-4716-8d88-cdd2c557791c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:37.600404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a8491e1-8f5a-4716-8d88-cdd2c557791c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:37.600888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a8491e1-8f5a-4716-8d88-cdd2c557791c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:37.602686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a8491e1-8f5a-4716-8d88-cdd2c557791c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:37.603280 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a8491e1-8f5a-4716-8d88-cdd2c557791c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:37.603722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a8491e1-8f5a-4716-8d88-cdd2c557791c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:37.920774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0b780ec5-6e43-4176-8010-92550a03f9ad tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:37.922089 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0b780ec5-6e43-4176-8010-92550a03f9ad tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:37.953083 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0b780ec5-6e43-4176-8010-92550a03f9ad tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:37.954697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0b780ec5-6e43-4176-8010-92550a03f9ad tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:37.956284 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0b780ec5-6e43-4176-8010-92550a03f9ad tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:37.963925 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0b780ec5-6e43-4176-8010-92550a03f9ad tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:37.967958 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0b780ec5-6e43-4176-8010-92550a03f9ad tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:37.975499 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0b780ec5-6e43-4176-8010-92550a03f9ad tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:38.288449 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3a8491e1-8f5a-4716-8d88-cdd2c557791c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:38.303841 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3a8491e1-8f5a-4716-8d88-cdd2c557791c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.758463 Oct 10 18:49:38.304440 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 18/34] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:37 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:38.342452 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0b780ec5-6e43-4176-8010-92550a03f9ad tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:38.364132 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0b780ec5-6e43-4176-8010-92550a03f9ad tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1289 microversion: 2.1 time: 0.446437 Oct 10 18:49:38.380709 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 17/35] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:37 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1289 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:49:39.327210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f4f7ba53-11af-43cc-82ee-b6ae5901d5c9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:39.342448 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f4f7ba53-11af-43cc-82ee-b6ae5901d5c9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:39.349431 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4f7ba53-11af-43cc-82ee-b6ae5901d5c9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:39.351630 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4f7ba53-11af-43cc-82ee-b6ae5901d5c9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:39.352261 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4f7ba53-11af-43cc-82ee-b6ae5901d5c9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:39.355009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4f7ba53-11af-43cc-82ee-b6ae5901d5c9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:39.355647 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4f7ba53-11af-43cc-82ee-b6ae5901d5c9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:39.356238 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4f7ba53-11af-43cc-82ee-b6ae5901d5c9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:39.407838 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-268a79b8-32cc-4662-90d3-2e5c17736071 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:39.407838 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-268a79b8-32cc-4662-90d3-2e5c17736071 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:39.432196 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-268a79b8-32cc-4662-90d3-2e5c17736071 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:39.432196 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-268a79b8-32cc-4662-90d3-2e5c17736071 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:39.433453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-268a79b8-32cc-4662-90d3-2e5c17736071 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:39.436901 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-268a79b8-32cc-4662-90d3-2e5c17736071 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:39.439053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-268a79b8-32cc-4662-90d3-2e5c17736071 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:39.458029 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-268a79b8-32cc-4662-90d3-2e5c17736071 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:39.768180 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f4f7ba53-11af-43cc-82ee-b6ae5901d5c9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:39.779077 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f4f7ba53-11af-43cc-82ee-b6ae5901d5c9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.455709 Oct 10 18:49:39.780890 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 19/36] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:39 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:40.081373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-268a79b8-32cc-4662-90d3-2e5c17736071 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:40.092386 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-268a79b8-32cc-4662-90d3-2e5c17736071 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1295 microversion: 2.1 time: 0.689412 Oct 10 18:49:40.093612 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 18/37] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:39 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1295 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:40.809977 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cbdb9310-4a0b-4740-a077-c5295c21ef56 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:40.809977 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cbdb9310-4a0b-4740-a077-c5295c21ef56 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:40.825149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cbdb9310-4a0b-4740-a077-c5295c21ef56 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:40.825706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cbdb9310-4a0b-4740-a077-c5295c21ef56 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:40.826447 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cbdb9310-4a0b-4740-a077-c5295c21ef56 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:40.827407 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cbdb9310-4a0b-4740-a077-c5295c21ef56 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:40.828015 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cbdb9310-4a0b-4740-a077-c5295c21ef56 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:40.828747 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cbdb9310-4a0b-4740-a077-c5295c21ef56 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:41.123378 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3048c965-254f-4497-aa47-54b46df4c251 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:41.124106 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3048c965-254f-4497-aa47-54b46df4c251 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:41.126312 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:41.143679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cbdb9310-4a0b-4740-a077-c5295c21ef56 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:41.145772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3048c965-254f-4497-aa47-54b46df4c251 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:41.150838 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3048c965-254f-4497-aa47-54b46df4c251 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:41.151340 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3048c965-254f-4497-aa47-54b46df4c251 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:41.152123 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3048c965-254f-4497-aa47-54b46df4c251 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:41.157267 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3048c965-254f-4497-aa47-54b46df4c251 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:41.157898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3048c965-254f-4497-aa47-54b46df4c251 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:41.165296 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cbdb9310-4a0b-4740-a077-c5295c21ef56 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.356400 Oct 10 18:49:41.166117 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 20/38] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:40 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:41.504447 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3048c965-254f-4497-aa47-54b46df4c251 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:41.514463 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3048c965-254f-4497-aa47-54b46df4c251 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1295 microversion: 2.1 time: 0.397929 Oct 10 18:49:41.519698 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 19/39] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:41 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1295 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:49:42.197717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0e1b1360-6617-4526-a822-253e80d457cc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:42.199388 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0e1b1360-6617-4526-a822-253e80d457cc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:42.209424 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e1b1360-6617-4526-a822-253e80d457cc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:42.210377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e1b1360-6617-4526-a822-253e80d457cc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:42.211657 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e1b1360-6617-4526-a822-253e80d457cc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:42.213463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e1b1360-6617-4526-a822-253e80d457cc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:42.214165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e1b1360-6617-4526-a822-253e80d457cc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:42.215232 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e1b1360-6617-4526-a822-253e80d457cc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:42.521535 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0e1b1360-6617-4526-a822-253e80d457cc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:42.533281 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0e1b1360-6617-4526-a822-253e80d457cc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.342445 Oct 10 18:49:42.533877 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 21/40] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:42 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:42.550323 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c33b9346-a347-45bd-8353-669826c12fe8 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:42.553145 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c33b9346-a347-45bd-8353-669826c12fe8 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:42.578915 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c33b9346-a347-45bd-8353-669826c12fe8 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:42.579677 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c33b9346-a347-45bd-8353-669826c12fe8 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:42.580773 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c33b9346-a347-45bd-8353-669826c12fe8 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:42.582048 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c33b9346-a347-45bd-8353-669826c12fe8 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:42.582869 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c33b9346-a347-45bd-8353-669826c12fe8 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:42.583755 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c33b9346-a347-45bd-8353-669826c12fe8 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:42.754119 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c33b9346-a347-45bd-8353-669826c12fe8 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:42.769496 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c33b9346-a347-45bd-8353-669826c12fe8 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1295 microversion: 2.1 time: 0.229263 Oct 10 18:49:42.785421 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 20/41] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:42 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1295 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:43.564592 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d8d65bbc-ef35-476f-89b2-d7f115d9f45f tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:43.567400 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d8d65bbc-ef35-476f-89b2-d7f115d9f45f tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:43.580721 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8d65bbc-ef35-476f-89b2-d7f115d9f45f tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:43.583129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8d65bbc-ef35-476f-89b2-d7f115d9f45f tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:43.583731 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8d65bbc-ef35-476f-89b2-d7f115d9f45f tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:43.585728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8d65bbc-ef35-476f-89b2-d7f115d9f45f tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:43.586254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8d65bbc-ef35-476f-89b2-d7f115d9f45f tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:43.587795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8d65bbc-ef35-476f-89b2-d7f115d9f45f tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:43.937273 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d8d65bbc-ef35-476f-89b2-d7f115d9f45f tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:43.954219 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d8d65bbc-ef35-476f-89b2-d7f115d9f45f tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.395101 Oct 10 18:49:43.959309 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 22/42] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:43 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:43.965346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ffbe9018-02b6-4b21-9538-a4983a87561d tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:43.966120 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ffbe9018-02b6-4b21-9538-a4983a87561d tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:43.996457 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffbe9018-02b6-4b21-9538-a4983a87561d tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:44.009069 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-f163459d-aba2-4059-a9e3-3dd57a0df957 req-e71194c5-84de-4eb8-9909-c324fcba3ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9fa1631-80e1-46e3-80f8-907534151a0c", "tag": "9add7f12-e83f-426c-b675-ae2a583da350"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:44.014006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffbe9018-02b6-4b21-9538-a4983a87561d tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:44.016128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffbe9018-02b6-4b21-9538-a4983a87561d tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:44.018687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffbe9018-02b6-4b21-9538-a4983a87561d tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:44.022786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffbe9018-02b6-4b21-9538-a4983a87561d tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:44.022786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffbe9018-02b6-4b21-9538-a4983a87561d tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:44.046842 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f163459d-aba2-4059-a9e3-3dd57a0df957 req-e71194c5-84de-4eb8-9909-c324fcba3ad1 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:44.051451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f163459d-aba2-4059-a9e3-3dd57a0df957 req-e71194c5-84de-4eb8-9909-c324fcba3ad1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:44.051451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f163459d-aba2-4059-a9e3-3dd57a0df957 req-e71194c5-84de-4eb8-9909-c324fcba3ad1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:44.085886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:44.098587 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-f163459d-aba2-4059-a9e3-3dd57a0df957 req-e71194c5-84de-4eb8-9909-c324fcba3ad1 service nova] Creating event network-changed:9add7f12-e83f-426c-b675-ae2a583da350 for instance d9fa1631-80e1-46e3-80f8-907534151a0c on n-h1-860863-1 Oct 10 18:49:44.099434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f163459d-aba2-4059-a9e3-3dd57a0df957 req-e71194c5-84de-4eb8-9909-c324fcba3ad1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 18:49:44.100008 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f163459d-aba2-4059-a9e3-3dd57a0df957 req-e71194c5-84de-4eb8-9909-c324fcba3ad1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 18:49:44.101776 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af5821ab-6b58-4d2b-91e0-8ba3b1e9b4d3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:44.102572 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af5821ab-6b58-4d2b-91e0-8ba3b1e9b4d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:44.103179 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af5821ab-6b58-4d2b-91e0-8ba3b1e9b4d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:44.104211 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af5821ab-6b58-4d2b-91e0-8ba3b1e9b4d3 None None] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:44.104979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af5821ab-6b58-4d2b-91e0-8ba3b1e9b4d3 None None] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:44.105617 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af5821ab-6b58-4d2b-91e0-8ba3b1e9b4d3 None None] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:44.120020 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.compute.rpcapi [None req-af5821ab-6b58-4d2b-91e0-8ba3b1e9b4d3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 10 18:49:44.121659 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af5821ab-6b58-4d2b-91e0-8ba3b1e9b4d3 None None] Releasing lock "compute-rpcapi-router" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 18:49:44.143369 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-af5821ab-6b58-4d2b-91e0-8ba3b1e9b4d3 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.525658 Oct 10 18:49:44.144599 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 21/43] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:44.151472 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=6 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:44.572416 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ffbe9018-02b6-4b21-9538-a4983a87561d tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:44.583065 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ffbe9018-02b6-4b21-9538-a4983a87561d tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1337 microversion: 2.1 time: 0.622345 Oct 10 18:49:44.583651 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 23/44] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:43 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1337 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:44.986766 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3f3ebd47-4619-48a9-8287-a5301160c944 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:44.987920 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3f3ebd47-4619-48a9-8287-a5301160c944 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:44.997328 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f3ebd47-4619-48a9-8287-a5301160c944 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:44.999666 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f3ebd47-4619-48a9-8287-a5301160c944 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:45.001147 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f3ebd47-4619-48a9-8287-a5301160c944 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:45.003227 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f3ebd47-4619-48a9-8287-a5301160c944 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:45.004563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f3ebd47-4619-48a9-8287-a5301160c944 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:45.005257 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f3ebd47-4619-48a9-8287-a5301160c944 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:45.298592 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ffbe9018-02b6-4b21-9538-a4983a87561d tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:45.299558 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ffbe9018-02b6-4b21-9538-a4983a87561d tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001338 Oct 10 18:49:45.300779 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 24/45] 10.222.0.43 () {56 vars in 886 bytes} [Mon Oct 10 18:49:45 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 10 18:49:45.588254 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=14 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:45.614720 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-41b76a26-ef19-4885-831d-d77d58ccac45 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:45.617650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-41b76a26-ef19-4885-831d-d77d58ccac45 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:45.619111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=10,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:45.630367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41b76a26-ef19-4885-831d-d77d58ccac45 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:45.633137 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41b76a26-ef19-4885-831d-d77d58ccac45 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:45.633744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41b76a26-ef19-4885-831d-d77d58ccac45 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:45.634624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41b76a26-ef19-4885-831d-d77d58ccac45 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:45.640109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41b76a26-ef19-4885-831d-d77d58ccac45 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:45.640795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41b76a26-ef19-4885-831d-d77d58ccac45 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:45.691733 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3f3ebd47-4619-48a9-8287-a5301160c944 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:45.721339 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3f3ebd47-4619-48a9-8287-a5301160c944 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.726409 Oct 10 18:49:45.721339 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 22/46] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:44 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:46.024437 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-41b76a26-ef19-4885-831d-d77d58ccac45 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:46.057917 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-41b76a26-ef19-4885-831d-d77d58ccac45 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1337 microversion: 2.1 time: 0.447190 Oct 10 18:49:46.063542 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 25/47] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:45 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1337 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:46.740732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3a9d2c68-a591-48c8-af0e-d9535509eb22 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:46.742367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3a9d2c68-a591-48c8-af0e-d9535509eb22 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:46.757137 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a9d2c68-a591-48c8-af0e-d9535509eb22 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:46.757137 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a9d2c68-a591-48c8-af0e-d9535509eb22 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:46.759047 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a9d2c68-a591-48c8-af0e-d9535509eb22 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:46.763035 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a9d2c68-a591-48c8-af0e-d9535509eb22 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:46.767433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a9d2c68-a591-48c8-af0e-d9535509eb22 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:46.768983 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a9d2c68-a591-48c8-af0e-d9535509eb22 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:47.268327 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f1fbb18b-2389-45b2-aac4-4bb8a9044eea tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-174956334", "ram": 512, "vcpus": 1, "disk": 10, "id": 400215300, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:47.315948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3a9d2c68-a591-48c8-af0e-d9535509eb22 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:47.337843 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3a9d2c68-a591-48c8-af0e-d9535509eb22 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.602902 Oct 10 18:49:47.354328 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 26/48] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:46 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:47.358628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-6f3f896f-c2c2-46c9-936f-992f6b0d17f3 req-c0a5e5c2-9f81-4f2a-8867-94af14cb1660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5603901d-b471-4e23-9f0c-1e62ff4bbd51", "tag": "8fbac730-1bb1-4ddf-92da-52bd004324f7"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:47.406041 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6f3f896f-c2c2-46c9-936f-992f6b0d17f3 req-c0a5e5c2-9f81-4f2a-8867-94af14cb1660 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:47.409987 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6f3f896f-c2c2-46c9-936f-992f6b0d17f3 req-c0a5e5c2-9f81-4f2a-8867-94af14cb1660 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:47.422426 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6f3f896f-c2c2-46c9-936f-992f6b0d17f3 req-c0a5e5c2-9f81-4f2a-8867-94af14cb1660 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:47.459252 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f1fbb18b-2389-45b2-aac4-4bb8a9044eea tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.999784 Oct 10 18:49:47.464259 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 23/49] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:49:46 2022] POST /compute/v2.1/flavors => generated 412 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:47.503180 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-6f3f896f-c2c2-46c9-936f-992f6b0d17f3 req-c0a5e5c2-9f81-4f2a-8867-94af14cb1660 service nova] Creating event network-changed:8fbac730-1bb1-4ddf-92da-52bd004324f7 for instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 on n-h1-860863-1 Oct 10 18:49:47.504452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6f3f896f-c2c2-46c9-936f-992f6b0d17f3 req-c0a5e5c2-9f81-4f2a-8867-94af14cb1660 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127288) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 18:49:47.505009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6f3f896f-c2c2-46c9-936f-992f6b0d17f3 req-c0a5e5c2-9f81-4f2a-8867-94af14cb1660 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127288) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 18:49:47.511061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d5f2bd34-f6fa-4922-a08e-d5b4b055661a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:47.511061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d5f2bd34-f6fa-4922-a08e-d5b4b055661a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:47.511061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d5f2bd34-f6fa-4922-a08e-d5b4b055661a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:47.511061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d5f2bd34-f6fa-4922-a08e-d5b4b055661a None None] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:47.511061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d5f2bd34-f6fa-4922-a08e-d5b4b055661a None None] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:47.511670 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d5f2bd34-f6fa-4922-a08e-d5b4b055661a None None] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:47.537228 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.compute.rpcapi [None req-d5f2bd34-f6fa-4922-a08e-d5b4b055661a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 10 18:49:47.543354 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d5f2bd34-f6fa-4922-a08e-d5b4b055661a None None] Releasing lock "compute-rpcapi-router" {{(pid=127288) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 18:49:47.585317 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d5f2bd34-f6fa-4922-a08e-d5b4b055661a None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245605 Oct 10 18:49:47.592270 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 27/50] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:47.603520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f15c396b-1fe7-46ae-be87-dfdfb6bf8526 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:47.604613 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f15c396b-1fe7-46ae-be87-dfdfb6bf8526 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:47.616530 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f15c396b-1fe7-46ae-be87-dfdfb6bf8526 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:47.621231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f15c396b-1fe7-46ae-be87-dfdfb6bf8526 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:47.621877 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f15c396b-1fe7-46ae-be87-dfdfb6bf8526 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:47.624029 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f15c396b-1fe7-46ae-be87-dfdfb6bf8526 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:47.624695 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f15c396b-1fe7-46ae-be87-dfdfb6bf8526 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:47.627269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f15c396b-1fe7-46ae-be87-dfdfb6bf8526 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:47.663215 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5cc559ed-baec-4ed4-8050-b398e433de06 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Action: 'update', calling method: .version_select at 0x7f318ef0d940>, body: {"quota_set": {"ram": "5120"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:47.799510 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5cc559ed-baec-4ed4-8050-b398e433de06 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:47.800223 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5cc559ed-baec-4ed4-8050-b398e433de06 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:47.800859 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5cc559ed-baec-4ed4-8050-b398e433de06 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:47.806552 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5cc559ed-baec-4ed4-8050-b398e433de06 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:47.806552 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5cc559ed-baec-4ed4-8050-b398e433de06 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:47.806552 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5cc559ed-baec-4ed4-8050-b398e433de06 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:48.019392 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5cc559ed-baec-4ed4-8050-b398e433de06 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/8aa312c07571410c8089ec0d535695b0" status: 200 len: 240 microversion: 2.36 time: 0.553144 Oct 10 18:49:48.023559 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 24/51] 10.222.0.43 () {62 vars in 1303 bytes} [Mon Oct 10 18:49:47 2022] PUT /compute/v2.1/os-quota-sets/8aa312c07571410c8089ec0d535695b0 => generated 240 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:49:48.025320 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f15c396b-1fe7-46ae-be87-dfdfb6bf8526 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:48.036186 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f15c396b-1fe7-46ae-be87-dfdfb6bf8526 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1337 microversion: 2.1 time: 0.448540 Oct 10 18:49:48.040236 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 28/52] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:47 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1337 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:48.069593 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-31d4ded6-3651-4018-95d1-423312e1b731 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:48.162880 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-67718dae-ae87-4db9-8b01-3152dbbaf69b tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Calling method '.version_select at 0x7f318ee7bf70>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:48.219756 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-31d4ded6-3651-4018-95d1-423312e1b731 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/400215300/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.174694 Oct 10 18:49:48.219756 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 29/53] 10.222.0.43 () {60 vars in 1221 bytes} [Mon Oct 10 18:49:48 2022] POST /compute/v2.1/flavors/400215300/os-extra_specs => generated 66 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:49:48.240751 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-83625f6c-d9c0-49ec-ab9c-565c55effa31 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Calling method '.version_select at 0x7f318ed98940>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:48.289496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:48.302699 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-67718dae-ae87-4db9-8b01-3152dbbaf69b tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc" status: 200 len: 371 microversion: 2.1 time: 0.281445 Oct 10 18:49:48.303688 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 25/54] 10.222.0.43 () {58 vars in 1242 bytes} [Mon Oct 10 18:49:48 2022] GET /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc => generated 371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:48.385281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83625f6c-d9c0-49ec-ab9c-565c55effa31 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:48.387776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83625f6c-d9c0-49ec-ab9c-565c55effa31 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:48.388424 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83625f6c-d9c0-49ec-ab9c-565c55effa31 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:48.389289 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83625f6c-d9c0-49ec-ab9c-565c55effa31 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:48.391963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83625f6c-d9c0-49ec-ab9c-565c55effa31 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:48.393661 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83625f6c-d9c0-49ec-ab9c-565c55effa31 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:48.471843 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-83625f6c-d9c0-49ec-ab9c-565c55effa31 tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/8aa312c07571410c8089ec0d535695b0/detail" status: 200 len: 672 microversion: 2.36 time: 0.250969 Oct 10 18:49:48.487894 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 30/55] 10.222.0.43 () {60 vars in 1304 bytes} [Mon Oct 10 18:49:48 2022] GET /compute/v2.1/os-quota-sets/8aa312c07571410c8089ec0d535695b0/detail => generated 672 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:49:48.487894 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8e62fcdf-8d26-462e-93e3-47be242c9cfe tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Action: 'update', calling method: .version_select at 0x7f318ed24ca0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:48.570389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-adba6318-c8a9-4761-9294-157eb1c8ded2 tempest-FlavorsExtraSpecsTestJSON-980567196 tempest-FlavorsExtraSpecsTestJSON-980567196-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:48.587323 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-adba6318-c8a9-4761-9294-157eb1c8ded2 tempest-FlavorsExtraSpecsTestJSON-980567196 tempest-FlavorsExtraSpecsTestJSON-980567196-project] 10.222.0.43 "GET /compute/v2.1/flavors/400215300/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.279726 Oct 10 18:49:48.593837 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 26/56] 10.222.0.43 () {58 vars in 1200 bytes} [Mon Oct 10 18:49:48 2022] GET /compute/v2.1/flavors/400215300/os-extra_specs => generated 66 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:49:48.611028 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9752742b-16d6-4b78-836b-5a1e88504401 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:48.611028 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9752742b-16d6-4b78-836b-5a1e88504401 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:48.637644 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9752742b-16d6-4b78-836b-5a1e88504401 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:48.638263 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9752742b-16d6-4b78-836b-5a1e88504401 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:48.639096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9752742b-16d6-4b78-836b-5a1e88504401 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:48.640229 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9752742b-16d6-4b78-836b-5a1e88504401 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:48.640723 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9752742b-16d6-4b78-836b-5a1e88504401 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:48.641154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9752742b-16d6-4b78-836b-5a1e88504401 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:48.734760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e62fcdf-8d26-462e-93e3-47be242c9cfe tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:48.735489 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e62fcdf-8d26-462e-93e3-47be242c9cfe tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:48.745668 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e62fcdf-8d26-462e-93e3-47be242c9cfe tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:48.748337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e62fcdf-8d26-462e-93e3-47be242c9cfe tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:48.749941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e62fcdf-8d26-462e-93e3-47be242c9cfe tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:48.750650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e62fcdf-8d26-462e-93e3-47be242c9cfe tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:48.919350 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8e62fcdf-8d26-462e-93e3-47be242c9cfe tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc" status: 200 len: 328 microversion: 2.1 time: 0.442901 Oct 10 18:49:48.925071 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 31/57] 10.222.0.43 () {60 vars in 1262 bytes} [Mon Oct 10 18:49:48 2022] PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc => generated 328 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:49.126206 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9752742b-16d6-4b78-836b-5a1e88504401 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:49.130091 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9752742b-16d6-4b78-836b-5a1e88504401 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.534889 Oct 10 18:49:49.134354 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 27/58] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:48 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:49.153488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-aa25aebb-cce8-48be-976d-ec07f9c269f3 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:49.269496 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-aa25aebb-cce8-48be-976d-ec07f9c269f3 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/400215300/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.133633 Oct 10 18:49:49.274282 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 28/59] 10.222.0.43 () {60 vars in 1221 bytes} [Mon Oct 10 18:49:49 2022] POST /compute/v2.1/flavors/400215300/os-extra_specs => generated 66 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:49:49.279876 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-225c300d-9517-4b90-a1e8-386b2861b8bc tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Action: 'update', calling method: .version_select at 0x7f318ee34b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:49.481581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2f5f024e-b985-4466-9f33-c7d20b2eb520 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:49.502430 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2f5f024e-b985-4466-9f33-c7d20b2eb520 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.576180 Oct 10 18:49:49.505461 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 32/60] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:49:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:49.518731 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a036f9ce-78ca-47b7-9cd7-f90909af6eba tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:49.519599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a036f9ce-78ca-47b7-9cd7-f90909af6eba tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:49.529854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a036f9ce-78ca-47b7-9cd7-f90909af6eba tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:49.530584 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a036f9ce-78ca-47b7-9cd7-f90909af6eba tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:49.531202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a036f9ce-78ca-47b7-9cd7-f90909af6eba tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:49.532134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a036f9ce-78ca-47b7-9cd7-f90909af6eba tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:49.532770 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a036f9ce-78ca-47b7-9cd7-f90909af6eba tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:49.533334 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a036f9ce-78ca-47b7-9cd7-f90909af6eba tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:49.587578 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:49.772926 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-225c300d-9517-4b90-a1e8-386b2861b8bc tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:49.774180 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-225c300d-9517-4b90-a1e8-386b2861b8bc tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:49.774776 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-225c300d-9517-4b90-a1e8-386b2861b8bc tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:49.775940 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-225c300d-9517-4b90-a1e8-386b2861b8bc tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:49.776654 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-225c300d-9517-4b90-a1e8-386b2861b8bc tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:49.779585 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-225c300d-9517-4b90-a1e8-386b2861b8bc tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:49.850650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a036f9ce-78ca-47b7-9cd7-f90909af6eba tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:49.859905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-225c300d-9517-4b90-a1e8-386b2861b8bc tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:49.863618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-225c300d-9517-4b90-a1e8-386b2861b8bc tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:49.870001 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-225c300d-9517-4b90-a1e8-386b2861b8bc tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:49.871354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-225c300d-9517-4b90-a1e8-386b2861b8bc tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:49.872057 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-225c300d-9517-4b90-a1e8-386b2861b8bc tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:49.873238 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-225c300d-9517-4b90-a1e8-386b2861b8bc tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:49.881832 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a036f9ce-78ca-47b7-9cd7-f90909af6eba tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1337 microversion: 2.1 time: 0.370889 Oct 10 18:49:49.884484 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 33/61] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:49 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1337 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:50.046083 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1778483047", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:50.115875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] validate_networks() for None {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:49:50.117671 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-225c300d-9517-4b90-a1e8-386b2861b8bc tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/8aa312c07571410c8089ec0d535695b0?user_id=52ec2bfc426f4176b9d6953c01303dc3" status: 200 len: 240 microversion: 2.36 time: 0.841682 Oct 10 18:49:50.118508 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 29/62] 10.222.0.43 () {62 vars in 1384 bytes} [Mon Oct 10 18:49:49 2022] PUT /compute/v2.1/os-quota-sets/8aa312c07571410c8089ec0d535695b0?user_id=52ec2bfc426f4176b9d6953c01303dc3 => generated 240 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:49:50.129023 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-43c1be99-f76a-47fb-9271-8b4169a3b7d2 tempest-FlavorsExtraSpecsTestJSON-980567196 tempest-FlavorsExtraSpecsTestJSON-980567196-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:50.138503 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-43c1be99-f76a-47fb-9271-8b4169a3b7d2 tempest-FlavorsExtraSpecsTestJSON-980567196 tempest-FlavorsExtraSpecsTestJSON-980567196-project] 10.222.0.43 "GET /compute/v2.1/flavors/400215300/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.018409 Oct 10 18:49:50.139159 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 30/63] 10.222.0.43 () {58 vars in 1242 bytes} [Mon Oct 10 18:49:50 2022] GET /compute/v2.1/flavors/400215300/os-extra_specs/hw:numa_nodes => generated 22 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:49:50.329770 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ac857ba6-1547-4143-8269-a7acb6b0feba tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-743092962", "id": 1909171365, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:50.359911 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:49:50.360337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:49:50.360855 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:49:50.361484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:49:50.362198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:49:50.371899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:50.375405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:50.375405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:50.375405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:50.375405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:50.375784 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:50.392985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Getting quotas for project 8b955bbce93e4283a16a224f87f0ccdc. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:49:50.398702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Getting quotas for user c9b2d13741de43a59c60ac6f6b20124a and project 8b955bbce93e4283a16a224f87f0ccdc. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:49:50.412363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.utils [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] cores quota exceeded for 8b955bbce93e4283a16a224f87f0ccdc, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127288) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 10 18:49:50.413225 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 18:49:50.420597 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ac857ba6-1547-4143-8269-a7acb6b0feba tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.279413 Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Request method failure captured: Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 145 Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGlGIKWZpakuSvrhBItjF3H9O0Tju5h0s9TcWZZf2oyOwTYO_OS9qCp5zOcF-A8P0S7SoAD0O3RWCFLhA29J3QM4buRxOrOxryOTRqrMN45hzr2O2WGf70ObO8wPUSiYJPDjYvJhoOffu0ax8UzoAXtsjg2IMuovb4ibjbYCvWXS_zw Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 8b955bbce93e4283a16a224f87f0ccdc Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-QuotasAdminNegativeTest-347478880 Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:49:50.426363 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:49:50.427762 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b955bbce93e4283a16a224f87f0ccdc", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b955bbce93e4283a16a224f87f0ccdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b955bbce93e4283a16a224f87f0ccdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b955bbce93e4283a16a224f87f0ccdc"}]}] Oct 10 18:49:50.427762 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-QuotasAdminNegativeTest-347478880 Oct 10 18:49:50.427762 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 8b955bbce93e4283a16a224f87f0ccdc Oct 10 18:49:50.427762 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-347478880 Oct 10 18:49:50.427762 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-QuotasAdminNegativeTest-347478880-project Oct 10 18:49:50.427762 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:49:50.427762 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:49:50.427762 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c9b2d13741de43a59c60ac6f6b20124a Oct 10 18:49:50.427762 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-QuotasAdminNegativeTest-347478880-project Oct 10 18:49:50.427762 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:49:50.427762 n-d-860863-1 devstack@n-api.service[127288]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1778483047", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} Oct 10 18:49:50.427762 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1778483047', 'imageRef': 'b0a280ee-26ee-4c9a-8155-4326e368ccc9', 'flavorRef': '452'}}} Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 10 18:49:50.428608 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:50.429798 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:50.431179 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:50.432843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:50.432843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:50.432843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:49:50.432843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:49:50.432843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 10 18:49:50.432843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:50.432843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:49:50.432843 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-12fbe0cc-0157-49d1-9c32-0428434f6df0 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.540549 Oct 10 18:49:50.432843 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 34/65] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:49:49 2022] POST /compute/v2.1/servers => generated 111 bytes in 544 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:49:50.433564 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 31/65] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:49:50 2022] POST /compute/v2.1/flavors => generated 424 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:50.433870 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-330903b8-ff54-4f3d-be62-a871522214fb tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] Calling method '.version_select at 0x7f318ed1a8b0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:50.438912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-82f4e83b-6198-4f60-8f00-f2f1fcc06916 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:50.464932 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-82f4e83b-6198-4f60-8f00-f2f1fcc06916 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/400215300/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030431 Oct 10 18:49:50.465533 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 32/66] 10.222.0.43 () {60 vars in 1221 bytes} [Mon Oct 10 18:49:50 2022] POST /compute/v2.1/flavors/400215300/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:49:50.470449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1cc8285c-9fbf-4fce-a425-84505356bf3b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:50.471079 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1cc8285c-9fbf-4fce-a425-84505356bf3b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:50.477959 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1cc8285c-9fbf-4fce-a425-84505356bf3b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:50.478551 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1cc8285c-9fbf-4fce-a425-84505356bf3b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:50.478981 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1cc8285c-9fbf-4fce-a425-84505356bf3b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:50.479662 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1cc8285c-9fbf-4fce-a425-84505356bf3b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:50.480132 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1cc8285c-9fbf-4fce-a425-84505356bf3b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:50.480810 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1cc8285c-9fbf-4fce-a425-84505356bf3b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:50.582687 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-330903b8-ff54-4f3d-be62-a871522214fb tempest-QuotasAdminTestV236-1900993570 tempest-QuotasAdminTestV236-1900993570-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/8aa312c07571410c8089ec0d535695b0?user_id=52ec2bfc426f4176b9d6953c01303dc3" status: 200 len: 282 microversion: 2.36 time: 0.149793 Oct 10 18:49:50.582687 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 35/67] 10.222.0.43 () {60 vars in 1364 bytes} [Mon Oct 10 18:49:50 2022] GET /compute/v2.1/os-quota-sets/8aa312c07571410c8089ec0d535695b0?user_id=52ec2bfc426f4176b9d6953c01303dc3 => generated 282 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:49:50.585501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-50c521d8-2fc6-4ce1-b317-90d85ab0f28c tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:50.594646 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-50c521d8-2fc6-4ce1-b317-90d85ab0f28c tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012317 Oct 10 18:49:50.595517 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 36/68] 10.222.0.43 () {58 vars in 1182 bytes} [Mon Oct 10 18:49:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:49:50.600692 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0e84a302-b4b4-4a6d-ad40-57fdc5ddb973 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Action: 'update', calling method: .version_select at 0x7f318eb574c0>, body: {"quota_set": {"cores": 20}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:50.691923 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1cc8285c-9fbf-4fce-a425-84505356bf3b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:50.702550 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1cc8285c-9fbf-4fce-a425-84505356bf3b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.235981 Oct 10 18:49:50.721293 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 33/69] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:50 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:50.727328 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7edd544a-0628-47ec-8f4b-c220d1a0fad2 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:50.737199 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7edd544a-0628-47ec-8f4b-c220d1a0fad2 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/400215300/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014041 Oct 10 18:49:50.743249 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 34/70] 10.222.0.43 () {58 vars in 1200 bytes} [Mon Oct 10 18:49:50 2022] GET /compute/v2.1/flavors/400215300/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:49:50.743249 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0c6c4673-8109-4b95-8541-09fc82c1bca0 tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-749849079", "id": 1746818710, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:50.826086 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0c6c4673-8109-4b95-8541-09fc82c1bca0 tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.087048 Oct 10 18:49:50.827093 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 35/71] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:49:50 2022] POST /compute/v2.1/flavors => generated 424 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:50.832782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-45a3ff3a-8272-4a6a-a072-a4d04b8b4a52 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:50.869187 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e84a302-b4b4-4a6d-ad40-57fdc5ddb973 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:50.869695 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e84a302-b4b4-4a6d-ad40-57fdc5ddb973 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:50.870466 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e84a302-b4b4-4a6d-ad40-57fdc5ddb973 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:50.871713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e84a302-b4b4-4a6d-ad40-57fdc5ddb973 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:50.872818 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e84a302-b4b4-4a6d-ad40-57fdc5ddb973 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:50.883287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e84a302-b4b4-4a6d-ad40-57fdc5ddb973 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:50.967052 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-45a3ff3a-8272-4a6a-a072-a4d04b8b4a52 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/400215300/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.138062 Oct 10 18:49:50.967699 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 36/72] 10.222.0.43 () {60 vars in 1262 bytes} [Mon Oct 10 18:49:50 2022] PUT /compute/v2.1/flavors/400215300/os-extra_specs/hw:numa_nodes => generated 22 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:49:50.976438 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cd12ee79-0637-4740-bf71-230a9e7eee85 tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:50.986263 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cd12ee79-0637-4740-bf71-230a9e7eee85 tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017527 Oct 10 18:49:50.986880 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 37/73] 10.222.0.43 () {58 vars in 1182 bytes} [Mon Oct 10 18:49:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:49:51.006005 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a85d886a-0aa0-4e9a-99c2-daaeed6ae018 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:51.006753 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a85d886a-0aa0-4e9a-99c2-daaeed6ae018 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:51.012818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a85d886a-0aa0-4e9a-99c2-daaeed6ae018 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:51.015665 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a85d886a-0aa0-4e9a-99c2-daaeed6ae018 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:51.015665 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a85d886a-0aa0-4e9a-99c2-daaeed6ae018 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:51.015665 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a85d886a-0aa0-4e9a-99c2-daaeed6ae018 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:51.015665 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a85d886a-0aa0-4e9a-99c2-daaeed6ae018 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:51.016357 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a85d886a-0aa0-4e9a-99c2-daaeed6ae018 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:51.055074 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0e84a302-b4b4-4a6d-ad40-57fdc5ddb973 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc" status: 200 len: 329 microversion: 2.1 time: 0.457999 Oct 10 18:49:51.067652 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 37/74] 10.222.0.43 () {60 vars in 1262 bytes} [Mon Oct 10 18:49:50 2022] PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc => generated 329 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:51.069954 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-42dcc22d-a338-438f-afbf-778e46a9cf1d tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:51.081515 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-42dcc22d-a338-438f-afbf-778e46a9cf1d tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/400215300/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016227 Oct 10 18:49:51.087659 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 38/75] 10.222.0.43 () {58 vars in 1200 bytes} [Mon Oct 10 18:49:51 2022] GET /compute/v2.1/flavors/400215300/os-extra_specs => generated 66 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:49:51.097554 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-77ff8a2b-1ef6-4eb8-b5c7-4314d09705ba tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Action: 'create', calling method: .version_select at 0x7f318ebd5a60>, body: {"keypair": {"name": "tempest-keypair-1701984569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjgNoAUmtg8lKNdkaZ4VlNFgfq4B60VpXkDjth6MoicOo9n8h1Z9OVdYtIm/NxoiaOCPQeayNJt9i9gG+Sc32jfCGKIZCLRQ8Fm6m2dab/8EB86Y0nHq3TzA1zJbjC2xw=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:51.127261 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-77ff8a2b-1ef6-4eb8-b5c7-4314d09705ba tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Getting quotas for project ea2029d88758407a9415b15747079079. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:49:51.134393 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-77ff8a2b-1ef6-4eb8-b5c7-4314d09705ba tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Getting quotas for user ad2be8da9a544318b112ba8e8d3f498a and project ea2029d88758407a9415b15747079079. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:49:51.168912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a85d886a-0aa0-4e9a-99c2-daaeed6ae018 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:51.178226 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a85d886a-0aa0-4e9a-99c2-daaeed6ae018 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1337 microversion: 2.1 time: 0.188760 Oct 10 18:49:51.179372 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 38/76] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:50 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1337 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:51.184959 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a688ae5c-83b8-4ecb-80dd-7384f4570aaa tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Calling method '.version_select at 0x7f318edce310>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:51.239411 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-77ff8a2b-1ef6-4eb8-b5c7-4314d09705ba tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.150435 Oct 10 18:49:51.246077 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 39/77] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:49:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:51.246077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-03f4ec1e-71d8-45b6-aef4-ad6396bf2e43 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:51.265901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:51.408879 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-03f4ec1e-71d8-45b6-aef4-ad6396bf2e43 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/400215300/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.164647 Oct 10 18:49:51.422162 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 40/78] 10.222.0.43 () {58 vars in 1245 bytes} [Mon Oct 10 18:49:51 2022] DELETE /compute/v2.1/flavors/400215300/os-extra_specs/hw:numa_nodes => generated 0 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:49:51.439791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-870cc160-4bc2-48b0-b66f-2e069fb9c064 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:51.526783 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-870cc160-4bc2-48b0-b66f-2e069fb9c064 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/400215300/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.097453 Oct 10 18:49:51.531845 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 41/79] 10.222.0.43 () {58 vars in 1245 bytes} [Mon Oct 10 18:49:51 2022] DELETE /compute/v2.1/flavors/400215300/os-extra_specs/hw:cpu_policy => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:49:51.539177 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d96ef375-e2b6-430a-843c-e874587b9b49 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:51.568666 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d96ef375-e2b6-430a-843c-e874587b9b49 tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/400215300/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.035243 Oct 10 18:49:51.578144 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 42/80] 10.222.0.43 () {58 vars in 1200 bytes} [Mon Oct 10 18:49:51 2022] GET /compute/v2.1/flavors/400215300/os-extra_specs => generated 19 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:49:51.585250 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d37bddbc-e48e-4b7c-8c28-9e5940f4331d tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:51.707744 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a688ae5c-83b8-4ecb-80dd-7384f4570aaa tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc" status: 200 len: 371 microversion: 2.1 time: 0.526847 Oct 10 18:49:51.708324 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 39/81] 10.222.0.43 () {58 vars in 1242 bytes} [Mon Oct 10 18:49:51 2022] GET /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc => generated 371 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:51.725322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1d798de2-39a9-44b6-b256-08457ad9394b tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Action: 'update', calling method: .version_select at 0x7f318ee34ca0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:51.726089 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d37bddbc-e48e-4b7c-8c28-9e5940f4331d tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/400215300" status: 202 len: 0 microversion: 2.1 time: 0.145512 Oct 10 18:49:51.726670 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 43/82] 10.222.0.43 () {58 vars in 1158 bytes} [Mon Oct 10 18:49:51 2022] DELETE /compute/v2.1/flavors/400215300 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:49:51.733543 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-799beaee-c87b-4f6b-8c0d-652db80708c4 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:51.738077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-799beaee-c87b-4f6b-8c0d-652db80708c4 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:51.743143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-799beaee-c87b-4f6b-8c0d-652db80708c4 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:51.743830 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-799beaee-c87b-4f6b-8c0d-652db80708c4 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:51.744423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-799beaee-c87b-4f6b-8c0d-652db80708c4 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:51.745922 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-799beaee-c87b-4f6b-8c0d-652db80708c4 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:51.745922 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-799beaee-c87b-4f6b-8c0d-652db80708c4 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:51.746221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-799beaee-c87b-4f6b-8c0d-652db80708c4 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:51.931822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-799beaee-c87b-4f6b-8c0d-652db80708c4 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:51.949690 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-799beaee-c87b-4f6b-8c0d-652db80708c4 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.221466 Oct 10 18:49:51.950307 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 44/83] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:51 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:51.955319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9b7ed921-3fb3-4434-8037-00333c40bb0c tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:51.994477 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9b7ed921-3fb3-4434-8037-00333c40bb0c tempest-FlavorsExtraSpecsTestJSON-1464023708 tempest-FlavorsExtraSpecsTestJSON-1464023708-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.042601 Oct 10 18:49:51.995497 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 45/84] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:49:51 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:52.139165 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1d798de2-39a9-44b6-b256-08457ad9394b tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:52.139737 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1d798de2-39a9-44b6-b256-08457ad9394b tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:52.140063 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1d798de2-39a9-44b6-b256-08457ad9394b tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:52.140806 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1d798de2-39a9-44b6-b256-08457ad9394b tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:52.141249 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1d798de2-39a9-44b6-b256-08457ad9394b tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:52.141665 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1d798de2-39a9-44b6-b256-08457ad9394b tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:52.202298 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fbb1e96e-c704-4ef0-bba4-199433e43902 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:52.202919 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fbb1e96e-c704-4ef0-bba4-199433e43902 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:52.211242 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fbb1e96e-c704-4ef0-bba4-199433e43902 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:52.211816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fbb1e96e-c704-4ef0-bba4-199433e43902 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:52.212456 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fbb1e96e-c704-4ef0-bba4-199433e43902 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:52.213404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fbb1e96e-c704-4ef0-bba4-199433e43902 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:52.213922 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fbb1e96e-c704-4ef0-bba4-199433e43902 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:52.214569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fbb1e96e-c704-4ef0-bba4-199433e43902 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:52.265425 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1d798de2-39a9-44b6-b256-08457ad9394b tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc" status: 200 len: 328 microversion: 2.1 time: 0.545763 Oct 10 18:49:52.266845 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 40/85] 10.222.0.43 () {60 vars in 1262 bytes} [Mon Oct 10 18:49:51 2022] PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc => generated 328 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:52.376247 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fbb1e96e-c704-4ef0-bba4-199433e43902 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:52.385741 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fbb1e96e-c704-4ef0-bba4-199433e43902 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1337 microversion: 2.1 time: 0.188124 Oct 10 18:49:52.393482 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 46/86] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:52 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1337 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:49:52.525918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-688872249", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:52.616946 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] validate_networks() for None {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:49:52.938689 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:49:52.939179 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:49:52.939837 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:49:52.940297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:49:52.940736 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:49:52.957631 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:52.958135 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:52.958575 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:52.959381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:52.960004 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:52.960658 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:52.973312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-86fc4f81-7a11-48df-87c5-dcc25ec83baf tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:52.976427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-86fc4f81-7a11-48df-87c5-dcc25ec83baf tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:52.977345 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=83,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:52.986416 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Getting quotas for project 8b955bbce93e4283a16a224f87f0ccdc. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:49:52.990461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-86fc4f81-7a11-48df-87c5-dcc25ec83baf tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:52.990750 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Getting quotas for user c9b2d13741de43a59c60ac6f6b20124a and project 8b955bbce93e4283a16a224f87f0ccdc. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:49:52.991254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-86fc4f81-7a11-48df-87c5-dcc25ec83baf tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:52.991696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-86fc4f81-7a11-48df-87c5-dcc25ec83baf tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:52.993037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-86fc4f81-7a11-48df-87c5-dcc25ec83baf tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:52.993647 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-86fc4f81-7a11-48df-87c5-dcc25ec83baf tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:52.994593 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-86fc4f81-7a11-48df-87c5-dcc25ec83baf tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:53.039635 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.utils [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] instances quota exceeded for 8b955bbce93e4283a16a224f87f0ccdc, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127289) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 10 18:49:53.043629 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Request method failure captured: Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 144 Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGlGIKWZpakuSvrhBItjF3H9O0Tju5h0s9TcWZZf2oyOwTYO_OS9qCp5zOcF-A8P0S7SoAD0O3RWCFLhA29J3QM4buRxOrOxryOTRqrMN45hzr2O2WGf70ObO8wPUSiYJPDjYvJhoOffu0ax8UzoAXtsjg2IMuovb4ibjbYCvWXS_zw Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 8b955bbce93e4283a16a224f87f0ccdc Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-QuotasAdminNegativeTest-347478880 Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:49:53.053954 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:49:53.055190 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b955bbce93e4283a16a224f87f0ccdc", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b955bbce93e4283a16a224f87f0ccdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b955bbce93e4283a16a224f87f0ccdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b955bbce93e4283a16a224f87f0ccdc"}]}] Oct 10 18:49:53.055190 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-QuotasAdminNegativeTest-347478880 Oct 10 18:49:53.055190 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 8b955bbce93e4283a16a224f87f0ccdc Oct 10 18:49:53.055190 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-347478880 Oct 10 18:49:53.055190 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-QuotasAdminNegativeTest-347478880-project Oct 10 18:49:53.055190 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:49:53.055190 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:49:53.055190 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: c9b2d13741de43a59c60ac6f6b20124a Oct 10 18:49:53.055190 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-QuotasAdminNegativeTest-347478880-project Oct 10 18:49:53.055190 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:49:53.055190 n-d-860863-1 devstack@n-api.service[127289]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-688872249", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} Oct 10 18:49:53.055190 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-688872249', 'imageRef': 'b0a280ee-26ee-4c9a-8155-4326e368ccc9', 'flavorRef': '452'}}} Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 10 18:49:53.055876 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:53.056973 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:53.059427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:53.070752 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:53.070752 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:53.070752 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:49:53.070752 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:49:53.070752 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 10 18:49:53.070752 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:53.070752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:49:53.070752 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dcdfef71-f96e-4bb3-a0f0-a2e24e603f1e tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.534902 Oct 10 18:49:53.070752 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 41/87] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:49:52 2022] POST /compute/v2.1/servers => generated 119 bytes in 537 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:49:53.071700 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7d90bcb8-14b7-46ec-b457-fd6f22e17eb7 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Action: 'update', calling method: .version_select at 0x7f318edc1280>, body: {"quota_set": {"instances": 10}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:53.439432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-86fc4f81-7a11-48df-87c5-dcc25ec83baf tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:53.462158 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-86fc4f81-7a11-48df-87c5-dcc25ec83baf tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.492857 Oct 10 18:49:53.472562 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 47/88] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:52 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:49:53.480849 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-83d027b5-6473-4052-9732-ba3be541f29c tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:53.482881 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-83d027b5-6473-4052-9732-ba3be541f29c tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:53.489456 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83d027b5-6473-4052-9732-ba3be541f29c tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:53.490470 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83d027b5-6473-4052-9732-ba3be541f29c tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:53.491007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83d027b5-6473-4052-9732-ba3be541f29c tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:53.492280 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83d027b5-6473-4052-9732-ba3be541f29c tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:53.493173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83d027b5-6473-4052-9732-ba3be541f29c tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:53.493791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83d027b5-6473-4052-9732-ba3be541f29c tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:53.640841 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7d90bcb8-14b7-46ec-b457-fd6f22e17eb7 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:53.642058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7d90bcb8-14b7-46ec-b457-fd6f22e17eb7 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:53.642695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7d90bcb8-14b7-46ec-b457-fd6f22e17eb7 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:53.643691 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7d90bcb8-14b7-46ec-b457-fd6f22e17eb7 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:53.644360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7d90bcb8-14b7-46ec-b457-fd6f22e17eb7 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:53.645040 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7d90bcb8-14b7-46ec-b457-fd6f22e17eb7 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:53.728525 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-83d027b5-6473-4052-9732-ba3be541f29c tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:53.736871 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-83d027b5-6473-4052-9732-ba3be541f29c tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1337 microversion: 2.1 time: 0.262734 Oct 10 18:49:53.737449 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 48/89] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:53 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1337 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:53.846156 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7d90bcb8-14b7-46ec-b457-fd6f22e17eb7 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc" status: 200 len: 329 microversion: 2.1 time: 0.783955 Oct 10 18:49:53.846925 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 42/90] 10.222.0.43 () {60 vars in 1262 bytes} [Mon Oct 10 18:49:53 2022] PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc => generated 329 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:53.860364 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7085008a-6166-4588-b68c-cc054fca4880 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Calling method '.version_select at 0x7f318eb83040>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:54.101745 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7085008a-6166-4588-b68c-cc054fca4880 tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc" status: 200 len: 371 microversion: 2.1 time: 0.245048 Oct 10 18:49:54.103643 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 49/91] 10.222.0.43 () {58 vars in 1242 bytes} [Mon Oct 10 18:49:53 2022] GET /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc => generated 371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:54.115007 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1ed43fda-9f44-4f36-9289-79fa17d2d31c tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Action: 'update', calling method: .version_select at 0x7f318edf7430>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:54.379668 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1ed43fda-9f44-4f36-9289-79fa17d2d31c tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:54.379668 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1ed43fda-9f44-4f36-9289-79fa17d2d31c tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:54.379668 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1ed43fda-9f44-4f36-9289-79fa17d2d31c tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:54.380247 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1ed43fda-9f44-4f36-9289-79fa17d2d31c tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:54.381345 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1ed43fda-9f44-4f36-9289-79fa17d2d31c tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:54.382059 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1ed43fda-9f44-4f36-9289-79fa17d2d31c tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:54.513733 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1ed43fda-9f44-4f36-9289-79fa17d2d31c tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc" status: 200 len: 325 microversion: 2.1 time: 0.401686 Oct 10 18:49:54.514554 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 43/92] 10.222.0.43 () {60 vars in 1262 bytes} [Mon Oct 10 18:49:54 2022] PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc => generated 325 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:54.531419 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6872edbc-e848-405e-889d-25d423c12099 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:54.531946 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6872edbc-e848-405e-889d-25d423c12099 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:54.538254 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6872edbc-e848-405e-889d-25d423c12099 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:54.538734 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6872edbc-e848-405e-889d-25d423c12099 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:54.539163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6872edbc-e848-405e-889d-25d423c12099 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:54.540012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6872edbc-e848-405e-889d-25d423c12099 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:54.540469 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6872edbc-e848-405e-889d-25d423c12099 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:54.540937 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6872edbc-e848-405e-889d-25d423c12099 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:54.674085 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6872edbc-e848-405e-889d-25d423c12099 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:54.676434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:49:54.683528 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6872edbc-e848-405e-889d-25d423c12099 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.155909 Oct 10 18:49:54.684412 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 44/93] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:54 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:54.759222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2618ebf8-dd1f-49a4-a35b-ec2878b0cc99 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:54.759824 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2618ebf8-dd1f-49a4-a35b-ec2878b0cc99 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:54.766290 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2618ebf8-dd1f-49a4-a35b-ec2878b0cc99 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:54.766759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2618ebf8-dd1f-49a4-a35b-ec2878b0cc99 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:54.767185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2618ebf8-dd1f-49a4-a35b-ec2878b0cc99 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:54.767923 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2618ebf8-dd1f-49a4-a35b-ec2878b0cc99 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:54.768309 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2618ebf8-dd1f-49a4-a35b-ec2878b0cc99 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:54.768768 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2618ebf8-dd1f-49a4-a35b-ec2878b0cc99 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:54.920037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2618ebf8-dd1f-49a4-a35b-ec2878b0cc99 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:54.930656 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2618ebf8-dd1f-49a4-a35b-ec2878b0cc99 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1337 microversion: 2.1 time: 0.175236 Oct 10 18:49:54.931202 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 45/94] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:54 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1337 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:49:54.992658 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1360744825", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "1746818710", "adminPass": "***", "networks": [{"uuid": "1953c544-78cb-4795-830d-2d7afa10c9d5"}], "security_groups": [{"name": "tempest-securitygroup--53381828"}], "key_name": "tempest-keypair-1701984569", "user_data": "}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:55.021420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8f4bb005-da67-40cb-ab87-f733c1816fd7 tempest-InstanceUsageAuditLogTestJSON-56385237 tempest-InstanceUsageAuditLogTestJSON-56385237-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:55.088786 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8f4bb005-da67-40cb-ab87-f733c1816fd7 tempest-InstanceUsageAuditLogTestJSON-56385237 tempest-InstanceUsageAuditLogTestJSON-56385237-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10 18:49:54" status: 200 len: 318 microversion: 2.1 time: 0.602114 Oct 10 18:49:55.089751 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 50/95] 10.222.0.43 () {58 vars in 1251 bytes} [Mon Oct 10 18:49:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10%2018%3A49%3A54 => generated 318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:55.104134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-087f6f50-19b2-423d-b155-75f03b77899a tempest-InstanceUsageAuditLogTestJSON-56385237 tempest-InstanceUsageAuditLogTestJSON-56385237-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:55.137134 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] validate_networks() for [('1953c544-78cb-4795-830d-2d7afa10c9d5', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:49:55.162188 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-087f6f50-19b2-423d-b155-75f03b77899a tempest-InstanceUsageAuditLogTestJSON-56385237 tempest-InstanceUsageAuditLogTestJSON-56385237-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.057194 Oct 10 18:49:55.167054 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 51/96] 10.222.0.43 () {58 vars in 1185 bytes} [Mon Oct 10 18:49:55 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:49:55.184920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1570759400", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:55.293598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] validate_networks() for None {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:49:55.578858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:49:55.579420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:49:55.579996 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:49:55.580497 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:49:55.581151 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:49:55.590662 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:55.591259 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:55.591749 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:55.592586 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:55.593298 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:55.593849 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:55.615686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Getting quotas for project 8b955bbce93e4283a16a224f87f0ccdc. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:49:55.620810 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Getting quotas for user c9b2d13741de43a59c60ac6f6b20124a and project 8b955bbce93e4283a16a224f87f0ccdc. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:49:55.634740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.utils [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] ram quota exceeded for 8b955bbce93e4283a16a224f87f0ccdc, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127288) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 10 18:49:55.635551 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Request method failure captured: Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 145 Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGlGIKWZpakuSvrhBItjF3H9O0Tju5h0s9TcWZZf2oyOwTYO_OS9qCp5zOcF-A8P0S7SoAD0O3RWCFLhA29J3QM4buRxOrOxryOTRqrMN45hzr2O2WGf70ObO8wPUSiYJPDjYvJhoOffu0ax8UzoAXtsjg2IMuovb4ibjbYCvWXS_zw Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 8b955bbce93e4283a16a224f87f0ccdc Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-QuotasAdminNegativeTest-347478880 Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:49:55.637789 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:49:55.639021 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b955bbce93e4283a16a224f87f0ccdc", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b955bbce93e4283a16a224f87f0ccdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b955bbce93e4283a16a224f87f0ccdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b955bbce93e4283a16a224f87f0ccdc"}]}] Oct 10 18:49:55.639021 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-QuotasAdminNegativeTest-347478880 Oct 10 18:49:55.639021 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 8b955bbce93e4283a16a224f87f0ccdc Oct 10 18:49:55.639021 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-347478880 Oct 10 18:49:55.639021 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-QuotasAdminNegativeTest-347478880-project Oct 10 18:49:55.639021 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:49:55.639021 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:49:55.639021 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c9b2d13741de43a59c60ac6f6b20124a Oct 10 18:49:55.639021 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-QuotasAdminNegativeTest-347478880-project Oct 10 18:49:55.639021 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:49:55.639021 n-d-860863-1 devstack@n-api.service[127288]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1570759400", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} Oct 10 18:49:55.639021 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1570759400', 'imageRef': 'b0a280ee-26ee-4c9a-8155-4326e368ccc9', 'flavorRef': '452'}}} Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 10 18:49:55.639782 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:55.641175 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:55.642519 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:55.643754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:55.643754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:55.643754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:49:55.643754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:49:55.643754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 10 18:49:55.643754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:55.645267 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:49:55.646564 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-764dcdfd-2330-423a-8267-79cf433c826b tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.478483 Oct 10 18:49:55.651764 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 52/97] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:49:55 2022] POST /compute/v2.1/servers => generated 110 bytes in 480 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:49:55.657343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c2fd44b4-6c66-4c86-8591-8d2c20e39eaa tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Action: 'update', calling method: .version_select at 0x7f318eb83dc0>, body: {"quota_set": {"ram": 51200}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:56.162918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c2fd44b4-6c66-4c86-8591-8d2c20e39eaa tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:56.164034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c2fd44b4-6c66-4c86-8591-8d2c20e39eaa tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:56.164564 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c2fd44b4-6c66-4c86-8591-8d2c20e39eaa tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:56.165892 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c2fd44b4-6c66-4c86-8591-8d2c20e39eaa tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:56.165892 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c2fd44b4-6c66-4c86-8591-8d2c20e39eaa tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:56.166457 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c2fd44b4-6c66-4c86-8591-8d2c20e39eaa tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:56.310728 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c2fd44b4-6c66-4c86-8591-8d2c20e39eaa tempest-QuotasAdminNegativeTest-1124554006 tempest-QuotasAdminNegativeTest-1124554006-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc" status: 200 len: 329 microversion: 2.1 time: 0.658181 Oct 10 18:49:56.312075 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 53/98] 10.222.0.43 () {60 vars in 1262 bytes} [Mon Oct 10 18:49:55 2022] PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc => generated 329 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:49:56.316764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8e5cd44f-22f8-4904-8375-3435812e6986 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:56.317703 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8e5cd44f-22f8-4904-8375-3435812e6986 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:56.327357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e5cd44f-22f8-4904-8375-3435812e6986 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:56.328616 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e5cd44f-22f8-4904-8375-3435812e6986 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:56.329219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e5cd44f-22f8-4904-8375-3435812e6986 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:56.330542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e5cd44f-22f8-4904-8375-3435812e6986 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:56.331286 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e5cd44f-22f8-4904-8375-3435812e6986 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:56.331858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e5cd44f-22f8-4904-8375-3435812e6986 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:56.519006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8e5cd44f-22f8-4904-8375-3435812e6986 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:56.532215 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8e5cd44f-22f8-4904-8375-3435812e6986 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.218864 Oct 10 18:49:56.549201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:49:56.549201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:49:56.549201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:49:56.549201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:49:56.549201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:49:56.551551 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 54/99] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:56 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:56.557648 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7033c6c3-65e3-4aa1-9d76-3cb0d95879fc tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:56.559292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7033c6c3-65e3-4aa1-9d76-3cb0d95879fc tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:56.566635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7033c6c3-65e3-4aa1-9d76-3cb0d95879fc tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:56.567126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7033c6c3-65e3-4aa1-9d76-3cb0d95879fc tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:56.567553 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7033c6c3-65e3-4aa1-9d76-3cb0d95879fc tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:56.568497 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7033c6c3-65e3-4aa1-9d76-3cb0d95879fc tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:56.569459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7033c6c3-65e3-4aa1-9d76-3cb0d95879fc tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:56.569889 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7033c6c3-65e3-4aa1-9d76-3cb0d95879fc tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:56.582000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:56.582274 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:56.583052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:56.583918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:56.584483 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:56.585893 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:56.616880 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Getting quotas for project ea2029d88758407a9415b15747079079. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:49:56.621238 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Getting quotas for user ad2be8da9a544318b112ba8e8d3f498a and project ea2029d88758407a9415b15747079079. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:49:56.634101 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:49:56.636758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:49:56.740558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7033c6c3-65e3-4aa1-9d76-3cb0d95879fc tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:56.749168 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7033c6c3-65e3-4aa1-9d76-3cb0d95879fc tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1337 microversion: 2.1 time: 0.196259 Oct 10 18:49:56.749750 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 55/100] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:56 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1337 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:56.754733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e69b0884-bd40-457f-80ef-12acaaccdb08 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Action: 'update', calling method: .version_select at 0x7f318eadbca0>, body: {"quota_set": {"ram": 0}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:56.760037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e69b0884-bd40-457f-80ef-12acaaccdb08 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'c9b2d13741de43a59c60ac6f6b20124a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b955bbce93e4283a16a224f87f0ccdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e69b0884-bd40-457f-80ef-12acaaccdb08 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Request method failure captured: Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: request: PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc HTTP/1.1 Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 25 Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGlGIKWZpakuSvrhBItjF3H9O0Tju5h0s9TcWZZf2oyOwTYO_OS9qCp5zOcF-A8P0S7SoAD0O3RWCFLhA29J3QM4buRxOrOxryOTRqrMN45hzr2O2WGf70ObO8wPUSiYJPDjYvJhoOffu0ax8UzoAXtsjg2IMuovb4ibjbYCvWXS_zw Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 8b955bbce93e4283a16a224f87f0ccdc Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-QuotasAdminNegativeTest-347478880 Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:49:56.762323 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:49:56.764160 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8b955bbce93e4283a16a224f87f0ccdc", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8b955bbce93e4283a16a224f87f0ccdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b955bbce93e4283a16a224f87f0ccdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8b955bbce93e4283a16a224f87f0ccdc"}]}] Oct 10 18:49:56.764160 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-QuotasAdminNegativeTest-347478880 Oct 10 18:49:56.764160 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 8b955bbce93e4283a16a224f87f0ccdc Oct 10 18:49:56.764160 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-347478880 Oct 10 18:49:56.764160 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-QuotasAdminNegativeTest-347478880-project Oct 10 18:49:56.764160 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:49:56.764160 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:49:56.764160 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c9b2d13741de43a59c60ac6f6b20124a Oct 10 18:49:56.764160 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-QuotasAdminNegativeTest-347478880-project Oct 10 18:49:56.764160 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:49:56.764160 n-d-860863-1 devstack@n-api.service[127288]: {"quota_set": {"ram": 0}} Oct 10 18:49:56.764160 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:49:56.764160 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 10 18:49:56.764160 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '8b955bbce93e4283a16a224f87f0ccdc', 'body': {'quota_set': {'ram': 0}}} Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:56.765163 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:56.766341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:56.767684 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:56.767684 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:56.767684 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:49:56.767684 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:49:56.767684 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 10 18:49:56.767684 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:49:56.768803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e69b0884-bd40-457f-80ef-12acaaccdb08 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:49:56.769634 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e69b0884-bd40-457f-80ef-12acaaccdb08 tempest-QuotasAdminNegativeTest-347478880 tempest-QuotasAdminNegativeTest-347478880-project] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc" status: 403 len: 116 microversion: 2.1 time: 0.018754 Oct 10 18:49:56.770171 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 56/101] 10.222.0.43 () {60 vars in 1262 bytes} [Mon Oct 10 18:49:56 2022] PUT /compute/v2.1/os-quota-sets/8b955bbce93e4283a16a224f87f0ccdc => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:49:56.824870 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-98e1d6ad-bd4c-4d55-9411-a6f388589331 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.836814 Oct 10 18:49:56.830178 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 46/102] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:49:54 2022] POST /compute/v2.1/servers => generated 400 bytes in 1843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 18:49:56.843546 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5ae5e545-ac4c-4d94-b0a4-9b5df2a63e99 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:56.844206 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5ae5e545-ac4c-4d94-b0a4-9b5df2a63e99 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:56.927261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5ae5e545-ac4c-4d94-b0a4-9b5df2a63e99 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:56.936880 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5ae5e545-ac4c-4d94-b0a4-9b5df2a63e99 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1265 microversion: 2.1 time: 0.099510 Oct 10 18:49:56.937990 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 47/103] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:56 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:57.065005 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-57b4a53e-6a98-4745-8efa-a9daa2b108b7 tempest-FlavorsV2NegativeTest-2079406239 tempest-FlavorsV2NegativeTest-2079406239-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:57.075373 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-57b4a53e-6a98-4745-8efa-a9daa2b108b7 tempest-FlavorsV2NegativeTest-2079406239 tempest-FlavorsV2NegativeTest-2079406239-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.303758 Oct 10 18:49:57.076116 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 57/104] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:49:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:57.555719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8c3bb63e-ce64-4f5d-b37b-e174e30e6e64 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:57.556389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8c3bb63e-ce64-4f5d-b37b-e174e30e6e64 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:57.563145 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c3bb63e-ce64-4f5d-b37b-e174e30e6e64 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:57.563628 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c3bb63e-ce64-4f5d-b37b-e174e30e6e64 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:57.564178 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c3bb63e-ce64-4f5d-b37b-e174e30e6e64 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:57.565043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c3bb63e-ce64-4f5d-b37b-e174e30e6e64 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:57.565489 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c3bb63e-ce64-4f5d-b37b-e174e30e6e64 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:57.566130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c3bb63e-ce64-4f5d-b37b-e174e30e6e64 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:57.712076 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8c3bb63e-ce64-4f5d-b37b-e174e30e6e64 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:57.720556 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8c3bb63e-ce64-4f5d-b37b-e174e30e6e64 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.168985 Oct 10 18:49:57.720927 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 48/105] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:57 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:57.773341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c731dc9a-40df-47c0-965e-273317ac3edb tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:57.774271 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c731dc9a-40df-47c0-965e-273317ac3edb tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:57.781401 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c731dc9a-40df-47c0-965e-273317ac3edb tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:57.781892 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c731dc9a-40df-47c0-965e-273317ac3edb tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:57.782322 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c731dc9a-40df-47c0-965e-273317ac3edb tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:57.788129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c731dc9a-40df-47c0-965e-273317ac3edb tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:57.788635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c731dc9a-40df-47c0-965e-273317ac3edb tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:57.789070 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c731dc9a-40df-47c0-965e-273317ac3edb tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:57.962744 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7ef3b865-6765-4f91-877f-c0ac050b6063 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:57.964000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7ef3b865-6765-4f91-877f-c0ac050b6063 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:58.015843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c731dc9a-40df-47c0-965e-273317ac3edb tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:58.026495 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c731dc9a-40df-47c0-965e-273317ac3edb tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1337 microversion: 2.1 time: 0.256949 Oct 10 18:49:58.045601 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 58/106] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:57 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1337 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:58.106704 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7ef3b865-6765-4f91-877f-c0ac050b6063 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:58.114520 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7ef3b865-6765-4f91-877f-c0ac050b6063 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1265 microversion: 2.1 time: 0.156476 Oct 10 18:49:58.114836 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 49/107] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:57 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:58.507536 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-7453311c-414b-4aa0-a384-36a18d5b0de1 req-fd0b3c64-abe1-4925-98fa-9697ad1ec33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9fa1631-80e1-46e3-80f8-907534151a0c", "name": "network-vif-plugged", "status": "completed", "tag": "9add7f12-e83f-426c-b675-ae2a583da350"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:58.519527 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-7453311c-414b-4aa0-a384-36a18d5b0de1 req-fd0b3c64-abe1-4925-98fa-9697ad1ec33e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:58.520084 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-7453311c-414b-4aa0-a384-36a18d5b0de1 req-fd0b3c64-abe1-4925-98fa-9697ad1ec33e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:58.520636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-7453311c-414b-4aa0-a384-36a18d5b0de1 req-fd0b3c64-abe1-4925-98fa-9697ad1ec33e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:58.533245 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-7453311c-414b-4aa0-a384-36a18d5b0de1 req-fd0b3c64-abe1-4925-98fa-9697ad1ec33e service nova] Creating event network-vif-plugged:9add7f12-e83f-426c-b675-ae2a583da350 for instance d9fa1631-80e1-46e3-80f8-907534151a0c on n-h1-860863-1 Oct 10 18:49:58.538748 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-7453311c-414b-4aa0-a384-36a18d5b0de1 req-fd0b3c64-abe1-4925-98fa-9697ad1ec33e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174245 Oct 10 18:49:58.539353 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 59/108] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:49:58.732315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fdd1ca97-325f-4edc-bdde-aeb7ded03f67 tempest-FlavorsV2NegativeTest-2079406239 tempest-FlavorsV2NegativeTest-2079406239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-810128271", "imageRef": "dc421d63-8b82-40e6-b1af-5cc0facdd1b5", "flavorRef": "452"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:49:58.745490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b63e09d4-031b-4827-b0c5-23d29c27d075 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:58.746965 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b63e09d4-031b-4827-b0c5-23d29c27d075 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:58.754797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b63e09d4-031b-4827-b0c5-23d29c27d075 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:58.755677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b63e09d4-031b-4827-b0c5-23d29c27d075 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:58.756248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b63e09d4-031b-4827-b0c5-23d29c27d075 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:58.757116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b63e09d4-031b-4827-b0c5-23d29c27d075 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:58.757704 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b63e09d4-031b-4827-b0c5-23d29c27d075 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:58.758264 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b63e09d4-031b-4827-b0c5-23d29c27d075 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:58.848089 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-fdd1ca97-325f-4edc-bdde-aeb7ded03f67 tempest-FlavorsV2NegativeTest-2079406239 tempest-FlavorsV2NegativeTest-2079406239-project] validate_networks() for None {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:49:58.921640 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b63e09d4-031b-4827-b0c5-23d29c27d075 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:58.934007 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b63e09d4-031b-4827-b0c5-23d29c27d075 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.192947 Oct 10 18:49:58.934626 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 60/109] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:58 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:59.050713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a537f7b8-e1fd-4899-8894-4a98d3113425 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:59.051330 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a537f7b8-e1fd-4899-8894-4a98d3113425 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:59.058655 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a537f7b8-e1fd-4899-8894-4a98d3113425 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:59.059139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a537f7b8-e1fd-4899-8894-4a98d3113425 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:59.059572 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a537f7b8-e1fd-4899-8894-4a98d3113425 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:59.060319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a537f7b8-e1fd-4899-8894-4a98d3113425 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:59.060816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a537f7b8-e1fd-4899-8894-4a98d3113425 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:59.061273 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a537f7b8-e1fd-4899-8894-4a98d3113425 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:59.103111 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-fdd1ca97-325f-4edc-bdde-aeb7ded03f67 tempest-FlavorsV2NegativeTest-2079406239 tempest-FlavorsV2NegativeTest-2079406239-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fdd1ca97-325f-4edc-bdde-aeb7ded03f67 tempest-FlavorsV2NegativeTest-2079406239 tempest-FlavorsV2NegativeTest-2079406239-project] Request method failure captured: Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 142 Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGlUbuaty0RWShqDF3ongM71lTIscvWXPPSiSRvG1rJWclppsLzwHWg-mhxRS1mAcpD39Gx7cr37JZbFqe9i49kzvBDzFL9_WRHbGEogYvyxCYvGng2GKhTrQraFVx-BRmdPkGlu2X4AsYfzFlcdmLngfTPrv7gCponn_RJNs_lce9M Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: ff8398ab5ccc4b0da67112bf4a767097 Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-FlavorsV2NegativeTest-2079406239 Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:49:59.105141 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:49:59.106418 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff8398ab5ccc4b0da67112bf4a767097", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff8398ab5ccc4b0da67112bf4a767097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff8398ab5ccc4b0da67112bf4a767097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff8398ab5ccc4b0da67112bf4a767097"}]}] Oct 10 18:49:59.106418 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-FlavorsV2NegativeTest-2079406239 Oct 10 18:49:59.106418 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: ff8398ab5ccc4b0da67112bf4a767097 Oct 10 18:49:59.106418 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-2079406239 Oct 10 18:49:59.106418 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-FlavorsV2NegativeTest-2079406239-project Oct 10 18:49:59.106418 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:49:59.106418 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:49:59.106418 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: b12febd41949447c886dd9559111c880 Oct 10 18:49:59.106418 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-FlavorsV2NegativeTest-2079406239-project Oct 10 18:49:59.106418 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:49:59.106418 n-d-860863-1 devstack@n-api.service[127289]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-810128271", "imageRef": "dc421d63-8b82-40e6-b1af-5cc0facdd1b5", "flavorRef": "452"}} Oct 10 18:49:59.106418 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: exception: Flavor's memory is too small for requested image. Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-810128271', 'imageRef': 'dc421d63-8b82-40e6-b1af-5cc0facdd1b5', 'flavorRef': '452'}}} Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:59.107824 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:59.108957 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:49:59.110120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:49:59.110120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:49:59.110120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:49:59.110120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:49:59.110120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 10 18:49:59.110120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:49:59.110120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fdd1ca97-325f-4edc-bdde-aeb7ded03f67 tempest-FlavorsV2NegativeTest-2079406239 tempest-FlavorsV2NegativeTest-2079406239-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:49:59.110120 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fdd1ca97-325f-4edc-bdde-aeb7ded03f67 tempest-FlavorsV2NegativeTest-2079406239 tempest-FlavorsV2NegativeTest-2079406239-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.379460 Oct 10 18:49:59.122455 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 50/110] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:49:58 2022] POST /compute/v2.1/servers => generated 93 bytes in 396 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 18:49:59.136978 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9f6cffa6-6131-4584-825d-b4ccd4378773 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:59.138195 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9f6cffa6-6131-4584-825d-b4ccd4378773 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:59.147684 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9f6cffa6-6131-4584-825d-b4ccd4378773 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:59.150381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9f6cffa6-6131-4584-825d-b4ccd4378773 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:59.151360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9f6cffa6-6131-4584-825d-b4ccd4378773 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:59.152563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9f6cffa6-6131-4584-825d-b4ccd4378773 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:59.154569 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9f6cffa6-6131-4584-825d-b4ccd4378773 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:59.155217 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9f6cffa6-6131-4584-825d-b4ccd4378773 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:59.265655 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9f6cffa6-6131-4584-825d-b4ccd4378773 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:59.273934 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a537f7b8-e1fd-4899-8894-4a98d3113425 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:49:59.276348 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9f6cffa6-6131-4584-825d-b4ccd4378773 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1317 microversion: 2.1 time: 0.143472 Oct 10 18:49:59.277127 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 51/111] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:59 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:49:59.283375 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a537f7b8-e1fd-4899-8894-4a98d3113425 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1337 microversion: 2.1 time: 0.236785 Oct 10 18:49:59.298549 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 61/112] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:59 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1337 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:49:59.882427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Calling method '.version_select at 0x7f318ec948b0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:59.888962 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:59.889576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:59.890128 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:59.910354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:59.910901 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:59.911329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:59.947618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:59.948407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:59.948893 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:59.957905 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9c185b99-a859-4c17-aa4e-f5f3cf802de3 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:49:59.959215 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9c185b99-a859-4c17-aa4e-f5f3cf802de3 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:49:59.962944 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:59.963439 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:59.963872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:59.988769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c185b99-a859-4c17-aa4e-f5f3cf802de3 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:59.988980 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:59.991537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:59.991537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:59.992324 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c185b99-a859-4c17-aa4e-f5f3cf802de3 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:59.992961 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c185b99-a859-4c17-aa4e-f5f3cf802de3 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:59.993912 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c185b99-a859-4c17-aa4e-f5f3cf802de3 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:49:59.994553 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c185b99-a859-4c17-aa4e-f5f3cf802de3 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:49:59.995160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c185b99-a859-4c17-aa4e-f5f3cf802de3 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:49:59.998423 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-487ae955-6b6f-4772-97fb-9f1107d81629 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.545316 Oct 10 18:49:59.999516 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 52/113] 10.222.0.43 () {60 vars in 1243 bytes} [Mon Oct 10 18:49:59 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:00.020475 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Calling method '.version_select at 0x7f318ec94dc0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:00.024784 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:00.029799 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:00.029799 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:00.063086 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:00.063575 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:00.069234 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:00.115414 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:00.115909 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:00.116345 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:00.142979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:00.143463 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:00.144965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:00.184014 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:00.184495 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:00.185732 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:00.192858 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f9cb0eda-e088-483d-8650-7e27d99683b4 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.177606 Oct 10 18:50:00.194093 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 53/114] 10.222.0.43 () {60 vars in 1222 bytes} [Mon Oct 10 18:50:00 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 18:50:00.207369 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c102ee6b-ac65-43cd-8a5e-6453a5a7be95 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Calling method '.version_select at 0x7f318ec93550>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:00.211140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c102ee6b-ac65-43cd-8a5e-6453a5a7be95 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:00.211890 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c102ee6b-ac65-43cd-8a5e-6453a5a7be95 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:00.212391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c102ee6b-ac65-43cd-8a5e-6453a5a7be95 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:00.228711 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c102ee6b-ac65-43cd-8a5e-6453a5a7be95 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:00.229198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c102ee6b-ac65-43cd-8a5e-6453a5a7be95 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:00.229623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c102ee6b-ac65-43cd-8a5e-6453a5a7be95 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:00.236195 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c102ee6b-ac65-43cd-8a5e-6453a5a7be95 tempest-HypervisorAdminV253TestBase-1087598486 tempest-HypervisorAdminV253TestBase-1087598486-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/c47d0229-99f9-4f15-ad3a-3d8663591a85" status: 200 len: 792 microversion: 2.53 time: 0.034225 Oct 10 18:50:00.236819 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 54/115] 10.222.0.43 () {60 vars in 1298 bytes} [Mon Oct 10 18:50:00 2022] GET /compute/v2.1/os-hypervisors/c47d0229-99f9-4f15-ad3a-3d8663591a85 => generated 792 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 18:50:00.301154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-90638ee2-b3be-474c-b685-24f109706072 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:00.301974 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-90638ee2-b3be-474c-b685-24f109706072 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:00.309772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90638ee2-b3be-474c-b685-24f109706072 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:00.310957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90638ee2-b3be-474c-b685-24f109706072 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:00.311387 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90638ee2-b3be-474c-b685-24f109706072 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:00.313334 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90638ee2-b3be-474c-b685-24f109706072 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:00.313334 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90638ee2-b3be-474c-b685-24f109706072 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:00.313334 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90638ee2-b3be-474c-b685-24f109706072 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:00.319910 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9c185b99-a859-4c17-aa4e-f5f3cf802de3 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:00.329665 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9c185b99-a859-4c17-aa4e-f5f3cf802de3 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1341 microversion: 2.1 time: 0.376137 Oct 10 18:50:00.330758 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 62/116] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:49:59 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1341 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:50:00.337809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8506bdf0-64bc-481d-8767-3e9415a1fcc0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:00.338818 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8506bdf0-64bc-481d-8767-3e9415a1fcc0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:00.354837 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8506bdf0-64bc-481d-8767-3e9415a1fcc0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:00.360270 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8506bdf0-64bc-481d-8767-3e9415a1fcc0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:00.362646 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8506bdf0-64bc-481d-8767-3e9415a1fcc0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:00.363565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8506bdf0-64bc-481d-8767-3e9415a1fcc0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:00.365012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8506bdf0-64bc-481d-8767-3e9415a1fcc0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:00.366845 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8506bdf0-64bc-481d-8767-3e9415a1fcc0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:00.417782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-90638ee2-b3be-474c-b685-24f109706072 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:00.437528 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-90638ee2-b3be-474c-b685-24f109706072 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1323 microversion: 2.1 time: 0.140003 Oct 10 18:50:00.445049 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 55/117] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:00 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1323 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:00.558378 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-1c2d59f3-0281-4aee-8289-45795b79ef4e req-bd790afd-05a6-4455-8cb5-abd7e2270a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5603901d-b471-4e23-9f0c-1e62ff4bbd51", "name": "network-vif-plugged", "status": "completed", "tag": "8fbac730-1bb1-4ddf-92da-52bd004324f7"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:00.569852 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1c2d59f3-0281-4aee-8289-45795b79ef4e req-bd790afd-05a6-4455-8cb5-abd7e2270a76 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:00.570330 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1c2d59f3-0281-4aee-8289-45795b79ef4e req-bd790afd-05a6-4455-8cb5-abd7e2270a76 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:00.570750 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1c2d59f3-0281-4aee-8289-45795b79ef4e req-bd790afd-05a6-4455-8cb5-abd7e2270a76 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:00.583574 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-1c2d59f3-0281-4aee-8289-45795b79ef4e req-bd790afd-05a6-4455-8cb5-abd7e2270a76 service nova] Creating event network-vif-plugged:8fbac730-1bb1-4ddf-92da-52bd004324f7 for instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 on n-h1-860863-1 Oct 10 18:50:00.588684 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-1c2d59f3-0281-4aee-8289-45795b79ef4e req-bd790afd-05a6-4455-8cb5-abd7e2270a76 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034158 Oct 10 18:50:00.589573 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 56/118] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:00.742077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8506bdf0-64bc-481d-8767-3e9415a1fcc0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:00.752043 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8506bdf0-64bc-481d-8767-3e9415a1fcc0 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1337 microversion: 2.1 time: 0.419046 Oct 10 18:50:00.765224 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 63/119] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:00 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1337 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:01.358511 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cf09629c-f1dd-4e2e-88be-8bd54bae5d6e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:01.360178 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cf09629c-f1dd-4e2e-88be-8bd54bae5d6e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:01.367197 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf09629c-f1dd-4e2e-88be-8bd54bae5d6e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:01.367710 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf09629c-f1dd-4e2e-88be-8bd54bae5d6e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:01.368131 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf09629c-f1dd-4e2e-88be-8bd54bae5d6e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:01.368871 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf09629c-f1dd-4e2e-88be-8bd54bae5d6e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:01.369325 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf09629c-f1dd-4e2e-88be-8bd54bae5d6e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:01.369770 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf09629c-f1dd-4e2e-88be-8bd54bae5d6e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:01.469376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4fe0caf1-b796-430d-adc4-b657e7a391b4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:01.471050 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4fe0caf1-b796-430d-adc4-b657e7a391b4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:01.494303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4fe0caf1-b796-430d-adc4-b657e7a391b4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:01.495466 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4fe0caf1-b796-430d-adc4-b657e7a391b4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:01.496825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4fe0caf1-b796-430d-adc4-b657e7a391b4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:01.498685 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4fe0caf1-b796-430d-adc4-b657e7a391b4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:01.499523 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4fe0caf1-b796-430d-adc4-b657e7a391b4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:01.500375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4fe0caf1-b796-430d-adc4-b657e7a391b4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:01.799004 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cf09629c-f1dd-4e2e-88be-8bd54bae5d6e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:01.811890 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cf09629c-f1dd-4e2e-88be-8bd54bae5d6e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1491 microversion: 2.1 time: 0.457877 Oct 10 18:50:01.824198 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 57/120] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:01 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1491 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:01.840278 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-785b4ebc-64a1-4e2d-9139-9db48fcd9730 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:01.840976 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-785b4ebc-64a1-4e2d-9139-9db48fcd9730 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:01.848467 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-785b4ebc-64a1-4e2d-9139-9db48fcd9730 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:01.849074 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-785b4ebc-64a1-4e2d-9139-9db48fcd9730 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:01.849519 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-785b4ebc-64a1-4e2d-9139-9db48fcd9730 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:01.850332 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-785b4ebc-64a1-4e2d-9139-9db48fcd9730 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:01.850788 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-785b4ebc-64a1-4e2d-9139-9db48fcd9730 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:01.854501 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-785b4ebc-64a1-4e2d-9139-9db48fcd9730 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:01.891304 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4fe0caf1-b796-430d-adc4-b657e7a391b4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:01.901157 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4fe0caf1-b796-430d-adc4-b657e7a391b4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1389 microversion: 2.1 time: 0.439392 Oct 10 18:50:01.917782 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 64/121] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:01 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1389 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:02.097154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-785b4ebc-64a1-4e2d-9139-9db48fcd9730 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:02.110242 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-785b4ebc-64a1-4e2d-9139-9db48fcd9730 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1337 microversion: 2.1 time: 0.277694 Oct 10 18:50:02.111212 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 58/122] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:01 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1337 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:02.359542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c754adea-8e53-41ff-8452-30aab97aaff5 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:02.360123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c754adea-8e53-41ff-8452-30aab97aaff5 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:02.366675 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c754adea-8e53-41ff-8452-30aab97aaff5 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:02.367241 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c754adea-8e53-41ff-8452-30aab97aaff5 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:02.367682 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c754adea-8e53-41ff-8452-30aab97aaff5 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:02.368398 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c754adea-8e53-41ff-8452-30aab97aaff5 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:02.368891 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c754adea-8e53-41ff-8452-30aab97aaff5 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:02.375466 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c754adea-8e53-41ff-8452-30aab97aaff5 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:02.445442 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c754adea-8e53-41ff-8452-30aab97aaff5 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:50:02.644744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:02.808248 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c754adea-8e53-41ff-8452-30aab97aaff5 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] 10.222.0.43 "DELETE /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 204 len: 0 microversion: 2.1 time: 0.888917 Oct 10 18:50:02.808871 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 65/123] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:50:01 2022] DELETE /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 0 bytes in 890 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:50:02.819239 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b866d5c0-7226-402d-8c4e-8f1222c6f150 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:02.820174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b866d5c0-7226-402d-8c4e-8f1222c6f150 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:02.823608 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:02.828342 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b866d5c0-7226-402d-8c4e-8f1222c6f150 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:02.828835 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b866d5c0-7226-402d-8c4e-8f1222c6f150 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:02.829272 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b866d5c0-7226-402d-8c4e-8f1222c6f150 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:02.829988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b866d5c0-7226-402d-8c4e-8f1222c6f150 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:02.830439 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b866d5c0-7226-402d-8c4e-8f1222c6f150 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:02.830861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b866d5c0-7226-402d-8c4e-8f1222c6f150 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:02.938242 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d442b569-9af4-4ebb-bc02-1a4f39906126 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:02.938242 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d442b569-9af4-4ebb-bc02-1a4f39906126 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:02.941461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d442b569-9af4-4ebb-bc02-1a4f39906126 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:02.943671 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d442b569-9af4-4ebb-bc02-1a4f39906126 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:02.944419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d442b569-9af4-4ebb-bc02-1a4f39906126 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:02.946153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d442b569-9af4-4ebb-bc02-1a4f39906126 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:02.946981 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d442b569-9af4-4ebb-bc02-1a4f39906126 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:02.948492 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d442b569-9af4-4ebb-bc02-1a4f39906126 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:02.995768 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b866d5c0-7226-402d-8c4e-8f1222c6f150 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:03.032644 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b866d5c0-7226-402d-8c4e-8f1222c6f150 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1497 microversion: 2.1 time: 0.196795 Oct 10 18:50:03.056523 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 59/124] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:02 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1497 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:03.134848 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b6336655-8b18-4d18-97f1-ecf29ecfb8ef tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:03.135590 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b6336655-8b18-4d18-97f1-ecf29ecfb8ef tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:03.143392 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b6336655-8b18-4d18-97f1-ecf29ecfb8ef tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:03.144165 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b6336655-8b18-4d18-97f1-ecf29ecfb8ef tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:03.144626 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b6336655-8b18-4d18-97f1-ecf29ecfb8ef tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:03.145567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b6336655-8b18-4d18-97f1-ecf29ecfb8ef tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:03.146278 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b6336655-8b18-4d18-97f1-ecf29ecfb8ef tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:03.147008 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b6336655-8b18-4d18-97f1-ecf29ecfb8ef tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:03.280166 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d442b569-9af4-4ebb-bc02-1a4f39906126 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:03.288441 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d442b569-9af4-4ebb-bc02-1a4f39906126 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1389 microversion: 2.1 time: 0.362423 Oct 10 18:50:03.302096 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 66/125] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:02 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1389 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:03.327383 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b6336655-8b18-4d18-97f1-ecf29ecfb8ef tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:03.336152 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b6336655-8b18-4d18-97f1-ecf29ecfb8ef tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1486 microversion: 2.1 time: 0.205960 Oct 10 18:50:03.336771 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 60/126] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:03 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1486 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:03.359621 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-662e6097-bb55-412a-aca4-d29ba38e97e5 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:03.360572 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-662e6097-bb55-412a-aca4-d29ba38e97e5 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:03.367189 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-662e6097-bb55-412a-aca4-d29ba38e97e5 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:03.367678 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-662e6097-bb55-412a-aca4-d29ba38e97e5 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:03.368108 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-662e6097-bb55-412a-aca4-d29ba38e97e5 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:03.368829 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-662e6097-bb55-412a-aca4-d29ba38e97e5 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:03.369283 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-662e6097-bb55-412a-aca4-d29ba38e97e5 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:03.371377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-662e6097-bb55-412a-aca4-d29ba38e97e5 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:03.780437 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-662e6097-bb55-412a-aca4-d29ba38e97e5 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1637 microversion: 2.1 time: 0.421969 Oct 10 18:50:03.810596 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 67/127] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:03 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1637 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:50:03.823565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bedb0240-17fa-4f42-97c9-e763c758b362 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:03.824311 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bedb0240-17fa-4f42-97c9-e763c758b362 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:03.833657 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bedb0240-17fa-4f42-97c9-e763c758b362 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:03.834218 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bedb0240-17fa-4f42-97c9-e763c758b362 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:03.834881 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bedb0240-17fa-4f42-97c9-e763c758b362 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:03.835664 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bedb0240-17fa-4f42-97c9-e763c758b362 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:03.836190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bedb0240-17fa-4f42-97c9-e763c758b362 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:03.836716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bedb0240-17fa-4f42-97c9-e763c758b362 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:03.865543 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bedb0240-17fa-4f42-97c9-e763c758b362 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:50:04.002827 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-eb2b8539-78f3-4844-bd25-302dfef3cd66 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Action: 'update', calling method: .version_select at 0x7f318ef81940>, body: {"quota_set": {"ram": "5120"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:04.203535 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bedb0240-17fa-4f42-97c9-e763c758b362 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 204 len: 0 microversion: 2.1 time: 0.390354 Oct 10 18:50:04.204560 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 68/128] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:50:03 2022] DELETE /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:50:04.222093 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-162e5f12-a18b-49cf-8d8d-647514df3406 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:04.222912 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-162e5f12-a18b-49cf-8d8d-647514df3406 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:04.227753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:04.234936 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-162e5f12-a18b-49cf-8d8d-647514df3406 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:04.235435 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-162e5f12-a18b-49cf-8d8d-647514df3406 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:04.235901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-162e5f12-a18b-49cf-8d8d-647514df3406 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:04.236696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-162e5f12-a18b-49cf-8d8d-647514df3406 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:04.237155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-162e5f12-a18b-49cf-8d8d-647514df3406 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:04.237580 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-162e5f12-a18b-49cf-8d8d-647514df3406 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:04.397650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-162e5f12-a18b-49cf-8d8d-647514df3406 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:04.407136 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-162e5f12-a18b-49cf-8d8d-647514df3406 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1497 microversion: 2.1 time: 0.201151 Oct 10 18:50:04.407933 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 69/129] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:04 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:04.411824 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb2b8539-78f3-4844-bd25-302dfef3cd66 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:04.412561 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb2b8539-78f3-4844-bd25-302dfef3cd66 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:04.413867 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb2b8539-78f3-4844-bd25-302dfef3cd66 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:04.414152 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb2b8539-78f3-4844-bd25-302dfef3cd66 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:04.414788 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb2b8539-78f3-4844-bd25-302dfef3cd66 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:04.415412 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb2b8539-78f3-4844-bd25-302dfef3cd66 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:04.416015 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e5f2f537-4bb4-4d1d-ae01-9b38729cb873 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:04.416797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e5f2f537-4bb4-4d1d-ae01-9b38729cb873 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:04.425621 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5f2f537-4bb4-4d1d-ae01-9b38729cb873 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:04.426262 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5f2f537-4bb4-4d1d-ae01-9b38729cb873 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:04.426872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5f2f537-4bb4-4d1d-ae01-9b38729cb873 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:04.427653 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5f2f537-4bb4-4d1d-ae01-9b38729cb873 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:04.428290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5f2f537-4bb4-4d1d-ae01-9b38729cb873 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:04.429812 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5f2f537-4bb4-4d1d-ae01-9b38729cb873 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:04.586204 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-eb2b8539-78f3-4844-bd25-302dfef3cd66 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/0b68d40761ca4e5f8699e77f38ef1952" status: 200 len: 148 microversion: 2.57 time: 1.134608 Oct 10 18:50:04.587417 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 61/130] 10.222.0.43 () {62 vars in 1303 bytes} [Mon Oct 10 18:50:03 2022] PUT /compute/v2.1/os-quota-sets/0b68d40761ca4e5f8699e77f38ef1952 => generated 148 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:50:04.592345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e5f2f537-4bb4-4d1d-ae01-9b38729cb873 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:04.599037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-eeb25cf3-220b-422a-90a4-9e007f8e99d2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:04.599972 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-eeb25cf3-220b-422a-90a4-9e007f8e99d2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:04.604201 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e5f2f537-4bb4-4d1d-ae01-9b38729cb873 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1492 microversion: 2.1 time: 0.195261 Oct 10 18:50:04.604843 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 70/131] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:04 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1492 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:04.610194 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-446dcc81-d075-4d40-adef-8a931a6cfd2c tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Calling method '.version_select at 0x7f318ff60040>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:04.621576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eeb25cf3-220b-422a-90a4-9e007f8e99d2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:04.623719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eeb25cf3-220b-422a-90a4-9e007f8e99d2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:04.624268 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eeb25cf3-220b-422a-90a4-9e007f8e99d2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:04.625103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eeb25cf3-220b-422a-90a4-9e007f8e99d2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:04.628635 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eeb25cf3-220b-422a-90a4-9e007f8e99d2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:04.628635 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eeb25cf3-220b-422a-90a4-9e007f8e99d2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:04.791096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-eeb25cf3-220b-422a-90a4-9e007f8e99d2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:04.804476 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-eeb25cf3-220b-422a-90a4-9e007f8e99d2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1389 microversion: 2.1 time: 0.215679 Oct 10 18:50:04.816639 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 62/132] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:04 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1389 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:05.101525 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-446dcc81-d075-4d40-adef-8a931a6cfd2c tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:05.102279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-446dcc81-d075-4d40-adef-8a931a6cfd2c tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:05.103200 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-446dcc81-d075-4d40-adef-8a931a6cfd2c tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:05.104126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-446dcc81-d075-4d40-adef-8a931a6cfd2c tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:05.104557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-446dcc81-d075-4d40-adef-8a931a6cfd2c tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:05.105047 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-446dcc81-d075-4d40-adef-8a931a6cfd2c tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:05.128719 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-446dcc81-d075-4d40-adef-8a931a6cfd2c tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/0b68d40761ca4e5f8699e77f38ef1952/detail" status: 200 len: 463 microversion: 2.57 time: 0.522603 Oct 10 18:50:05.132895 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 71/133] 10.222.0.43 () {60 vars in 1304 bytes} [Mon Oct 10 18:50:04 2022] GET /compute/v2.1/os-quota-sets/0b68d40761ca4e5f8699e77f38ef1952/detail => generated 463 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:50:05.222188 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-282056117", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": "none"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:05.294678 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:50:05.295127 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:50:05.295636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:50:05.296043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:50:05.296449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:50:05.306126 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:05.306604 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:05.307036 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:05.307898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:05.308505 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:05.312202 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:05.329381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Getting quotas for project 8ef741d9b69c440c86b92b1a74dc3967. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:50:05.333214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Getting quotas for user 7914aad2d75e45ff83670105b7383e74 and project 8ef741d9b69c440c86b92b1a74dc3967. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:50:05.346044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:50:05.348322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:50:05.432111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-29d37910-60f9-4d2a-9731-3604aec89c8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:05.432908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-29d37910-60f9-4d2a-9731-3604aec89c8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:05.441940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29d37910-60f9-4d2a-9731-3604aec89c8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:05.445972 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29d37910-60f9-4d2a-9731-3604aec89c8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:05.446562 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29d37910-60f9-4d2a-9731-3604aec89c8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:05.449294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29d37910-60f9-4d2a-9731-3604aec89c8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:05.450819 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29d37910-60f9-4d2a-9731-3604aec89c8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:05.451436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29d37910-60f9-4d2a-9731-3604aec89c8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:05.630355 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4c615168-a029-4f3f-85fd-825bbc032bb4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.618489 Oct 10 18:50:05.631172 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 63/134] 10.222.0.43 () {62 vars in 1188 bytes} [Mon Oct 10 18:50:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 10 18:50:05.646883 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3491dc2b-d419-4cb2-929b-247c23e91a46 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:05.647937 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3491dc2b-d419-4cb2-929b-247c23e91a46 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:05.658316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3491dc2b-d419-4cb2-929b-247c23e91a46 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:05.658316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3491dc2b-d419-4cb2-929b-247c23e91a46 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:05.658316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3491dc2b-d419-4cb2-929b-247c23e91a46 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:05.659312 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3491dc2b-d419-4cb2-929b-247c23e91a46 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:05.659899 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3491dc2b-d419-4cb2-929b-247c23e91a46 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:05.660419 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3491dc2b-d419-4cb2-929b-247c23e91a46 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:05.692728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-29d37910-60f9-4d2a-9731-3604aec89c8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:05.710570 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-29d37910-60f9-4d2a-9731-3604aec89c8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1497 microversion: 2.1 time: 0.282839 Oct 10 18:50:05.734385 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 72/135] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:05 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1497 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:50:05.740126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-572939f2-74c3-46f4-9d27-2973fee4f849 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:05.747620 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-572939f2-74c3-46f4-9d27-2973fee4f849 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:05.976415 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-572939f2-74c3-46f4-9d27-2973fee4f849 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:05.990736 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-572939f2-74c3-46f4-9d27-2973fee4f849 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:05.992402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-572939f2-74c3-46f4-9d27-2973fee4f849 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:06.001524 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-572939f2-74c3-46f4-9d27-2973fee4f849 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "PUT /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1358 microversion: 2.75 time: 0.265616 Oct 10 18:50:06.003293 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 73/136] 10.222.0.43 () {62 vars in 1297 bytes} [Mon Oct 10 18:50:05 2022] PUT /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:06.007439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5d89a05d-159b-45c9-abff-cc9a254fffb7 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Action: 'update', calling method: .version_select at 0x7f318eadbca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:06.280674 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d89a05d-159b-45c9-abff-cc9a254fffb7 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:06.281298 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d89a05d-159b-45c9-abff-cc9a254fffb7 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:06.281517 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d89a05d-159b-45c9-abff-cc9a254fffb7 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:06.282398 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d89a05d-159b-45c9-abff-cc9a254fffb7 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:06.282947 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d89a05d-159b-45c9-abff-cc9a254fffb7 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:06.283464 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d89a05d-159b-45c9-abff-cc9a254fffb7 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:06.327557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d89a05d-159b-45c9-abff-cc9a254fffb7 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:06.327886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d89a05d-159b-45c9-abff-cc9a254fffb7 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:06.328427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d89a05d-159b-45c9-abff-cc9a254fffb7 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:06.329572 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d89a05d-159b-45c9-abff-cc9a254fffb7 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:06.330238 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d89a05d-159b-45c9-abff-cc9a254fffb7 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:06.330777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d89a05d-159b-45c9-abff-cc9a254fffb7 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:06.425118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3491dc2b-d419-4cb2-929b-247c23e91a46 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:06.446323 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:06.449187 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3491dc2b-d419-4cb2-929b-247c23e91a46 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1492 microversion: 2.1 time: 0.810424 Oct 10 18:50:06.450956 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 64/137] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:05 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1492 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:06.478862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0de1316a-1fe3-4422-9776-5a461fc01ff9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:06.479355 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0de1316a-1fe3-4422-9776-5a461fc01ff9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:06.492839 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0de1316a-1fe3-4422-9776-5a461fc01ff9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:06.493565 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0de1316a-1fe3-4422-9776-5a461fc01ff9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:06.494457 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0de1316a-1fe3-4422-9776-5a461fc01ff9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:06.495476 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0de1316a-1fe3-4422-9776-5a461fc01ff9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:06.496144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0de1316a-1fe3-4422-9776-5a461fc01ff9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:06.496758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0de1316a-1fe3-4422-9776-5a461fc01ff9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:06.565704 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5d89a05d-159b-45c9-abff-cc9a254fffb7 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/0b68d40761ca4e5f8699e77f38ef1952?user_id=3deb4d6e099a4e789efcfa53dd0d209a" status: 200 len: 148 microversion: 2.57 time: 0.562186 Oct 10 18:50:06.572716 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 74/138] 10.222.0.43 () {62 vars in 1384 bytes} [Mon Oct 10 18:50:06 2022] PUT /compute/v2.1/os-quota-sets/0b68d40761ca4e5f8699e77f38ef1952?user_id=3deb4d6e099a4e789efcfa53dd0d209a => generated 148 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:50:06.572716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-225fdbe7-a18e-4ced-85cd-f54e32fc799f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:06.572716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-225fdbe7-a18e-4ced-85cd-f54e32fc799f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:06.632029 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-225fdbe7-a18e-4ced-85cd-f54e32fc799f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:06.640766 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-225fdbe7-a18e-4ced-85cd-f54e32fc799f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:06.642223 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-225fdbe7-a18e-4ced-85cd-f54e32fc799f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:06.647938 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-225fdbe7-a18e-4ced-85cd-f54e32fc799f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1358 microversion: 2.75 time: 0.079888 Oct 10 18:50:06.648992 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 75/139] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:06 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1358 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:06.654738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-39343922-54bc-4452-ba25-ec6d0fa28107 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] Calling method '.version_select at 0x7f318e9a0670>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:06.938694 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-39343922-54bc-4452-ba25-ec6d0fa28107 tempest-QuotasAdminTestV257-1809621651 tempest-QuotasAdminTestV257-1809621651-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/0b68d40761ca4e5f8699e77f38ef1952?user_id=3deb4d6e099a4e789efcfa53dd0d209a" status: 200 len: 190 microversion: 2.57 time: 0.287464 Oct 10 18:50:06.945839 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 76/140] 10.222.0.43 () {60 vars in 1364 bytes} [Mon Oct 10 18:50:06 2022] GET /compute/v2.1/os-quota-sets/0b68d40761ca4e5f8699e77f38ef1952?user_id=3deb4d6e099a4e789efcfa53dd0d209a => generated 190 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:50:06.954475 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cd617664-8ca2-488b-a63d-c877fe174239 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:06.955389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cd617664-8ca2-488b-a63d-c877fe174239 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:06.967715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cd617664-8ca2-488b-a63d-c877fe174239 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:06.968561 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cd617664-8ca2-488b-a63d-c877fe174239 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:06.969557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cd617664-8ca2-488b-a63d-c877fe174239 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:06.970655 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cd617664-8ca2-488b-a63d-c877fe174239 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:06.971908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cd617664-8ca2-488b-a63d-c877fe174239 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:06.973098 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cd617664-8ca2-488b-a63d-c877fe174239 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:07.090513 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cd617664-8ca2-488b-a63d-c877fe174239 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:07.102828 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cd617664-8ca2-488b-a63d-c877fe174239 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1455 microversion: 2.1 time: 0.155548 Oct 10 18:50:07.119677 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 77/141] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:06 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:07.119677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-bc307a5e-944d-4155-a59b-1996d58196ea req-626a176a-7e48-4c06-9fb6-b8c3b630775c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9fa1631-80e1-46e3-80f8-907534151a0c", "name": "network-vif-deleted", "tag": "9add7f12-e83f-426c-b675-ae2a583da350"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:07.162092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-bc307a5e-944d-4155-a59b-1996d58196ea req-626a176a-7e48-4c06-9fb6-b8c3b630775c service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:07.167763 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-bc307a5e-944d-4155-a59b-1996d58196ea req-626a176a-7e48-4c06-9fb6-b8c3b630775c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:07.167763 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-bc307a5e-944d-4155-a59b-1996d58196ea req-626a176a-7e48-4c06-9fb6-b8c3b630775c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:07.168282 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0de1316a-1fe3-4422-9776-5a461fc01ff9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:07.173624 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0de1316a-1fe3-4422-9776-5a461fc01ff9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1389 microversion: 2.1 time: 0.721377 Oct 10 18:50:07.176837 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 65/142] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:06 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1389 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:07.178070 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-bc307a5e-944d-4155-a59b-1996d58196ea req-626a176a-7e48-4c06-9fb6-b8c3b630775c service nova] Creating event network-vif-deleted:9add7f12-e83f-426c-b675-ae2a583da350 for instance d9fa1631-80e1-46e3-80f8-907534151a0c on n-h1-860863-1 Oct 10 18:50:07.183430 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-bc307a5e-944d-4155-a59b-1996d58196ea req-626a176a-7e48-4c06-9fb6-b8c3b630775c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070846 Oct 10 18:50:07.187408 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 78/143] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:07.473897 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-af5d9db3-c16a-4a25-9518-84f7ee7e7da2 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:07.474612 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-af5d9db3-c16a-4a25-9518-84f7ee7e7da2 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:07.495134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-af5d9db3-c16a-4a25-9518-84f7ee7e7da2 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:07.497331 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-af5d9db3-c16a-4a25-9518-84f7ee7e7da2 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:07.508054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-af5d9db3-c16a-4a25-9518-84f7ee7e7da2 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:07.508054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-af5d9db3-c16a-4a25-9518-84f7ee7e7da2 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:07.508054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-af5d9db3-c16a-4a25-9518-84f7ee7e7da2 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:07.508054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-af5d9db3-c16a-4a25-9518-84f7ee7e7da2 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:07.519277 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-796358e4-3d4b-4b68-8fbd-6b75bab65927 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:07.525215 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-796358e4-3d4b-4b68-8fbd-6b75bab65927 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:07.527062 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-796358e4-3d4b-4b68-8fbd-6b75bab65927 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:07.529783 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-796358e4-3d4b-4b68-8fbd-6b75bab65927 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:07.531825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-796358e4-3d4b-4b68-8fbd-6b75bab65927 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:07.534840 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-796358e4-3d4b-4b68-8fbd-6b75bab65927 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:07.535546 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-796358e4-3d4b-4b68-8fbd-6b75bab65927 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:07.665690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-af5d9db3-c16a-4a25-9518-84f7ee7e7da2 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:07.673017 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-796358e4-3d4b-4b68-8fbd-6b75bab65927 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.341613 Oct 10 18:50:07.675209 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-af5d9db3-c16a-4a25-9518-84f7ee7e7da2 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1450 microversion: 2.1 time: 0.205468 Oct 10 18:50:07.676244 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 79/144] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:07 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1450 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:07.677799 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 66/145] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:50:07 2022] GET /compute/v2.1/os-services => generated 965 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:07.696486 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-831e995f-3b29-40e7-ac51-41104fb379ce tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:07.702509 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-831e995f-3b29-40e7-ac51-41104fb379ce tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:07.702983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-831e995f-3b29-40e7-ac51-41104fb379ce tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:07.709386 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-831e995f-3b29-40e7-ac51-41104fb379ce tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:07.710484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f03777c0-1e9e-4f79-9b93-8fbf84e253a7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:07.711489 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-831e995f-3b29-40e7-ac51-41104fb379ce tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:07.711965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-831e995f-3b29-40e7-ac51-41104fb379ce tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:07.712573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-831e995f-3b29-40e7-ac51-41104fb379ce tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:07.713795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f03777c0-1e9e-4f79-9b93-8fbf84e253a7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:07.725968 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f03777c0-1e9e-4f79-9b93-8fbf84e253a7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:07.729681 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f03777c0-1e9e-4f79-9b93-8fbf84e253a7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:07.730466 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f03777c0-1e9e-4f79-9b93-8fbf84e253a7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:07.734309 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f03777c0-1e9e-4f79-9b93-8fbf84e253a7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:07.736647 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f03777c0-1e9e-4f79-9b93-8fbf84e253a7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:07.737307 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f03777c0-1e9e-4f79-9b93-8fbf84e253a7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:07.818259 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-831e995f-3b29-40e7-ac51-41104fb379ce tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=n-d-860863-1" status: 200 len: 578 microversion: 2.1 time: 0.119649 Oct 10 18:50:07.824965 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 67/146] 10.222.0.43 () {58 vars in 1172 bytes} [Mon Oct 10 18:50:07 2022] GET /compute/v2.1/os-services?host=n-d-860863-1 => generated 578 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:07.994688 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f03777c0-1e9e-4f79-9b93-8fbf84e253a7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:08.003800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f03777c0-1e9e-4f79-9b93-8fbf84e253a7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:08.005303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f03777c0-1e9e-4f79-9b93-8fbf84e253a7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:08.010704 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f03777c0-1e9e-4f79-9b93-8fbf84e253a7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1354 microversion: 2.75 time: 0.318275 Oct 10 18:50:08.011305 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 80/147] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:07 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1354 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:08.014278 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-fb1db249-5f33-49b5-9972-ad15f21e8c84 req-8c78a6d2-9eeb-4295-b456-ba7fb774f734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "237bf8ad-542e-4814-a679-25fe8058682d", "tag": "d4082492-8977-4421-932c-18f50547846c"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:08.016575 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0116b7b2-0131-459f-be5e-6a8af1499fa2 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:08.024095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-fb1db249-5f33-49b5-9972-ad15f21e8c84 req-8c78a6d2-9eeb-4295-b456-ba7fb774f734 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:08.026040 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-fb1db249-5f33-49b5-9972-ad15f21e8c84 req-8c78a6d2-9eeb-4295-b456-ba7fb774f734 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:08.026879 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-fb1db249-5f33-49b5-9972-ad15f21e8c84 req-8c78a6d2-9eeb-4295-b456-ba7fb774f734 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:08.028651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0116b7b2-0131-459f-be5e-6a8af1499fa2 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:08.029132 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0116b7b2-0131-459f-be5e-6a8af1499fa2 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:08.030396 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0116b7b2-0131-459f-be5e-6a8af1499fa2 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:08.031436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0116b7b2-0131-459f-be5e-6a8af1499fa2 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:08.044025 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-fb1db249-5f33-49b5-9972-ad15f21e8c84 req-8c78a6d2-9eeb-4295-b456-ba7fb774f734 service nova] Creating event network-changed:d4082492-8977-4421-932c-18f50547846c for instance 237bf8ad-542e-4814-a679-25fe8058682d on n-h2-860863-1 Oct 10 18:50:08.044295 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0116b7b2-0131-459f-be5e-6a8af1499fa2 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:08.044900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0116b7b2-0131-459f-be5e-6a8af1499fa2 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:08.050168 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-fb1db249-5f33-49b5-9972-ad15f21e8c84 req-8c78a6d2-9eeb-4295-b456-ba7fb774f734 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226627 Oct 10 18:50:08.052133 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 68/148] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:50:08.109530 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0116b7b2-0131-459f-be5e-6a8af1499fa2 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 401 microversion: 2.1 time: 0.097001 Oct 10 18:50:08.117572 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 81/149] 10.222.0.43 () {58 vars in 1176 bytes} [Mon Oct 10 18:50:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 401 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:08.126053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e690716d-f7b3-4013-adf8-7cd56e8bb807 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:08.133713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e690716d-f7b3-4013-adf8-7cd56e8bb807 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:08.134205 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e690716d-f7b3-4013-adf8-7cd56e8bb807 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:08.135188 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e690716d-f7b3-4013-adf8-7cd56e8bb807 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:08.138487 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e690716d-f7b3-4013-adf8-7cd56e8bb807 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:08.138960 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e690716d-f7b3-4013-adf8-7cd56e8bb807 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:08.139393 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e690716d-f7b3-4013-adf8-7cd56e8bb807 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:08.142493 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6b0395bc-5784-48c1-bd80-790fd9aa99dc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:08.144026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6b0395bc-5784-48c1-bd80-790fd9aa99dc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:08.167198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b0395bc-5784-48c1-bd80-790fd9aa99dc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:08.167198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b0395bc-5784-48c1-bd80-790fd9aa99dc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:08.167499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b0395bc-5784-48c1-bd80-790fd9aa99dc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:08.168249 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b0395bc-5784-48c1-bd80-790fd9aa99dc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:08.168740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b0395bc-5784-48c1-bd80-790fd9aa99dc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:08.169209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b0395bc-5784-48c1-bd80-790fd9aa99dc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:08.203767 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e690716d-f7b3-4013-adf8-7cd56e8bb807 tempest-ServicesAdminTestJSON-196896704 tempest-ServicesAdminTestJSON-196896704-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.084440 Oct 10 18:50:08.205132 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 69/150] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:50:08 2022] GET /compute/v2.1/os-services => generated 965 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:08.219140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-aec7494a-980a-4b89-b6d0-0d80af460c4f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:08.219903 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-aec7494a-980a-4b89-b6d0-0d80af460c4f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:08.234718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-aec7494a-980a-4b89-b6d0-0d80af460c4f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:08.236608 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-aec7494a-980a-4b89-b6d0-0d80af460c4f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:08.237059 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-aec7494a-980a-4b89-b6d0-0d80af460c4f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:08.240429 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-aec7494a-980a-4b89-b6d0-0d80af460c4f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:08.241538 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-aec7494a-980a-4b89-b6d0-0d80af460c4f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:08.241997 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-aec7494a-980a-4b89-b6d0-0d80af460c4f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:08.246533 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b0395bc-5784-48c1-bd80-790fd9aa99dc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:08.253300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b0395bc-5784-48c1-bd80-790fd9aa99dc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:08.254208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b0395bc-5784-48c1-bd80-790fd9aa99dc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:08.256763 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-6b0395bc-5784-48c1-bd80-790fd9aa99dc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lazy-loading 'fault' on Instance uuid d9fa1631-80e1-46e3-80f8-907534151a0c {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:50:08.415381 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6b0395bc-5784-48c1-bd80-790fd9aa99dc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:08.424483 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6b0395bc-5784-48c1-bd80-790fd9aa99dc tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 200 len: 1331 microversion: 2.1 time: 0.293437 Oct 10 18:50:08.436908 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 82/151] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:08 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 1331 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:08.523571 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-aec7494a-980a-4b89-b6d0-0d80af460c4f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:08.532355 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-aec7494a-980a-4b89-b6d0-0d80af460c4f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1389 microversion: 2.1 time: 0.325227 Oct 10 18:50:08.532963 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 70/152] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:08 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1389 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:08.699086 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7997db33-bf75-483d-8e10-b8a6dfecbc10 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:08.699837 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7997db33-bf75-483d-8e10-b8a6dfecbc10 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:08.710366 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7997db33-bf75-483d-8e10-b8a6dfecbc10 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:08.710817 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7997db33-bf75-483d-8e10-b8a6dfecbc10 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:08.711263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7997db33-bf75-483d-8e10-b8a6dfecbc10 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:08.711976 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7997db33-bf75-483d-8e10-b8a6dfecbc10 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:08.712431 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7997db33-bf75-483d-8e10-b8a6dfecbc10 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:08.712894 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7997db33-bf75-483d-8e10-b8a6dfecbc10 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:08.744998 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7997db33-bf75-483d-8e10-b8a6dfecbc10 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:08.745543 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7997db33-bf75-483d-8e10-b8a6dfecbc10 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:08.745916 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7997db33-bf75-483d-8e10-b8a6dfecbc10 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:08.746367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-7997db33-bf75-483d-8e10-b8a6dfecbc10 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lazy-loading 'fault' on Instance uuid 5603901d-b471-4e23-9f0c-1e62ff4bbd51 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:50:08.793481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7997db33-bf75-483d-8e10-b8a6dfecbc10 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7345b87c6a8d473fb93d50260a147c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5880a8cb15d4be881eebd9d7cf9af3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:08.802004 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7997db33-bf75-483d-8e10-b8a6dfecbc10 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 200 len: 1327 microversion: 2.1 time: 0.106951 Oct 10 18:50:08.813719 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 83/153] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:08 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:09.048979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-54c50522-07ed-47db-9f8c-4d3ef91787f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:09.049601 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-54c50522-07ed-47db-9f8c-4d3ef91787f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:09.062174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-54c50522-07ed-47db-9f8c-4d3ef91787f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:09.062680 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-54c50522-07ed-47db-9f8c-4d3ef91787f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:09.063124 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-54c50522-07ed-47db-9f8c-4d3ef91787f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:09.063853 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-54c50522-07ed-47db-9f8c-4d3ef91787f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:09.064429 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-54c50522-07ed-47db-9f8c-4d3ef91787f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:09.064797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-54c50522-07ed-47db-9f8c-4d3ef91787f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:09.203083 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-11d1ff6d-b3bf-4cf8-b6f0-71bca28a612f req-4490410f-8a00-4f5b-84bd-14daef5289ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5603901d-b471-4e23-9f0c-1e62ff4bbd51", "name": "network-vif-deleted", "tag": "8fbac730-1bb1-4ddf-92da-52bd004324f7"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:09.212663 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-11d1ff6d-b3bf-4cf8-b6f0-71bca28a612f req-4490410f-8a00-4f5b-84bd-14daef5289ac service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:09.213204 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-11d1ff6d-b3bf-4cf8-b6f0-71bca28a612f req-4490410f-8a00-4f5b-84bd-14daef5289ac service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:09.213912 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-11d1ff6d-b3bf-4cf8-b6f0-71bca28a612f req-4490410f-8a00-4f5b-84bd-14daef5289ac service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:09.225765 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-11d1ff6d-b3bf-4cf8-b6f0-71bca28a612f req-4490410f-8a00-4f5b-84bd-14daef5289ac service nova] Creating event network-vif-deleted:8fbac730-1bb1-4ddf-92da-52bd004324f7 for instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 on n-h1-860863-1 Oct 10 18:50:09.242016 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-11d1ff6d-b3bf-4cf8-b6f0-71bca28a612f req-4490410f-8a00-4f5b-84bd-14daef5289ac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043009 Oct 10 18:50:09.245028 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-54c50522-07ed-47db-9f8c-4d3ef91787f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:09.250116 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 84/154] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:50:09.257347 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-54c50522-07ed-47db-9f8c-4d3ef91787f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:09.258810 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-54c50522-07ed-47db-9f8c-4d3ef91787f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:09.280298 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-54c50522-07ed-47db-9f8c-4d3ef91787f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1410 microversion: 2.75 time: 0.237235 Oct 10 18:50:09.280926 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 71/155] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:09 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1410 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:50:09.453803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f5229546-1de6-4319-9669-1f65d9609bd1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:09.454819 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f5229546-1de6-4319-9669-1f65d9609bd1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:09.471789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5229546-1de6-4319-9669-1f65d9609bd1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:09.475531 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5229546-1de6-4319-9669-1f65d9609bd1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:09.476165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5229546-1de6-4319-9669-1f65d9609bd1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:09.477045 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5229546-1de6-4319-9669-1f65d9609bd1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:09.478886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5229546-1de6-4319-9669-1f65d9609bd1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:09.480423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5229546-1de6-4319-9669-1f65d9609bd1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:09.515044 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-f5229546-1de6-4319-9669-1f65d9609bd1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] HTTP exception thrown: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f5229546-1de6-4319-9669-1f65d9609bd1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Request method failure captured: Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c HTTP/1.1 Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk0JnuzvtPAiYB1qYrT7OTm4ss9X-4nZ-pZZpIQOnLeFLX82PDM4AfRZwC4DXf32c9v6BcrO9RzbnLlAFOp4cBEbow-SaTUs2aHqPYBd3m-aebWTBDKhuXNb695bnAlmS9mRCNiFKLZCZ1PyYrhqUpxtm0QuMyggQEDIK-Lzje0hSI Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 3977c93857c3448a9c51227abad2ecfb Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:09.517831 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:09.519104 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3977c93857c3448a9c51227abad2ecfb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3977c93857c3448a9c51227abad2ecfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3977c93857c3448a9c51227abad2ecfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3977c93857c3448a9c51227abad2ecfb"}]}] Oct 10 18:50:09.519104 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:09.519104 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 3977c93857c3448a9c51227abad2ecfb Oct 10 18:50:09.519104 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:09.519104 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-DeleteServersAdminTestJSON-34767308-project Oct 10 18:50:09.519104 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:09.519104 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:09.519104 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 162d1d44a68b4ce69b2eaf4627974335 Oct 10 18:50:09.519104 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-DeleteServersAdminTestJSON-34767308-project Oct 10 18:50:09.519104 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:09.519104 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:09.519104 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'd9fa1631-80e1-46e3-80f8-907534151a0c'} Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:09.519837 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:09.521051 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:09.522280 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f5229546-1de6-4319-9669-1f65d9609bd1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Returning 404 to user: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:09.522280 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f5229546-1de6-4319-9669-1f65d9609bd1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 404 len: 111 microversion: 2.1 time: 0.075806 Oct 10 18:50:09.522280 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 85/156] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:09 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:09.570587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-13fe6eb9-375a-48fc-8db6-2345a935acba tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:09.572765 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-13fe6eb9-375a-48fc-8db6-2345a935acba tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:09.582454 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-13fe6eb9-375a-48fc-8db6-2345a935acba tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:09.583463 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-13fe6eb9-375a-48fc-8db6-2345a935acba tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:09.583908 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-13fe6eb9-375a-48fc-8db6-2345a935acba tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:09.585068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-13fe6eb9-375a-48fc-8db6-2345a935acba tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:09.586339 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-13fe6eb9-375a-48fc-8db6-2345a935acba tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:09.586934 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-13fe6eb9-375a-48fc-8db6-2345a935acba tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:09.703479 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-565838766", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:09.764088 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] validate_networks() for None {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:50:09.768638 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-13fe6eb9-375a-48fc-8db6-2345a935acba tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:09.777199 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-13fe6eb9-375a-48fc-8db6-2345a935acba tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1389 microversion: 2.1 time: 0.225463 Oct 10 18:50:09.777856 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 72/157] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:09 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1389 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:09.826621 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9da7774d-5575-4c83-a68a-364e61389613 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:09.827434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9da7774d-5575-4c83-a68a-364e61389613 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:09.841604 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9da7774d-5575-4c83-a68a-364e61389613 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:09.842329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9da7774d-5575-4c83-a68a-364e61389613 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:09.843789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9da7774d-5575-4c83-a68a-364e61389613 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:09.846256 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9da7774d-5575-4c83-a68a-364e61389613 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:09.846905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9da7774d-5575-4c83-a68a-364e61389613 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:09.852142 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9da7774d-5575-4c83-a68a-364e61389613 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-9da7774d-5575-4c83-a68a-364e61389613 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] HTTP exception thrown: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9da7774d-5575-4c83-a68a-364e61389613 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Request method failure captured: Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 HTTP/1.1 Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGk0YKBy2yGVH_ylhn8JPN2vhefrZrC5KOi7UyuSmEuB_i_5i09oxJfus23t7grk0A-xUChcaR4FVxVI3AX3UKcVudfO8jRd17UKEWAhFfTsE07TrKsUkri0P5ADO5G1mjS8_mdlDNDFA1yVIO48GienbaKupCugtUXND0Y2sm2auVg Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: d5880a8cb15d4be881eebd9d7cf9af3b Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AggregatesAdminTestJSON-831897051 Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:50:09.880312 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:50:09.881767 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d5880a8cb15d4be881eebd9d7cf9af3b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d5880a8cb15d4be881eebd9d7cf9af3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d5880a8cb15d4be881eebd9d7cf9af3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d5880a8cb15d4be881eebd9d7cf9af3b"}]}] Oct 10 18:50:09.881767 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AggregatesAdminTestJSON-831897051 Oct 10 18:50:09.881767 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: d5880a8cb15d4be881eebd9d7cf9af3b Oct 10 18:50:09.881767 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-831897051 Oct 10 18:50:09.881767 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AggregatesAdminTestJSON-831897051-project Oct 10 18:50:09.881767 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:09.881767 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:09.881767 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 7345b87c6a8d473fb93d50260a147c30 Oct 10 18:50:09.881767 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AggregatesAdminTestJSON-831897051-project Oct 10 18:50:09.881767 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:09.881767 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:09.881767 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '5603901d-b471-4e23-9f0c-1e62ff4bbd51'} Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:09.882571 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:09.885058 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:09.887614 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9da7774d-5575-4c83-a68a-364e61389613 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Returning 404 to user: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:09.887614 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9da7774d-5575-4c83-a68a-364e61389613 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 404 len: 111 microversion: 2.1 time: 0.059572 Oct 10 18:50:09.887614 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 73/158] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:09 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 18:50:09.901536 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-37af10cd-8f0b-4745-b5dd-8b11bc9d9424 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860863-1"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:09.941313 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37af10cd-8f0b-4745-b5dd-8b11bc9d9424 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:09.941806 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37af10cd-8f0b-4745-b5dd-8b11bc9d9424 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:09.942245 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37af10cd-8f0b-4745-b5dd-8b11bc9d9424 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:10.099595 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:50:10.100022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:50:10.100512 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:50:10.100956 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:50:10.101364 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:50:10.111928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:10.112415 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:10.112883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:10.113662 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:10.114115 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:10.114745 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:10.136978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Getting quotas for project 3977c93857c3448a9c51227abad2ecfb. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:50:10.142674 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Getting quotas for user 162d1d44a68b4ce69b2eaf4627974335 and project 3977c93857c3448a9c51227abad2ecfb. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:50:10.179143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:50:10.187100 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:50:10.450524 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a8627e4d-cfcf-45b3-a88b-2c599dfbeaa7 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751579 Oct 10 18:50:10.458218 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 86/159] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 18:50:10.466580 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8d049798-9ebe-4d63-a4f6-88bc36d7ed9d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:10.467503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8d049798-9ebe-4d63-a4f6-88bc36d7ed9d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:10.480470 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:10.483604 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d049798-9ebe-4d63-a4f6-88bc36d7ed9d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:10.484360 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d049798-9ebe-4d63-a4f6-88bc36d7ed9d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:10.485087 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d049798-9ebe-4d63-a4f6-88bc36d7ed9d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:10.485996 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d049798-9ebe-4d63-a4f6-88bc36d7ed9d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:10.486660 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d049798-9ebe-4d63-a4f6-88bc36d7ed9d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:10.487290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d049798-9ebe-4d63-a4f6-88bc36d7ed9d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:10.535240 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:10.640383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8d049798-9ebe-4d63-a4f6-88bc36d7ed9d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:10.655311 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8d049798-9ebe-4d63-a4f6-88bc36d7ed9d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:10.657160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8d049798-9ebe-4d63-a4f6-88bc36d7ed9d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:10.664842 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8d049798-9ebe-4d63-a4f6-88bc36d7ed9d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1418 microversion: 2.75 time: 0.204688 Oct 10 18:50:10.665999 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 87/160] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:10 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1418 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:10.670882 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6cb086c8-3b94-43dc-87ac-17d72ebbc87c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:10.671667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6cb086c8-3b94-43dc-87ac-17d72ebbc87c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:10.818043 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6cb086c8-3b94-43dc-87ac-17d72ebbc87c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:10.834489 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6cb086c8-3b94-43dc-87ac-17d72ebbc87c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1219 microversion: 2.1 time: 0.167210 Oct 10 18:50:10.861150 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 88/161] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:10 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1219 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:10.873308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a533249b-5281-434d-8073-01f982d1bbe9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:10.877193 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a533249b-5281-434d-8073-01f982d1bbe9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:10.897055 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a533249b-5281-434d-8073-01f982d1bbe9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:10.899740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a533249b-5281-434d-8073-01f982d1bbe9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:10.904122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a533249b-5281-434d-8073-01f982d1bbe9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:10.905037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a533249b-5281-434d-8073-01f982d1bbe9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:10.914065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a533249b-5281-434d-8073-01f982d1bbe9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:10.915182 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a533249b-5281-434d-8073-01f982d1bbe9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:11.101565 n-d-860863-1 devstack@n-api.service[127289]: WARNING nova.scheduler.client.report [None req-37af10cd-8f0b-4745-b5dd-8b11bc9d9424 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] [req-370161a2-f17c-4146-be88-f2e8cda2c9b1] Failed to update aggregates to [] for resource provider with UUID c47d0229-99f9-4f15-ad3a-3d8663591a85. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Resource provider's generation already changed. Please update the generation and try again. ", "request_id": "req-370161a2-f17c-4146-be88-f2e8cda2c9b1"}]} Oct 10 18:50:11.404068 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-37af10cd-8f0b-4745-b5dd-8b11bc9d9424 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 1.510102 Oct 10 18:50:11.405316 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 74/162] 10.222.0.43 () {60 vars in 1191 bytes} [Mon Oct 10 18:50:09 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:11.420029 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6bb17a8e-e184-45c0-90fe-b464fb00cc47 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:11.455599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a533249b-5281-434d-8073-01f982d1bbe9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:11.479856 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a533249b-5281-434d-8073-01f982d1bbe9 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1389 microversion: 2.1 time: 0.617435 Oct 10 18:50:11.480619 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 89/163] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:10 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1389 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:11.592136 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6bb17a8e-e184-45c0-90fe-b464fb00cc47 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.178626 Oct 10 18:50:11.593549 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 75/164] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:50:11 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:11.609010 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8934848d-6173-4f5c-b430-2628ef80fc5c tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-136561738"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:11.613432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.aggregate [None req-8934848d-6173-4f5c-b430-2628ef80fc5c tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Generated uuid c332154b-05aa-48ec-8df2-0958f6f56d91 for aggregate {{(pid=127288) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:11.697013 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c43b07b6-2394-4e9e-9395-f8dd3487dbb2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:11.697736 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c43b07b6-2394-4e9e-9395-f8dd3487dbb2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:11.713719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c43b07b6-2394-4e9e-9395-f8dd3487dbb2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:11.714385 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c43b07b6-2394-4e9e-9395-f8dd3487dbb2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:11.714954 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c43b07b6-2394-4e9e-9395-f8dd3487dbb2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:11.716342 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c43b07b6-2394-4e9e-9395-f8dd3487dbb2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:11.716991 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c43b07b6-2394-4e9e-9395-f8dd3487dbb2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:11.717547 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c43b07b6-2394-4e9e-9395-f8dd3487dbb2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:11.732688 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8934848d-6173-4f5c-b430-2628ef80fc5c tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.127064 Oct 10 18:50:11.733466 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 90/165] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:11 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:11.746433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0ca305a9-58ed-43bb-bd98-7b4740e366f9 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860863-1"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:11.771881 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ca305a9-58ed-43bb-bd98-7b4740e366f9 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:11.774760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ca305a9-58ed-43bb-bd98-7b4740e366f9 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:11.775638 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ca305a9-58ed-43bb-bd98-7b4740e366f9 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:11.857672 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c43b07b6-2394-4e9e-9395-f8dd3487dbb2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:11.909611 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c43b07b6-2394-4e9e-9395-f8dd3487dbb2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:11.914082 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c43b07b6-2394-4e9e-9395-f8dd3487dbb2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:11.947377 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c43b07b6-2394-4e9e-9395-f8dd3487dbb2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1416 microversion: 2.75 time: 0.254295 Oct 10 18:50:11.948263 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 76/166] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:11 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1416 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:50:11.953824 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-41f984ce-168a-4343-b637-c3519ac4bbc0 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:11.959905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-41f984ce-168a-4343-b637-c3519ac4bbc0 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:11.976170 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41f984ce-168a-4343-b637-c3519ac4bbc0 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:11.976728 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41f984ce-168a-4343-b637-c3519ac4bbc0 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:11.977158 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41f984ce-168a-4343-b637-c3519ac4bbc0 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:11.977925 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41f984ce-168a-4343-b637-c3519ac4bbc0 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:11.978374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41f984ce-168a-4343-b637-c3519ac4bbc0 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:11.978790 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41f984ce-168a-4343-b637-c3519ac4bbc0 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:12.149102 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-41f984ce-168a-4343-b637-c3519ac4bbc0 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:12.161318 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-41f984ce-168a-4343-b637-c3519ac4bbc0 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1244 microversion: 2.1 time: 0.211757 Oct 10 18:50:12.173065 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0ca305a9-58ed-43bb-bd98-7b4740e366f9 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.432079 Oct 10 18:50:12.173998 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 77/167] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:11 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1244 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:12.174285 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 91/168] 10.222.0.43 () {60 vars in 1191 bytes} [Mon Oct 10 18:50:11 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:12.194567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f259b3d3-7501-4c4f-8e06-d23f362a0e2e tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:12.208835 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f259b3d3-7501-4c4f-8e06-d23f362a0e2e tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.018008 Oct 10 18:50:12.211830 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 78/169] 10.222.0.43 () {58 vars in 1149 bytes} [Mon Oct 10 18:50:12 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:12.221535 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5b7f291a-5f60-4558-a1c6-8f1a1152dca4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860863-1"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:12.233236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b7f291a-5f60-4558-a1c6-8f1a1152dca4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:12.233751 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b7f291a-5f60-4558-a1c6-8f1a1152dca4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:12.234356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b7f291a-5f60-4558-a1c6-8f1a1152dca4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:12.514405 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5b7f291a-5f60-4558-a1c6-8f1a1152dca4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.296690 Oct 10 18:50:12.515032 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-172c895f-7707-4871-8c74-05dae195ddb2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:12.516943 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-172c895f-7707-4871-8c74-05dae195ddb2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:12.519725 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 92/170] 10.222.0.43 () {60 vars in 1191 bytes} [Mon Oct 10 18:50:12 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:12.530997 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5fd67ca3-6639-438d-9270-78f38b5ca550 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:12.533112 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-172c895f-7707-4871-8c74-05dae195ddb2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:12.535556 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-172c895f-7707-4871-8c74-05dae195ddb2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:12.536184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-172c895f-7707-4871-8c74-05dae195ddb2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:12.540323 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-172c895f-7707-4871-8c74-05dae195ddb2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:12.541206 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-172c895f-7707-4871-8c74-05dae195ddb2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:12.541906 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-172c895f-7707-4871-8c74-05dae195ddb2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:12.644444 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5fd67ca3-6639-438d-9270-78f38b5ca550 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.117373 Oct 10 18:50:12.645547 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 93/171] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:50:12 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:12.662265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8e31703f-472f-47b5-81f5-f3e249ed5694 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1648100350"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:12.669810 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.aggregate [None req-8e31703f-472f-47b5-81f5-f3e249ed5694 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Generated uuid 370782df-ef67-4751-90a8-5ebf2367ab6f for aggregate {{(pid=127288) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:12.776131 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8e31703f-472f-47b5-81f5-f3e249ed5694 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.119834 Oct 10 18:50:12.777324 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 94/172] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:12.791092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-613485e7-e772-4f2e-8d73-270905b1f900 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860863-1"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:12.813831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-613485e7-e772-4f2e-8d73-270905b1f900 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:12.814322 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-613485e7-e772-4f2e-8d73-270905b1f900 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:12.814744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-613485e7-e772-4f2e-8d73-270905b1f900 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:12.970659 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-172c895f-7707-4871-8c74-05dae195ddb2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:12.978976 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-172c895f-7707-4871-8c74-05dae195ddb2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1389 microversion: 2.1 time: 0.479029 Oct 10 18:50:12.979547 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 79/173] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:12 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1389 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:50:13.000290 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f66125e7-b137-4a0b-82f0-75d59d487f18 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:13.002069 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f66125e7-b137-4a0b-82f0-75d59d487f18 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:13.014269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f66125e7-b137-4a0b-82f0-75d59d487f18 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:13.016468 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f66125e7-b137-4a0b-82f0-75d59d487f18 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:13.017074 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f66125e7-b137-4a0b-82f0-75d59d487f18 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:13.018837 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f66125e7-b137-4a0b-82f0-75d59d487f18 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:13.022636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f66125e7-b137-4a0b-82f0-75d59d487f18 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:13.022636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f66125e7-b137-4a0b-82f0-75d59d487f18 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:13.133659 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f66125e7-b137-4a0b-82f0-75d59d487f18 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:13.143373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f66125e7-b137-4a0b-82f0-75d59d487f18 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:13.145382 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f66125e7-b137-4a0b-82f0-75d59d487f18 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:13.151255 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f66125e7-b137-4a0b-82f0-75d59d487f18 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1416 microversion: 2.75 time: 0.165114 Oct 10 18:50:13.169290 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 80/174] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:12 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1416 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:13.199188 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a531d5a9-3973-4e27-80e2-e6e9ee384200 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:13.199188 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a531d5a9-3973-4e27-80e2-e6e9ee384200 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:13.206793 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a531d5a9-3973-4e27-80e2-e6e9ee384200 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:13.208240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a531d5a9-3973-4e27-80e2-e6e9ee384200 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:13.209061 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a531d5a9-3973-4e27-80e2-e6e9ee384200 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:13.210212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a531d5a9-3973-4e27-80e2-e6e9ee384200 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:13.210904 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a531d5a9-3973-4e27-80e2-e6e9ee384200 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:13.211745 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a531d5a9-3973-4e27-80e2-e6e9ee384200 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:13.225263 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-613485e7-e772-4f2e-8d73-270905b1f900 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.438671 Oct 10 18:50:13.226838 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 95/175] 10.222.0.43 () {60 vars in 1191 bytes} [Mon Oct 10 18:50:12 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:13.238968 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7ff17666-bc17-4972-bc24-f189ab1fc965 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:13.248852 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7ff17666-bc17-4972-bc24-f189ab1fc965 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.013728 Oct 10 18:50:13.255423 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 96/176] 10.222.0.43 () {58 vars in 1143 bytes} [Mon Oct 10 18:50:13 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:13.269064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4bfffc5a-d246-4d09-86b7-1d9184c89e2b tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860863-1"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:13.297171 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4bfffc5a-d246-4d09-86b7-1d9184c89e2b tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:13.298011 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4bfffc5a-d246-4d09-86b7-1d9184c89e2b tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:13.298851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4bfffc5a-d246-4d09-86b7-1d9184c89e2b tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:13.367887 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a531d5a9-3973-4e27-80e2-e6e9ee384200 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:13.378414 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a531d5a9-3973-4e27-80e2-e6e9ee384200 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1279 microversion: 2.1 time: 0.186510 Oct 10 18:50:13.380226 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 81/177] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:13 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:13.765706 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4bfffc5a-d246-4d09-86b7-1d9184c89e2b tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.501594 Oct 10 18:50:13.773695 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 97/178] 10.222.0.43 () {60 vars in 1191 bytes} [Mon Oct 10 18:50:13 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:13.779448 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-079949a4-2004-4f6e-94e4-c10b54e88e49 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:13.901604 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-079949a4-2004-4f6e-94e4-c10b54e88e49 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.126922 Oct 10 18:50:13.902849 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 82/179] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:50:13 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 10 18:50:13.914978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-921464fa-4a32-41a0-8a6c-01d67738dee9 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-837438171"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:13.920735 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.aggregate [None req-921464fa-4a32-41a0-8a6c-01d67738dee9 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Generated uuid fd3dc0c6-84d5-45e2-9945-89116dad09e4 for aggregate {{(pid=127288) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:14.001932 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-e71ddaeb-6a8b-4c55-a398-8fda35a6e6ec req-2ad010e1-0bb3-467c-b9a5-d24f7b3b3de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237bf8ad-542e-4814-a679-25fe8058682d", "name": "network-vif-plugged", "status": "completed", "tag": "d4082492-8977-4421-932c-18f50547846c"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:14.020796 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-921464fa-4a32-41a0-8a6c-01d67738dee9 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.110260 Oct 10 18:50:14.021889 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 98/180] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:13 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:14.035920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1dabfb8f-6591-4a28-8dc3-cc31276b5e91 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:14.039038 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:14.042922 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1dabfb8f-6591-4a28-8dc3-cc31276b5e91 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:14.064129 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e71ddaeb-6a8b-4c55-a398-8fda35a6e6ec req-2ad010e1-0bb3-467c-b9a5-d24f7b3b3de9 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:14.065787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e71ddaeb-6a8b-4c55-a398-8fda35a6e6ec req-2ad010e1-0bb3-467c-b9a5-d24f7b3b3de9 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:14.067412 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e71ddaeb-6a8b-4c55-a398-8fda35a6e6ec req-2ad010e1-0bb3-467c-b9a5-d24f7b3b3de9 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:14.068738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1dabfb8f-6591-4a28-8dc3-cc31276b5e91 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:14.071185 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1dabfb8f-6591-4a28-8dc3-cc31276b5e91 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:14.071697 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1dabfb8f-6591-4a28-8dc3-cc31276b5e91 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:14.075544 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1dabfb8f-6591-4a28-8dc3-cc31276b5e91 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:14.076584 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1dabfb8f-6591-4a28-8dc3-cc31276b5e91 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:14.084190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1dabfb8f-6591-4a28-8dc3-cc31276b5e91 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:14.109044 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-e71ddaeb-6a8b-4c55-a398-8fda35a6e6ec req-2ad010e1-0bb3-467c-b9a5-d24f7b3b3de9 service nova] Creating event network-vif-plugged:d4082492-8977-4421-932c-18f50547846c for instance 237bf8ad-542e-4814-a679-25fe8058682d on n-h2-860863-1 Oct 10 18:50:14.115776 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-e71ddaeb-6a8b-4c55-a398-8fda35a6e6ec req-2ad010e1-0bb3-467c-b9a5-d24f7b3b3de9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124120 Oct 10 18:50:14.116870 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 83/181] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:14.128335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2cf66e67-06b2-46da-9b1d-e6170221c859 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860863-1"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:14.149214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2cf66e67-06b2-46da-9b1d-e6170221c859 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:14.149705 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2cf66e67-06b2-46da-9b1d-e6170221c859 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:14.151699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2cf66e67-06b2-46da-9b1d-e6170221c859 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:14.465724 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1dabfb8f-6591-4a28-8dc3-cc31276b5e91 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:14.481835 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1dabfb8f-6591-4a28-8dc3-cc31276b5e91 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1389 microversion: 2.1 time: 0.451059 Oct 10 18:50:14.482417 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 99/182] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:14 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1389 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:14.490477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a287b660-ae8e-4615-831f-b0e19228d57d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:14.491175 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a287b660-ae8e-4615-831f-b0e19228d57d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:14.505692 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a287b660-ae8e-4615-831f-b0e19228d57d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:14.506189 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a287b660-ae8e-4615-831f-b0e19228d57d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:14.506602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a287b660-ae8e-4615-831f-b0e19228d57d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:14.508058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a287b660-ae8e-4615-831f-b0e19228d57d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:14.509621 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a287b660-ae8e-4615-831f-b0e19228d57d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:14.510199 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a287b660-ae8e-4615-831f-b0e19228d57d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:14.567148 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2cf66e67-06b2-46da-9b1d-e6170221c859 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.448323 Oct 10 18:50:14.568031 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 84/183] 10.222.0.43 () {60 vars in 1191 bytes} [Mon Oct 10 18:50:14 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:14.587907 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2f959e91-47dd-4985-9f83-cfb0ec46d945 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:14.589034 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2f959e91-47dd-4985-9f83-cfb0ec46d945 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:14.601260 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2f959e91-47dd-4985-9f83-cfb0ec46d945 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:14.602202 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2f959e91-47dd-4985-9f83-cfb0ec46d945 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:14.602884 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2f959e91-47dd-4985-9f83-cfb0ec46d945 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:14.603847 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2f959e91-47dd-4985-9f83-cfb0ec46d945 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:14.604620 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2f959e91-47dd-4985-9f83-cfb0ec46d945 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:14.605220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2f959e91-47dd-4985-9f83-cfb0ec46d945 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:14.834388 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a287b660-ae8e-4615-831f-b0e19228d57d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:14.847769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a287b660-ae8e-4615-831f-b0e19228d57d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:14.849354 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a287b660-ae8e-4615-831f-b0e19228d57d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:14.875165 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a287b660-ae8e-4615-831f-b0e19228d57d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1437 microversion: 2.75 time: 0.388046 Oct 10 18:50:14.891418 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 100/184] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:14 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1437 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:14.917204 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fa9dd65b-88a5-42e5-9075-8bd82501241e tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860863-1"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:14.941774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa9dd65b-88a5-42e5-9075-8bd82501241e tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:14.942593 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa9dd65b-88a5-42e5-9075-8bd82501241e tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:14.944073 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa9dd65b-88a5-42e5-9075-8bd82501241e tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:15.211815 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2f959e91-47dd-4985-9f83-cfb0ec46d945 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:15.228758 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2f959e91-47dd-4985-9f83-cfb0ec46d945 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1319 microversion: 2.1 time: 0.659365 Oct 10 18:50:15.229900 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 85/185] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:14 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1319 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:15.240315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:15.243522 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:15.253192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:15.253858 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:15.254471 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:15.255764 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:15.256526 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:15.257214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:15.348415 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fa9dd65b-88a5-42e5-9075-8bd82501241e tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.455617 Oct 10 18:50:15.349237 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 101/186] 10.222.0.43 () {60 vars in 1191 bytes} [Mon Oct 10 18:50:14 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:15.361275 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-77a15dcd-c00d-4ce9-8c1e-3a05254a0571 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:15.369458 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=78 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:15.458239 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:50:15.460457 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:50:15.461652 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:50:15.464475 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:50:15.465504 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:50:15.508845 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-77a15dcd-c00d-4ce9-8c1e-3a05254a0571 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.151127 Oct 10 18:50:15.509880 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 102/187] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:50:15 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:15.521218 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-870de443-3527-4b9d-82d7-b0f54386e66a tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:15.523994 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-870de443-3527-4b9d-82d7-b0f54386e66a tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:15.536392 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-870de443-3527-4b9d-82d7-b0f54386e66a tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:15.538950 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-870de443-3527-4b9d-82d7-b0f54386e66a tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:15.539070 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-870de443-3527-4b9d-82d7-b0f54386e66a tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:15.539796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-870de443-3527-4b9d-82d7-b0f54386e66a tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:15.540612 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-870de443-3527-4b9d-82d7-b0f54386e66a tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:15.541026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-870de443-3527-4b9d-82d7-b0f54386e66a tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:15.757336 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-870de443-3527-4b9d-82d7-b0f54386e66a tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:15.768874 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-870de443-3527-4b9d-82d7-b0f54386e66a tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1389 microversion: 2.1 time: 0.257894 Oct 10 18:50:15.769694 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 103/188] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:15 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1389 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:15.774782 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-953364a8-2627-4e32-b793-11e1ab1a3dff tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-950583472"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:15.779524 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.aggregate [None req-953364a8-2627-4e32-b793-11e1ab1a3dff tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Generated uuid a1491710-a64b-4328-8129-757941c58056 for aggregate {{(pid=127288) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:15.830206 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:15.841562 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:15.842171 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:15.842796 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:15.843971 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:15.845043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:15.845699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:15.890269 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-953364a8-2627-4e32-b793-11e1ab1a3dff tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.119355 Oct 10 18:50:15.892758 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 104/189] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:15 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:15.921166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:15.931178 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:15.934579 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:15.936367 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:15.942152 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2e170d6a-2823-417e-be1d-5d88e5c8cd8a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "POST /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab/action" status: 202 len: 1494 microversion: 2.75 time: 0.711116 Oct 10 18:50:15.943365 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 86/190] 10.222.0.43 () {62 vars in 1319 bytes} [Mon Oct 10 18:50:15 2022] POST /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab/action => generated 1494 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 10 18:50:15.948735 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6cce091f-768e-46ba-9d10-9b380f6f68a3 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-373670134"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:15.953198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.aggregate [None req-6cce091f-768e-46ba-9d10-9b380f6f68a3 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Generated uuid c3a2553f-b375-4832-8e03-1a1496280543 for aggregate {{(pid=127289) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:16.098578 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6cce091f-768e-46ba-9d10-9b380f6f68a3 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.153787 Oct 10 18:50:16.099511 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 87/191] 10.222.0.43 () {62 vars in 1205 bytes} [Mon Oct 10 18:50:15 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:50:16.167769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1095749126", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "bc198aba-4d54-4cd2-9a46-68327b084cae"}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:16.193907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f0439b38-d8b9-4fc3-93be-8070797a0fbf tempest-SecurityGroupsTestAdminJSON-2109297482 tempest-SecurityGroupsTestAdminJSON-2109297482-project] Action: 'create', calling method: .version_select at 0x7f318e9335e0>, body: {"security_group": {"name": "tempest-securitygroup-1996976472", "description": "tempest-description-1557198403"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:16.257496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] validate_networks() for [('bc198aba-4d54-4cd2-9a46-68327b084cae', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:50:16.840947 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:50:16.841369 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:50:16.841844 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:50:16.842248 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:50:16.842653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:50:16.854431 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:16.855155 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:16.855941 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:16.860315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:16.861054 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:16.861673 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:16.869236 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=30 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:16.885667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Getting quotas for project d610c145b1284aa293c1f456bf476602. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:50:16.890527 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Getting quotas for user 831696709a6b473fbd54b99883d38c8d and project d610c145b1284aa293c1f456bf476602. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:50:16.892854 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f0439b38-d8b9-4fc3-93be-8070797a0fbf tempest-SecurityGroupsTestAdminJSON-2109297482 tempest-SecurityGroupsTestAdminJSON-2109297482-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.998785 Oct 10 18:50:16.894643 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 105/192] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:50:15 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:16.900878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f2d17642-5bc0-4c54-aa32-328bee829fef tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:16.909884 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:50:16.913062 n-d-860863-1 devstack@n-api.service[127289]: WARNING nova.utils [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1095749126 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-109574912 Oct 10 18:50:16.913615 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:50:17.054495 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f2d17642-5bc0-4c54-aa32-328bee829fef tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.157259 Oct 10 18:50:17.055040 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 106/193] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:50:16 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:17.084885 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-16bb909c-055b-4f1a-b527-3fc5b7d5fcc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:17.088734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-16bb909c-055b-4f1a-b527-3fc5b7d5fcc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:17.092766 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-23f1be89-37d5-45a3-bb42-6840681201eb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991668 Oct 10 18:50:17.093443 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 88/194] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:50:17.104258 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a45f0a24-43d8-44e0-b4c4-1bbf170196ac tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1155939230"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:17.149792 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16bb909c-055b-4f1a-b527-3fc5b7d5fcc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:17.154292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16bb909c-055b-4f1a-b527-3fc5b7d5fcc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:17.157283 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16bb909c-055b-4f1a-b527-3fc5b7d5fcc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:17.159786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16bb909c-055b-4f1a-b527-3fc5b7d5fcc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:17.160255 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16bb909c-055b-4f1a-b527-3fc5b7d5fcc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:17.162590 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16bb909c-055b-4f1a-b527-3fc5b7d5fcc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:17.333620 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a45f0a24-43d8-44e0-b4c4-1bbf170196ac tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.239072 Oct 10 18:50:17.335545 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 89/195] 10.222.0.43 () {62 vars in 1210 bytes} [Mon Oct 10 18:50:17 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:50:17.347318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8ca9cdb8-f20e-449c-8fd3-23a777127c6b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:17.348493 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8ca9cdb8-f20e-449c-8fd3-23a777127c6b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:17.358381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ca9cdb8-f20e-449c-8fd3-23a777127c6b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:17.359128 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ca9cdb8-f20e-449c-8fd3-23a777127c6b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:17.359900 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ca9cdb8-f20e-449c-8fd3-23a777127c6b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:17.362000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ca9cdb8-f20e-449c-8fd3-23a777127c6b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:17.363333 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ca9cdb8-f20e-449c-8fd3-23a777127c6b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:17.363942 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ca9cdb8-f20e-449c-8fd3-23a777127c6b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:17.582008 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8ca9cdb8-f20e-449c-8fd3-23a777127c6b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:17.593289 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8ca9cdb8-f20e-449c-8fd3-23a777127c6b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1319 microversion: 2.1 time: 0.254497 Oct 10 18:50:17.594233 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 90/196] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:17 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:17.599788 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-6581fe0c-e8ab-4bde-b583-6d8a053d2f99 req-fc492144-db14-417c-9b7d-82d70150a2be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "907f0a12-5167-416e-a0a7-b1e3a398ebe3", "tag": "7fea10e4-e3f5-4276-8a1e-5ec237e34644"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:17.612252 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6581fe0c-e8ab-4bde-b583-6d8a053d2f99 req-fc492144-db14-417c-9b7d-82d70150a2be service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:17.614584 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6581fe0c-e8ab-4bde-b583-6d8a053d2f99 req-fc492144-db14-417c-9b7d-82d70150a2be service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:17.615195 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6581fe0c-e8ab-4bde-b583-6d8a053d2f99 req-fc492144-db14-417c-9b7d-82d70150a2be service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:17.630534 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-6581fe0c-e8ab-4bde-b583-6d8a053d2f99 req-fc492144-db14-417c-9b7d-82d70150a2be service nova] Creating event network-changed:7fea10e4-e3f5-4276-8a1e-5ec237e34644 for instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 on n-h1-860863-1 Oct 10 18:50:17.639723 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-6581fe0c-e8ab-4bde-b583-6d8a053d2f99 req-fc492144-db14-417c-9b7d-82d70150a2be service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043617 Oct 10 18:50:17.643178 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 91/197] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:17.647548 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-050931ce-3e4e-4b8e-970d-1c8ac7b714c5 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:17.648375 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-050931ce-3e4e-4b8e-970d-1c8ac7b714c5 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:17.657799 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-050931ce-3e4e-4b8e-970d-1c8ac7b714c5 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:17.658975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-050931ce-3e4e-4b8e-970d-1c8ac7b714c5 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:17.659491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-050931ce-3e4e-4b8e-970d-1c8ac7b714c5 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:17.660318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-050931ce-3e4e-4b8e-970d-1c8ac7b714c5 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:17.661366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-050931ce-3e4e-4b8e-970d-1c8ac7b714c5 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:17.661835 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-050931ce-3e4e-4b8e-970d-1c8ac7b714c5 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:17.714923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-16bb909c-055b-4f1a-b527-3fc5b7d5fcc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:17.735176 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-16bb909c-055b-4f1a-b527-3fc5b7d5fcc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:17.738943 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-16bb909c-055b-4f1a-b527-3fc5b7d5fcc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:17.752037 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-16bb909c-055b-4f1a-b527-3fc5b7d5fcc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.693443 Oct 10 18:50:17.753096 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 107/198] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:17 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:17.761029 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-553cdc08-a112-4c2b-82f8-8fdc193b0321 tempest-SecurityGroupsTestAdminJSON-2109297482 tempest-SecurityGroupsTestAdminJSON-2109297482-project] Action: 'create', calling method: .version_select at 0x7f318e9c2ca0>, body: {"security_group": {"name": "tempest-securitygroup-1897282834", "description": "tempest-description-1914882818"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:17.851355 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-050931ce-3e4e-4b8e-970d-1c8ac7b714c5 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:17.863002 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-050931ce-3e4e-4b8e-970d-1c8ac7b714c5 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1587 microversion: 2.1 time: 0.220975 Oct 10 18:50:17.863781 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 92/199] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:17 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1587 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:17.868693 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e47f8446-4b1d-4949-9c2a-01c96673f753 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:17.876107 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-e47f8446-4b1d-4949-9c2a-01c96673f753 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e47f8446-4b1d-4949-9c2a-01c96673f753 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Request method failure captured: Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGk3x2Wr3AZQRssWzsHKToO24RvyfBVWC_uJf11ChjRLoi-5bLX6DssHVxyBFowVTnQ-dTB4GiO9p17Bj6_bv-sbgOQYCQdy_NnxULg4nDtCbHdrVLex5v_ozs62zzV_VqQ9E3zMjBhRksacuhwjkh7DbkV6I1PkXq6qAxyYg4um5zU Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 97488a76b1aa4c21a7822a4c68bde09d Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AggregatesAdminTestJSON-788370142 Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:17.878818 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:17.880062 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_97488a76b1aa4c21a7822a4c68bde09d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/97488a76b1aa4c21a7822a4c68bde09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/97488a76b1aa4c21a7822a4c68bde09d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/97488a76b1aa4c21a7822a4c68bde09d"}]}] Oct 10 18:50:17.880062 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AggregatesAdminTestJSON-788370142 Oct 10 18:50:17.880062 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 97488a76b1aa4c21a7822a4c68bde09d Oct 10 18:50:17.880062 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-788370142 Oct 10 18:50:17.880062 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AggregatesAdminTestJSON-788370142-project-admin Oct 10 18:50:17.880062 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:17.880062 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:17.880062 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: b6e7401213474263902bd79f797d1b4f Oct 10 18:50:17.880062 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AggregatesAdminTestJSON-788370142-project-admin Oct 10 18:50:17.880062 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:17.880062 n-d-860863-1 devstack@n-api.service[127289]: exception: Aggregate 5 could not be found. Oct 10 18:50:17.880062 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '5'} Oct 10 18:50:17.880062 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:17.880864 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:17.881937 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e47f8446-4b1d-4949-9c2a-01c96673f753 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:17.883083 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e47f8446-4b1d-4949-9c2a-01c96673f753 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.015489 Oct 10 18:50:17.883083 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 93/200] 10.222.0.43 () {58 vars in 1149 bytes} [Mon Oct 10 18:50:17 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:17.890169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cbd4adbd-6830-4173-afe5-f8048cc8d2cd tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:17.890843 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cbd4adbd-6830-4173-afe5-f8048cc8d2cd tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:17.952699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cbd4adbd-6830-4173-afe5-f8048cc8d2cd tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:17.960062 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cbd4adbd-6830-4173-afe5-f8048cc8d2cd tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1232 microversion: 2.1 time: 0.078230 Oct 10 18:50:17.976922 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 94/201] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:17 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1232 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:17.982261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8f3a5ac4-8bf2-4aa1-ad41-0a7068c02588 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:17.991706 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8f3a5ac4-8bf2-4aa1-ad41-0a7068c02588 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.016814 Oct 10 18:50:17.992279 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 95/202] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Oct 10 18:50:17 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:50:17.999076 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f4fc2b8e-2b15-44b1-aca1-c8e153cbe4c0 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:17.999925 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f4fc2b8e-2b15-44b1-aca1-c8e153cbe4c0 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:18.006221 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4fc2b8e-2b15-44b1-aca1-c8e153cbe4c0 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:18.006713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4fc2b8e-2b15-44b1-aca1-c8e153cbe4c0 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:18.013316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4fc2b8e-2b15-44b1-aca1-c8e153cbe4c0 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:18.013316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4fc2b8e-2b15-44b1-aca1-c8e153cbe4c0 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:18.013316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4fc2b8e-2b15-44b1-aca1-c8e153cbe4c0 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:18.013618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4fc2b8e-2b15-44b1-aca1-c8e153cbe4c0 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:18.092628 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f4fc2b8e-2b15-44b1-aca1-c8e153cbe4c0 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099083 Oct 10 18:50:18.101150 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 96/203] 10.222.0.43 () {58 vars in 1275 bytes} [Mon Oct 10 18:50:17 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:18.106492 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3507044f-1765-4790-8d6d-28667ffbe1d8 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:18.125116 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-3507044f-1765-4790-8d6d-28667ffbe1d8 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3507044f-1765-4790-8d6d-28667ffbe1d8 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Request method failure captured: Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGk3x2Wr3AZQRssWzsHKToO24RvyfBVWC_uJf11ChjRLoi-5bLX6DssHVxyBFowVTnQ-dTB4GiO9p17Bj6_bv-sbgOQYCQdy_NnxULg4nDtCbHdrVLex5v_ozs62zzV_VqQ9E3zMjBhRksacuhwjkh7DbkV6I1PkXq6qAxyYg4um5zU Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 97488a76b1aa4c21a7822a4c68bde09d Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AggregatesAdminTestJSON-788370142 Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:18.128005 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:18.129408 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_97488a76b1aa4c21a7822a4c68bde09d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/97488a76b1aa4c21a7822a4c68bde09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/97488a76b1aa4c21a7822a4c68bde09d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/97488a76b1aa4c21a7822a4c68bde09d"}]}] Oct 10 18:50:18.129408 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AggregatesAdminTestJSON-788370142 Oct 10 18:50:18.129408 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 97488a76b1aa4c21a7822a4c68bde09d Oct 10 18:50:18.129408 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-788370142 Oct 10 18:50:18.129408 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AggregatesAdminTestJSON-788370142-project-admin Oct 10 18:50:18.129408 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:18.129408 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:18.129408 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: b6e7401213474263902bd79f797d1b4f Oct 10 18:50:18.129408 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AggregatesAdminTestJSON-788370142-project-admin Oct 10 18:50:18.129408 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:18.129408 n-d-860863-1 devstack@n-api.service[127289]: exception: Aggregate 5 could not be found. Oct 10 18:50:18.129408 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '5'} Oct 10 18:50:18.129408 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:18.130178 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:18.131262 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:18.132496 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:18.132496 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:18.132496 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:18.132496 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 10 18:50:18.132496 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:18.132496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3507044f-1765-4790-8d6d-28667ffbe1d8 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:18.132496 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3507044f-1765-4790-8d6d-28667ffbe1d8 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.028177 Oct 10 18:50:18.132496 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 97/204] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:50:18 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:18.138970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3fb72bc9-5e81-4c68-9c5d-a37ad9b3ec87 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860863-1"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:18.151984 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fb72bc9-5e81-4c68-9c5d-a37ad9b3ec87 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:18.152872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fb72bc9-5e81-4c68-9c5d-a37ad9b3ec87 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:18.157945 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fb72bc9-5e81-4c68-9c5d-a37ad9b3ec87 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:18.457480 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-553cdc08-a112-4c2b-82f8-8fdc193b0321 tempest-SecurityGroupsTestAdminJSON-2109297482 tempest-SecurityGroupsTestAdminJSON-2109297482-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.703113 Oct 10 18:50:18.468383 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 108/205] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:50:17 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:18.473996 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-95e01e57-5eed-4969-9fc4-1162a77b5dba tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1421958198", "name": "tempest-test_aggregate-1664191608"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:18.504847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.aggregate [None req-95e01e57-5eed-4969-9fc4-1162a77b5dba tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Generated uuid e4acd358-5eab-42b1-ab68-05cd3e1a26c7 for aggregate {{(pid=127288) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:18.533241 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=9 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:18.612569 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3fb72bc9-5e81-4c68-9c5d-a37ad9b3ec87 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.480242 Oct 10 18:50:18.614253 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 98/206] 10.222.0.43 () {62 vars in 1232 bytes} [Mon Oct 10 18:50:18 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:50:18.658510 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-95e01e57-5eed-4969-9fc4-1162a77b5dba tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.188697 Oct 10 18:50:18.659124 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 109/207] 10.222.0.43 () {60 vars in 1165 bytes} [Mon Oct 10 18:50:18 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:18.678188 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-59ca1796-662a-4166-8158-57fcb1ab7c7e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:18.678918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-59ca1796-662a-4166-8158-57fcb1ab7c7e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:18.696186 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59ca1796-662a-4166-8158-57fcb1ab7c7e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:18.696913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59ca1796-662a-4166-8158-57fcb1ab7c7e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:18.702117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59ca1796-662a-4166-8158-57fcb1ab7c7e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:18.703939 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59ca1796-662a-4166-8158-57fcb1ab7c7e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:18.713690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59ca1796-662a-4166-8158-57fcb1ab7c7e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:18.714297 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59ca1796-662a-4166-8158-57fcb1ab7c7e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:18.740180 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dbcfca52-b02c-4586-bf8c-5982b8ad32a7 tempest-SecurityGroupsTestAdminJSON-2096269599 tempest-SecurityGroupsTestAdminJSON-2096269599-project-admin] Action: 'create', calling method: .version_select at 0x7f318ea6e160>, body: {"security_group": {"name": "tempest-securitygroup-1738922898", "description": "tempest-description-1036492853"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:19.126453 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-59ca1796-662a-4166-8158-57fcb1ab7c7e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:19.136085 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-59ca1796-662a-4166-8158-57fcb1ab7c7e tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1319 microversion: 2.1 time: 0.468350 Oct 10 18:50:19.143129 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 110/208] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:18 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:19.153495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2bbb3a37-038f-46a0-bea4-6f0ec199d0b7 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860863-1"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:19.187484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2bbb3a37-038f-46a0-bea4-6f0ec199d0b7 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:19.188076 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2bbb3a37-038f-46a0-bea4-6f0ec199d0b7 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:19.188618 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2bbb3a37-038f-46a0-bea4-6f0ec199d0b7 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:19.580655 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2bbb3a37-038f-46a0-bea4-6f0ec199d0b7 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.435987 Oct 10 18:50:19.583399 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 111/209] 10.222.0.43 () {62 vars in 1232 bytes} [Mon Oct 10 18:50:19 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:50:19.589751 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-03f4db7b-f5ef-4221-812f-4b66b7a3be18 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:19.787419 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-03f4db7b-f5ef-4221-812f-4b66b7a3be18 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.202568 Oct 10 18:50:19.791202 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 112/210] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:50:19 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:19.796858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f0d153f5-1a7c-4be9-af90-ef779507f27c tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:19.802829 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f0d153f5-1a7c-4be9-af90-ef779507f27c tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:19.818712 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0d153f5-1a7c-4be9-af90-ef779507f27c tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:19.822323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0d153f5-1a7c-4be9-af90-ef779507f27c tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:19.826124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0d153f5-1a7c-4be9-af90-ef779507f27c tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:19.827745 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0d153f5-1a7c-4be9-af90-ef779507f27c tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:19.828900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0d153f5-1a7c-4be9-af90-ef779507f27c tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:19.829501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0d153f5-1a7c-4be9-af90-ef779507f27c tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:19.993820 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f0d153f5-1a7c-4be9-af90-ef779507f27c tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:20.011708 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f0d153f5-1a7c-4be9-af90-ef779507f27c tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:20.014071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f0d153f5-1a7c-4be9-af90-ef779507f27c tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:20.046037 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f0d153f5-1a7c-4be9-af90-ef779507f27c tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.253326 Oct 10 18:50:20.047312 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 113/211] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:19 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:20.059500 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-34d55593-530c-4bf7-9303-29bf70bb622b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:20.063844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-34d55593-530c-4bf7-9303-29bf70bb622b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:20.097361 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34d55593-530c-4bf7-9303-29bf70bb622b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:20.099359 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34d55593-530c-4bf7-9303-29bf70bb622b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:20.101756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34d55593-530c-4bf7-9303-29bf70bb622b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:20.102662 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34d55593-530c-4bf7-9303-29bf70bb622b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:20.105071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34d55593-530c-4bf7-9303-29bf70bb622b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:20.106488 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34d55593-530c-4bf7-9303-29bf70bb622b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:20.142715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=25 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:20.328351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-34d55593-530c-4bf7-9303-29bf70bb622b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:20.342266 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-34d55593-530c-4bf7-9303-29bf70bb622b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1284 microversion: 2.1 time: 0.291538 Oct 10 18:50:20.356648 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 114/212] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:20 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1284 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:20.370419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-019283d8-65b3-4a4a-b076-77f0fb126de8 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:20.491328 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-019283d8-65b3-4a4a-b076-77f0fb126de8 tempest-AggregatesAdminTestV241-796511688 tempest-AggregatesAdminTestV241-796511688-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.134253 Oct 10 18:50:20.492088 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 115/213] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Oct 10 18:50:20 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:20.497554 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7beb1659-57e7-4978-b193-0ef3f47ad4f4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:20.516965 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-7beb1659-57e7-4978-b193-0ef3f47ad4f4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7beb1659-57e7-4978-b193-0ef3f47ad4f4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Request method failure captured: Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk3x2Wr3AZQRssWzsHKToO24RvyfBVWC_uJf11ChjRLoi-5bLX6DssHVxyBFowVTnQ-dTB4GiO9p17Bj6_bv-sbgOQYCQdy_NnxULg4nDtCbHdrVLex5v_ozs62zzV_VqQ9E3zMjBhRksacuhwjkh7DbkV6I1PkXq6qAxyYg4um5zU Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 97488a76b1aa4c21a7822a4c68bde09d Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-AggregatesAdminTestJSON-788370142 Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:50:20.522728 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:50:20.524051 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_97488a76b1aa4c21a7822a4c68bde09d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/97488a76b1aa4c21a7822a4c68bde09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/97488a76b1aa4c21a7822a4c68bde09d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/97488a76b1aa4c21a7822a4c68bde09d"}]}] Oct 10 18:50:20.524051 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-AggregatesAdminTestJSON-788370142 Oct 10 18:50:20.524051 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 97488a76b1aa4c21a7822a4c68bde09d Oct 10 18:50:20.524051 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-788370142 Oct 10 18:50:20.524051 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-AggregatesAdminTestJSON-788370142-project-admin Oct 10 18:50:20.524051 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:20.524051 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:20.524051 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: b6e7401213474263902bd79f797d1b4f Oct 10 18:50:20.524051 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-AggregatesAdminTestJSON-788370142-project-admin Oct 10 18:50:20.524051 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:20.524051 n-d-860863-1 devstack@n-api.service[127288]: exception: Aggregate 7 could not be found. Oct 10 18:50:20.524051 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '7'} Oct 10 18:50:20.524051 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:20.525552 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 10 18:50:20.526632 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:20.531327 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7beb1659-57e7-4978-b193-0ef3f47ad4f4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:20.532746 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7beb1659-57e7-4978-b193-0ef3f47ad4f4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.039311 Oct 10 18:50:20.539378 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 116/214] 10.222.0.43 () {58 vars in 1149 bytes} [Mon Oct 10 18:50:20 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:20.546645 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0e50d6b0-3b27-422b-9a25-f037082e6889 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:20.547614 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0e50d6b0-3b27-422b-9a25-f037082e6889 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:20.555469 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e50d6b0-3b27-422b-9a25-f037082e6889 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:20.558003 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e50d6b0-3b27-422b-9a25-f037082e6889 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:20.558668 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e50d6b0-3b27-422b-9a25-f037082e6889 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:20.571793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e50d6b0-3b27-422b-9a25-f037082e6889 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:20.572913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e50d6b0-3b27-422b-9a25-f037082e6889 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:20.574053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e50d6b0-3b27-422b-9a25-f037082e6889 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:20.835262 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=86 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:20.919973 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0e50d6b0-3b27-422b-9a25-f037082e6889 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:21.114074 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dbcfca52-b02c-4586-bf8c-5982b8ad32a7 tempest-SecurityGroupsTestAdminJSON-2096269599 tempest-SecurityGroupsTestAdminJSON-2096269599-project-admin] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 2.302164 Oct 10 18:50:21.114074 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 99/215] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:50:18 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 2312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:21.158561 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0e50d6b0-3b27-422b-9a25-f037082e6889 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1319 microversion: 2.1 time: 0.394040 Oct 10 18:50:21.158561 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 117/216] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:20 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b5b5cc02-c5ff-481e-8bf0-c098a0b2429a tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-b5b5cc02-c5ff-481e-8bf0-c098a0b2429a tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b5b5cc02-c5ff-481e-8bf0-c098a0b2429a tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Request method failure captured: Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGk3x2Wr3AZQRssWzsHKToO24RvyfBVWC_uJf11ChjRLoi-5bLX6DssHVxyBFowVTnQ-dTB4GiO9p17Bj6_bv-sbgOQYCQdy_NnxULg4nDtCbHdrVLex5v_ozs62zzV_VqQ9E3zMjBhRksacuhwjkh7DbkV6I1PkXq6qAxyYg4um5zU Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 97488a76b1aa4c21a7822a4c68bde09d Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AggregatesAdminTestJSON-788370142 Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:21.160298 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:21.163458 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_97488a76b1aa4c21a7822a4c68bde09d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/97488a76b1aa4c21a7822a4c68bde09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/97488a76b1aa4c21a7822a4c68bde09d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/97488a76b1aa4c21a7822a4c68bde09d"}]}] Oct 10 18:50:21.163458 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AggregatesAdminTestJSON-788370142 Oct 10 18:50:21.163458 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 97488a76b1aa4c21a7822a4c68bde09d Oct 10 18:50:21.163458 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-788370142 Oct 10 18:50:21.163458 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AggregatesAdminTestJSON-788370142-project-admin Oct 10 18:50:21.163458 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:21.163458 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:21.163458 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: b6e7401213474263902bd79f797d1b4f Oct 10 18:50:21.163458 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AggregatesAdminTestJSON-788370142-project-admin Oct 10 18:50:21.163458 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:21.163458 n-d-860863-1 devstack@n-api.service[127289]: exception: Aggregate 7 could not be found. Oct 10 18:50:21.163458 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '7'} Oct 10 18:50:21.163458 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:21.165041 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:21.167440 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:21.172930 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:21.172930 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:21.172930 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:21.172930 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 10 18:50:21.172930 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:21.172930 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b5b5cc02-c5ff-481e-8bf0-c098a0b2429a tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:21.172930 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b5b5cc02-c5ff-481e-8bf0-c098a0b2429a tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.023753 Oct 10 18:50:21.172930 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 100/217] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:50:20 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:21.174205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-15b2f1f4-c77f-4f44-8a68-9379c663da97 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:21.174205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-15b2f1f4-c77f-4f44-8a68-9379c663da97 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:21.174205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-15b2f1f4-c77f-4f44-8a68-9379c663da97 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:21.174205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-15b2f1f4-c77f-4f44-8a68-9379c663da97 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:21.175049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-15b2f1f4-c77f-4f44-8a68-9379c663da97 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:21.175049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-15b2f1f4-c77f-4f44-8a68-9379c663da97 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:21.175049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-15b2f1f4-c77f-4f44-8a68-9379c663da97 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:21.175049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-15b2f1f4-c77f-4f44-8a68-9379c663da97 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:21.175815 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-593d32e2-6842-4852-af09-58bcd446d13d tempest-SecurityGroupsTestAdminJSON-2096269599 tempest-SecurityGroupsTestAdminJSON-2096269599-project-admin] Action: 'create', calling method: .version_select at 0x7f318ea4e820>, body: {"security_group": {"name": "tempest-securitygroup-184538300", "description": "tempest-description-68397159"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:21.196066 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-15b2f1f4-c77f-4f44-8a68-9379c663da97 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:21.205365 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-15b2f1f4-c77f-4f44-8a68-9379c663da97 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:21.206804 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-15b2f1f4-c77f-4f44-8a68-9379c663da97 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:21.218688 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-15b2f1f4-c77f-4f44-8a68-9379c663da97 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.143891 Oct 10 18:50:21.219939 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 118/218] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:21 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:21.236067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c51f3391-1253-44c0-bc6b-ff71553804c3 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-373563653"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:21.241967 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.aggregate [None req-c51f3391-1253-44c0-bc6b-ff71553804c3 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Generated uuid 10e3f329-bcf0-4cce-a465-9f4ec435641c for aggregate {{(pid=127288) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:21.391898 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c51f3391-1253-44c0-bc6b-ff71553804c3 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.170846 Oct 10 18:50:21.392846 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 119/219] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:21 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:21.398708 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4349e196-a5f9-4406-b9ac-51e27e96a948 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:21.399650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4349e196-a5f9-4406-b9ac-51e27e96a948 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:21.414443 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4349e196-a5f9-4406-b9ac-51e27e96a948 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:21.416123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4349e196-a5f9-4406-b9ac-51e27e96a948 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:21.420190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4349e196-a5f9-4406-b9ac-51e27e96a948 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:21.421294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4349e196-a5f9-4406-b9ac-51e27e96a948 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:21.422016 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4349e196-a5f9-4406-b9ac-51e27e96a948 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:21.422680 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4349e196-a5f9-4406-b9ac-51e27e96a948 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:21.497334 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4349e196-a5f9-4406-b9ac-51e27e96a948 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:21.506323 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4349e196-a5f9-4406-b9ac-51e27e96a948 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1292 microversion: 2.1 time: 0.112138 Oct 10 18:50:21.507230 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 120/220] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:21 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1292 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:21.527403 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4999aa02-e9fb-4d3f-91c7-1e961af2f716 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:21.535732 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4999aa02-e9fb-4d3f-91c7-1e961af2f716 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.017973 Oct 10 18:50:21.537965 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 121/221] 10.222.0.43 () {58 vars in 1149 bytes} [Mon Oct 10 18:50:21 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:21.547647 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fab895b8-51aa-4c6d-8da0-556325069a93 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:21.547647 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fab895b8-51aa-4c6d-8da0-556325069a93 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:21.549816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fab895b8-51aa-4c6d-8da0-556325069a93 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:21.550405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fab895b8-51aa-4c6d-8da0-556325069a93 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:21.552952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fab895b8-51aa-4c6d-8da0-556325069a93 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:21.553748 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fab895b8-51aa-4c6d-8da0-556325069a93 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:21.554318 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fab895b8-51aa-4c6d-8da0-556325069a93 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:21.554849 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fab895b8-51aa-4c6d-8da0-556325069a93 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:21.760056 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fab895b8-51aa-4c6d-8da0-556325069a93 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:21.772099 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fab895b8-51aa-4c6d-8da0-556325069a93 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 200 len: 1587 microversion: 2.1 time: 0.232849 Oct 10 18:50:21.786492 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 122/222] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:21 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 1587 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:21.803189 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-a327c231-d65a-4f39-b4f2-0408de722529 req-004b72ee-6061-4f78-8b2d-1cad0e3953aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "237bf8ad-542e-4814-a679-25fe8058682d", "tag": "d4082492-8977-4421-932c-18f50547846c"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:21.824065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-a327c231-d65a-4f39-b4f2-0408de722529 req-004b72ee-6061-4f78-8b2d-1cad0e3953aa service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:21.827472 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-a327c231-d65a-4f39-b4f2-0408de722529 req-004b72ee-6061-4f78-8b2d-1cad0e3953aa service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:21.827472 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-a327c231-d65a-4f39-b4f2-0408de722529 req-004b72ee-6061-4f78-8b2d-1cad0e3953aa service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:21.836019 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:21.853899 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-a327c231-d65a-4f39-b4f2-0408de722529 req-004b72ee-6061-4f78-8b2d-1cad0e3953aa service nova] Creating event network-changed:d4082492-8977-4421-932c-18f50547846c for instance 237bf8ad-542e-4814-a679-25fe8058682d on n-h2-860863-1 Oct 10 18:50:21.861442 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-593d32e2-6842-4852-af09-58bcd446d13d tempest-SecurityGroupsTestAdminJSON-2096269599 tempest-SecurityGroupsTestAdminJSON-2096269599-project-admin] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.770066 Oct 10 18:50:21.863394 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-a327c231-d65a-4f39-b4f2-0408de722529 req-004b72ee-6061-4f78-8b2d-1cad0e3953aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070040 Oct 10 18:50:21.866131 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 123/223] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:21.874535 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 101/224] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:50:21 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:21.878181 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-18e907ba-d631-4190-8e44-6aeee44758fc tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:21.879903 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f0170205-e64b-4b73-a293-9153f4dd1e5a tempest-SecurityGroupsTestAdminJSON-2096269599 tempest-SecurityGroupsTestAdminJSON-2096269599-project-admin] Calling method '.version_select at 0x7f318ea6e8b0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:21.977874 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-18e907ba-d631-4190-8e44-6aeee44758fc tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.110140 Oct 10 18:50:21.978494 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 124/225] 10.222.0.43 () {60 vars in 1191 bytes} [Mon Oct 10 18:50:21 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:21.990106 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ba417c64-b86c-4e60-a019-9384ea31d8f4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:22.009309 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ba417c64-b86c-4e60-a019-9384ea31d8f4 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.023045 Oct 10 18:50:22.010379 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 125/226] 10.222.0.43 () {58 vars in 1149 bytes} [Mon Oct 10 18:50:21 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:50:22.022891 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5d662849-044a-4dae-a16e-e9f06c8d776e tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:22.130466 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5d662849-044a-4dae-a16e-e9f06c8d776e tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.111813 Oct 10 18:50:22.131606 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 126/227] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:50:22 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:22.140520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-34aefd85-8425-42a5-b5b1-54c5a764c80d tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:22.143972 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-34aefd85-8425-42a5-b5b1-54c5a764c80d tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:22.159548 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34aefd85-8425-42a5-b5b1-54c5a764c80d tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:22.160056 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34aefd85-8425-42a5-b5b1-54c5a764c80d tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:22.160493 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34aefd85-8425-42a5-b5b1-54c5a764c80d tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:22.161231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34aefd85-8425-42a5-b5b1-54c5a764c80d tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:22.161869 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34aefd85-8425-42a5-b5b1-54c5a764c80d tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:22.162293 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34aefd85-8425-42a5-b5b1-54c5a764c80d tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:22.776393 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-34aefd85-8425-42a5-b5b1-54c5a764c80d tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:22.796943 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-34aefd85-8425-42a5-b5b1-54c5a764c80d tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1319 microversion: 2.1 time: 0.664117 Oct 10 18:50:22.833320 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 127/228] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:22 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1319 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:22.845693 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-28859367-80cf-44fd-aaa0-cc08d0dbc846 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1891167437", "availability_zone": "tempest-test_az-1021333587"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:22.850100 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.aggregate [None req-28859367-80cf-44fd-aaa0-cc08d0dbc846 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Generated uuid ac4f96e8-7d87-48a8-a45c-567c613f5dfd for aggregate {{(pid=127288) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:22.999680 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-28859367-80cf-44fd-aaa0-cc08d0dbc846 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.164612 Oct 10 18:50:23.007526 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 128/229] 10.222.0.43 () {60 vars in 1165 bytes} [Mon Oct 10 18:50:22 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:23.017892 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9e0cebff-b49a-4ad4-9442-a84703e214f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:23.020465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9e0cebff-b49a-4ad4-9442-a84703e214f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:23.042517 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9e0cebff-b49a-4ad4-9442-a84703e214f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:23.048229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9e0cebff-b49a-4ad4-9442-a84703e214f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:23.048954 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9e0cebff-b49a-4ad4-9442-a84703e214f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:23.049724 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9e0cebff-b49a-4ad4-9442-a84703e214f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:23.050323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9e0cebff-b49a-4ad4-9442-a84703e214f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:23.050759 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9e0cebff-b49a-4ad4-9442-a84703e214f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:23.243416 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9e0cebff-b49a-4ad4-9442-a84703e214f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:23.261367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9e0cebff-b49a-4ad4-9442-a84703e214f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:23.263389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9e0cebff-b49a-4ad4-9442-a84703e214f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:23.275249 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9e0cebff-b49a-4ad4-9442-a84703e214f7 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.266135 Oct 10 18:50:23.276128 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 129/230] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:23 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:23.286482 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d0d1fc6d-1cd2-4ae0-a883-f95f3caafa6b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:23.287408 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d0d1fc6d-1cd2-4ae0-a883-f95f3caafa6b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:23.299284 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0d1fc6d-1cd2-4ae0-a883-f95f3caafa6b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:23.299769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0d1fc6d-1cd2-4ae0-a883-f95f3caafa6b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:23.306451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0d1fc6d-1cd2-4ae0-a883-f95f3caafa6b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:23.307759 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0d1fc6d-1cd2-4ae0-a883-f95f3caafa6b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:23.308490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0d1fc6d-1cd2-4ae0-a883-f95f3caafa6b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:23.309733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0d1fc6d-1cd2-4ae0-a883-f95f3caafa6b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:23.898936 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d0d1fc6d-1cd2-4ae0-a883-f95f3caafa6b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:23.917473 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d0d1fc6d-1cd2-4ae0-a883-f95f3caafa6b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1332 microversion: 2.1 time: 0.639671 Oct 10 18:50:23.929609 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 130/231] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:23 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1332 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:23.929609 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5411b5d3-a666-4436-bab5-13affb844668 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1891167437_new", "availability_zone": "tempest-test_az-1021333587_new"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:24.169795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5411b5d3-a666-4436-bab5-13affb844668 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:24.170503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5411b5d3-a666-4436-bab5-13affb844668 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:24.171097 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5411b5d3-a666-4436-bab5-13affb844668 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:24.278676 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5411b5d3-a666-4436-bab5-13affb844668 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.356550 Oct 10 18:50:24.287483 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 131/232] 10.222.0.43 () {60 vars in 1170 bytes} [Mon Oct 10 18:50:23 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:24.297207 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f5d6f09a-ee23-476a-8a0b-dfd717e0b0d1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:24.302880 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f5d6f09a-ee23-476a-8a0b-dfd717e0b0d1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:24.326548 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5d6f09a-ee23-476a-8a0b-dfd717e0b0d1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:24.327079 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5d6f09a-ee23-476a-8a0b-dfd717e0b0d1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:24.327564 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5d6f09a-ee23-476a-8a0b-dfd717e0b0d1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:24.328222 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5d6f09a-ee23-476a-8a0b-dfd717e0b0d1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:24.329204 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5d6f09a-ee23-476a-8a0b-dfd717e0b0d1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:24.329314 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5d6f09a-ee23-476a-8a0b-dfd717e0b0d1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:24.631279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f5d6f09a-ee23-476a-8a0b-dfd717e0b0d1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:24.647468 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f5d6f09a-ee23-476a-8a0b-dfd717e0b0d1 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1319 microversion: 2.1 time: 0.358512 Oct 10 18:50:24.686464 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 132/233] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:24 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:24.700330 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-25968246-a767-42a5-ad9f-db44ce1e8a63 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:24.710932 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-25968246-a767-42a5-ad9f-db44ce1e8a63 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.022424 Oct 10 18:50:24.711814 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 133/234] 10.222.0.43 () {58 vars in 1143 bytes} [Mon Oct 10 18:50:24 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:24.723715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-17e71f00-2157-4782-aeb4-a36edeae2929 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:24.724325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-17e71f00-2157-4782-aeb4-a36edeae2929 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:24.730410 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17e71f00-2157-4782-aeb4-a36edeae2929 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:24.733346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17e71f00-2157-4782-aeb4-a36edeae2929 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:24.735350 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17e71f00-2157-4782-aeb4-a36edeae2929 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:24.736112 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17e71f00-2157-4782-aeb4-a36edeae2929 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:24.736845 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17e71f00-2157-4782-aeb4-a36edeae2929 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:24.738041 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17e71f00-2157-4782-aeb4-a36edeae2929 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:24.845516 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-17e71f00-2157-4782-aeb4-a36edeae2929 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:24.871424 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-17e71f00-2157-4782-aeb4-a36edeae2929 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:24.873547 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-17e71f00-2157-4782-aeb4-a36edeae2929 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:24.879743 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=7,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:24.882947 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-17e71f00-2157-4782-aeb4-a36edeae2929 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.162477 Oct 10 18:50:24.905713 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 134/235] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:24 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:24.937492 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-a54c09a0-e56e-4939-85f6-08183846c327 req-3e02be17-bd66-4b84-8487-7e479e53f0ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a71922-7bbf-4415-b3f5-2c2716b7c7c1", "tag": "c279876a-95a9-436e-bc98-b4a82d21aa0b"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:24.957221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-a54c09a0-e56e-4939-85f6-08183846c327 req-3e02be17-bd66-4b84-8487-7e479e53f0ad service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:24.961372 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-a54c09a0-e56e-4939-85f6-08183846c327 req-3e02be17-bd66-4b84-8487-7e479e53f0ad service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:24.962249 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-a54c09a0-e56e-4939-85f6-08183846c327 req-3e02be17-bd66-4b84-8487-7e479e53f0ad service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:24.977542 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-a54c09a0-e56e-4939-85f6-08183846c327 req-3e02be17-bd66-4b84-8487-7e479e53f0ad service nova] Creating event network-changed:c279876a-95a9-436e-bc98-b4a82d21aa0b for instance f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 on n-h1-860863-1 Oct 10 18:50:24.983075 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-a54c09a0-e56e-4939-85f6-08183846c327 req-3e02be17-bd66-4b84-8487-7e479e53f0ad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090542 Oct 10 18:50:24.984287 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 135/236] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:25.008267 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-02151131-adb9-4a3e-b155-121806d93ccc tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:25.148211 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-02151131-adb9-4a3e-b155-121806d93ccc tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.149175 Oct 10 18:50:25.148558 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 136/237] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:50:24 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:25.171406 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7b495a46-b075-46b1-91d6-09b0e5f3ff57 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:25.172882 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7b495a46-b075-46b1-91d6-09b0e5f3ff57 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:25.201048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b495a46-b075-46b1-91d6-09b0e5f3ff57 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:25.204312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b495a46-b075-46b1-91d6-09b0e5f3ff57 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:25.204312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b495a46-b075-46b1-91d6-09b0e5f3ff57 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:25.212103 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b495a46-b075-46b1-91d6-09b0e5f3ff57 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:25.212620 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b495a46-b075-46b1-91d6-09b0e5f3ff57 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:25.213053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b495a46-b075-46b1-91d6-09b0e5f3ff57 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:25.533833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7b495a46-b075-46b1-91d6-09b0e5f3ff57 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:25.541096 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7b495a46-b075-46b1-91d6-09b0e5f3ff57 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1332 microversion: 2.1 time: 0.382618 Oct 10 18:50:25.544939 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 137/238] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:25 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1332 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:25.570920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-82d7e3d2-4aa4-4d42-b349-5cabce1ac13b tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1145039110"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:25.575457 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.aggregate [None req-82d7e3d2-4aa4-4d42-b349-5cabce1ac13b tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Generated uuid 4adb1b74-3955-496c-92bf-83fef7c969ba for aggregate {{(pid=127288) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:25.648218 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f0170205-e64b-4b73-a293-9153f4dd1e5a tempest-SecurityGroupsTestAdminJSON-2096269599 tempest-SecurityGroupsTestAdminJSON-2096269599-project-admin] 10.222.0.43 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9682 microversion: 2.1 time: 3.772165 Oct 10 18:50:25.650475 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 102/239] 10.222.0.43 () {58 vars in 1191 bytes} [Mon Oct 10 18:50:21 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9682 bytes in 3775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:25.672959 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a368f828-66e2-4285-be44-4a2686c3b1f0 tempest-SecurityGroupsTestAdminJSON-2109297482 tempest-SecurityGroupsTestAdminJSON-2109297482-project] Calling method '.version_select at 0x7f318ea5dc10>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:25.728796 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-82d7e3d2-4aa4-4d42-b349-5cabce1ac13b tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.182733 Oct 10 18:50:25.729723 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 138/240] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:25.734896 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bba7e5cf-d38a-4c48-a0de-d1296f472146 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:25.735499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bba7e5cf-d38a-4c48-a0de-d1296f472146 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:25.744504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bba7e5cf-d38a-4c48-a0de-d1296f472146 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:25.745026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bba7e5cf-d38a-4c48-a0de-d1296f472146 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:25.745455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bba7e5cf-d38a-4c48-a0de-d1296f472146 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:25.746168 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bba7e5cf-d38a-4c48-a0de-d1296f472146 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:25.746684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bba7e5cf-d38a-4c48-a0de-d1296f472146 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:25.747109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bba7e5cf-d38a-4c48-a0de-d1296f472146 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:25.927081 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a368f828-66e2-4285-be44-4a2686c3b1f0 tempest-SecurityGroupsTestAdminJSON-2109297482 tempest-SecurityGroupsTestAdminJSON-2109297482-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.259905 Oct 10 18:50:25.927781 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 103/241] 10.222.0.43 () {58 vars in 1191 bytes} [Mon Oct 10 18:50:25 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:25.935028 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4eb6e53c-7c35-47cd-8b13-0aced8d40372 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:25.956354 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4eb6e53c-7c35-47cd-8b13-0aced8d40372 tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.026556 Oct 10 18:50:25.957122 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 104/242] 10.222.0.43 () {58 vars in 1143 bytes} [Mon Oct 10 18:50:25 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:25.962210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-20d27dd2-1d16-417c-9d90-8b29a5decc02 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:25.962823 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-20d27dd2-1d16-417c-9d90-8b29a5decc02 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:25.968943 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20d27dd2-1d16-417c-9d90-8b29a5decc02 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:25.969420 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20d27dd2-1d16-417c-9d90-8b29a5decc02 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:25.969854 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20d27dd2-1d16-417c-9d90-8b29a5decc02 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:25.970555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20d27dd2-1d16-417c-9d90-8b29a5decc02 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:25.971018 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20d27dd2-1d16-417c-9d90-8b29a5decc02 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:25.971438 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20d27dd2-1d16-417c-9d90-8b29a5decc02 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:25.996995 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bba7e5cf-d38a-4c48-a0de-d1296f472146 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:26.011337 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bba7e5cf-d38a-4c48-a0de-d1296f472146 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1319 microversion: 2.1 time: 0.280539 Oct 10 18:50:26.013215 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 139/243] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:25 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:26.018854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-f43bb206-b114-4bb9-b4b6-5aa95deeda6a req-b55e312d-9c3b-4f79-9a85-4b8029fabd6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907f0a12-5167-416e-a0a7-b1e3a398ebe3", "name": "network-vif-plugged", "status": "completed", "tag": "7fea10e4-e3f5-4276-8a1e-5ec237e34644"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:26.030443 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f43bb206-b114-4bb9-b4b6-5aa95deeda6a req-b55e312d-9c3b-4f79-9a85-4b8029fabd6d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:26.031151 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f43bb206-b114-4bb9-b4b6-5aa95deeda6a req-b55e312d-9c3b-4f79-9a85-4b8029fabd6d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:26.031580 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f43bb206-b114-4bb9-b4b6-5aa95deeda6a req-b55e312d-9c3b-4f79-9a85-4b8029fabd6d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:26.043845 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-f43bb206-b114-4bb9-b4b6-5aa95deeda6a req-b55e312d-9c3b-4f79-9a85-4b8029fabd6d service nova] Creating event network-vif-plugged:7fea10e4-e3f5-4276-8a1e-5ec237e34644 for instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 on n-h1-860863-1 Oct 10 18:50:26.049744 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-f43bb206-b114-4bb9-b4b6-5aa95deeda6a req-b55e312d-9c3b-4f79-9a85-4b8029fabd6d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034893 Oct 10 18:50:26.050577 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 140/244] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:26.063792 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cdf0a1b9-46dd-4dd4-ba24-1d2119d0daf3 tempest-SecurityGroupsTestAdminJSON-2096269599 tempest-SecurityGroupsTestAdminJSON-2096269599-project-admin] Calling method '.version_select at 0x7f318eb83430>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:26.066198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-20d27dd2-1d16-417c-9d90-8b29a5decc02 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:26.079014 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-20d27dd2-1d16-417c-9d90-8b29a5decc02 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:26.080883 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-20d27dd2-1d16-417c-9d90-8b29a5decc02 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:26.085842 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-20d27dd2-1d16-417c-9d90-8b29a5decc02 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.127533 Oct 10 18:50:26.086419 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 105/245] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:25 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:26.298681 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-923199942", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "c5f3fcff-69f9-404c-aeaa-2f1924041f8b"}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:26.313251 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cdf0a1b9-46dd-4dd4-ba24-1d2119d0daf3 tempest-SecurityGroupsTestAdminJSON-2096269599 tempest-SecurityGroupsTestAdminJSON-2096269599-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/c2c06815-4424-44ff-b328-f95147a9da63" status: 202 len: 0 microversion: 2.1 time: 0.259496 Oct 10 18:50:26.313251 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 141/246] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:50:26 2022] DELETE /compute/v2.1/os-security-groups/c2c06815-4424-44ff-b328-f95147a9da63 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:26.322823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-160194fa-2f8a-4da5-9292-3a2a54ed5d9c tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:26.382238 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] validate_networks() for [('c5f3fcff-69f9-404c-aeaa-2f1924041f8b', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:50:26.438123 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-160194fa-2f8a-4da5-9292-3a2a54ed5d9c tempest-AggregatesAdminTestJSON-788370142 tempest-AggregatesAdminTestJSON-788370142-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.119860 Oct 10 18:50:26.444913 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 142/247] 10.222.0.43 () {58 vars in 1155 bytes} [Mon Oct 10 18:50:26 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:26.451398 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-979311da-808c-4d5f-a283-d2bf584e913f tempest-SecurityGroupsTestAdminJSON-2096269599 tempest-SecurityGroupsTestAdminJSON-2096269599-project-admin] Calling method '.version_select at 0x7f318e9a0790>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:26.735678 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-979311da-808c-4d5f-a283-d2bf584e913f tempest-SecurityGroupsTestAdminJSON-2096269599 tempest-SecurityGroupsTestAdminJSON-2096269599-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/42b83257-0fa3-435e-be3a-117845514729" status: 202 len: 0 microversion: 2.1 time: 0.288489 Oct 10 18:50:26.739401 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 143/248] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:50:26 2022] DELETE /compute/v2.1/os-security-groups/42b83257-0fa3-435e-be3a-117845514729 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:26.745468 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9a47f84e-6007-41bb-9ac3-efb9a4474e77 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:26.746347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9a47f84e-6007-41bb-9ac3-efb9a4474e77 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:26.764665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9a47f84e-6007-41bb-9ac3-efb9a4474e77 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:26.764665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9a47f84e-6007-41bb-9ac3-efb9a4474e77 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:26.764665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9a47f84e-6007-41bb-9ac3-efb9a4474e77 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:26.764665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9a47f84e-6007-41bb-9ac3-efb9a4474e77 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:26.765155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9a47f84e-6007-41bb-9ac3-efb9a4474e77 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:26.765155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9a47f84e-6007-41bb-9ac3-efb9a4474e77 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:26.776707 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-9a47f84e-6007-41bb-9ac3-efb9a4474e77 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] HTTP exception thrown: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9a47f84e-6007-41bb-9ac3-efb9a4474e77 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Request method failure captured: Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 HTTP/1.1 Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk0YKBy2yGVH_ylhn8JPN2vhefrZrC5KOi7UyuSmEuB_i_5i09oxJfus23t7grk0A-xUChcaR4FVxVI3AX3UKcVudfO8jRd17UKEWAhFfTsE07TrKsUkri0P5ADO5G1mjS8_mdlDNDFA1yVIO48GienbaKupCugtUXND0Y2sm2auVg Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: d5880a8cb15d4be881eebd9d7cf9af3b Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-AggregatesAdminTestJSON-831897051 Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:26.778919 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:26.780400 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d5880a8cb15d4be881eebd9d7cf9af3b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d5880a8cb15d4be881eebd9d7cf9af3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d5880a8cb15d4be881eebd9d7cf9af3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d5880a8cb15d4be881eebd9d7cf9af3b"}]}] Oct 10 18:50:26.780400 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-AggregatesAdminTestJSON-831897051 Oct 10 18:50:26.780400 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: d5880a8cb15d4be881eebd9d7cf9af3b Oct 10 18:50:26.780400 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-831897051 Oct 10 18:50:26.780400 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-AggregatesAdminTestJSON-831897051-project Oct 10 18:50:26.780400 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:26.780400 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:26.780400 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 7345b87c6a8d473fb93d50260a147c30 Oct 10 18:50:26.780400 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-AggregatesAdminTestJSON-831897051-project Oct 10 18:50:26.780400 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:26.780400 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:26.780400 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '5603901d-b471-4e23-9f0c-1e62ff4bbd51'} Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:26.781288 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:26.782799 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:26.784382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9a47f84e-6007-41bb-9ac3-efb9a4474e77 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Returning 404 to user: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:26.784382 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9a47f84e-6007-41bb-9ac3-efb9a4474e77 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 404 len: 111 microversion: 2.1 time: 0.041453 Oct 10 18:50:26.784382 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 144/249] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:50:26 2022] DELETE /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:26.788630 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0bcd30bc-364e-463b-8d67-d0ca0120f694 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:26.790454 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0bcd30bc-364e-463b-8d67-d0ca0120f694 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:26.795715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0bcd30bc-364e-463b-8d67-d0ca0120f694 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:26.796344 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0bcd30bc-364e-463b-8d67-d0ca0120f694 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:26.796868 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0bcd30bc-364e-463b-8d67-d0ca0120f694 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:26.797567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0bcd30bc-364e-463b-8d67-d0ca0120f694 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:26.798012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0bcd30bc-364e-463b-8d67-d0ca0120f694 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:26.798434 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0bcd30bc-364e-463b-8d67-d0ca0120f694 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:26.954737 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0bcd30bc-364e-463b-8d67-d0ca0120f694 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:26.964400 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0bcd30bc-364e-463b-8d67-d0ca0120f694 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1332 microversion: 2.1 time: 0.179199 Oct 10 18:50:26.980388 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 145/250] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:26 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1332 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:26.987506 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-255a870c-e6b7-4156-b94e-930d34f39e61 tempest-SecurityGroupsTestAdminJSON-2109297482 tempest-SecurityGroupsTestAdminJSON-2109297482-project] Calling method '.version_select at 0x7f318e9c2940>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:27.255190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:50:27.255826 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:50:27.256349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:50:27.257147 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:50:27.257632 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:50:27.267781 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:27.274090 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:27.274090 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:27.274090 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:27.274090 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:27.274527 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:27.294515 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Getting quotas for project 38266e43742d4a9598d44340cac9bf92. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:50:27.299920 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Getting quotas for user fc8eaa5f3d6b44cfaff60781c3381e80 and project 38266e43742d4a9598d44340cac9bf92. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:50:27.317382 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:50:27.326716 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-255a870c-e6b7-4156-b94e-930d34f39e61 tempest-SecurityGroupsTestAdminJSON-2109297482 tempest-SecurityGroupsTestAdminJSON-2109297482-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/85194fe9-88ae-4563-891d-4bb08b58251c" status: 202 len: 0 microversion: 2.1 time: 0.344219 Oct 10 18:50:27.330433 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 146/251] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:50:26 2022] DELETE /compute/v2.1/os-security-groups/85194fe9-88ae-4563-891d-4bb08b58251c => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:27.332204 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:50:27.334034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cb8b0833-4264-4709-90bc-ffe64941a914 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:27.334690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cb8b0833-4264-4709-90bc-ffe64941a914 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] [instance: 5603901d-b471-4e23-9f0c-1e62ff4bbd51] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:27.351343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cb8b0833-4264-4709-90bc-ffe64941a914 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:27.356048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cb8b0833-4264-4709-90bc-ffe64941a914 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:27.356048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cb8b0833-4264-4709-90bc-ffe64941a914 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:27.356048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cb8b0833-4264-4709-90bc-ffe64941a914 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:27.356647 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cb8b0833-4264-4709-90bc-ffe64941a914 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:27.356647 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cb8b0833-4264-4709-90bc-ffe64941a914 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:27.382203 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-cb8b0833-4264-4709-90bc-ffe64941a914 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] HTTP exception thrown: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cb8b0833-4264-4709-90bc-ffe64941a914 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Request method failure captured: Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 HTTP/1.1 Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk0YKBy2yGVH_ylhn8JPN2vhefrZrC5KOi7UyuSmEuB_i_5i09oxJfus23t7grk0A-xUChcaR4FVxVI3AX3UKcVudfO8jRd17UKEWAhFfTsE07TrKsUkri0P5ADO5G1mjS8_mdlDNDFA1yVIO48GienbaKupCugtUXND0Y2sm2auVg Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: d5880a8cb15d4be881eebd9d7cf9af3b Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-AggregatesAdminTestJSON-831897051 Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:27.384441 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:27.385927 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d5880a8cb15d4be881eebd9d7cf9af3b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d5880a8cb15d4be881eebd9d7cf9af3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d5880a8cb15d4be881eebd9d7cf9af3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d5880a8cb15d4be881eebd9d7cf9af3b"}]}] Oct 10 18:50:27.385927 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-AggregatesAdminTestJSON-831897051 Oct 10 18:50:27.385927 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: d5880a8cb15d4be881eebd9d7cf9af3b Oct 10 18:50:27.385927 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-831897051 Oct 10 18:50:27.385927 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-AggregatesAdminTestJSON-831897051-project Oct 10 18:50:27.385927 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:27.385927 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:27.385927 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 7345b87c6a8d473fb93d50260a147c30 Oct 10 18:50:27.385927 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-AggregatesAdminTestJSON-831897051-project Oct 10 18:50:27.385927 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:27.385927 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:27.385927 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '5603901d-b471-4e23-9f0c-1e62ff4bbd51'} Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:27.390145 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. Oct 10 18:50:27.391675 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:27.392818 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cb8b0833-4264-4709-90bc-ffe64941a914 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] Returning 404 to user: Instance 5603901d-b471-4e23-9f0c-1e62ff4bbd51 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:27.392818 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cb8b0833-4264-4709-90bc-ffe64941a914 tempest-AggregatesAdminTestJSON-831897051 tempest-AggregatesAdminTestJSON-831897051-project] 10.222.0.43 "GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51" status: 404 len: 111 microversion: 2.1 time: 0.056558 Oct 10 18:50:27.392818 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 147/252] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:27 2022] GET /compute/v2.1/servers/5603901d-b471-4e23-9f0c-1e62ff4bbd51 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:27.392818 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e4e83b7c-c3cf-4ba1-b2a1-95b30eaacafe tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:27.393085 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e4e83b7c-c3cf-4ba1-b2a1-95b30eaacafe tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:27.399622 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4e83b7c-c3cf-4ba1-b2a1-95b30eaacafe tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:27.400372 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4e83b7c-c3cf-4ba1-b2a1-95b30eaacafe tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:27.400948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4e83b7c-c3cf-4ba1-b2a1-95b30eaacafe tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:27.410776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4e83b7c-c3cf-4ba1-b2a1-95b30eaacafe tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:27.410776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4e83b7c-c3cf-4ba1-b2a1-95b30eaacafe tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:27.410776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4e83b7c-c3cf-4ba1-b2a1-95b30eaacafe tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:27.573821 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c69ff025-5330-4315-be49-eb22e5f03ec7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.486231 Oct 10 18:50:27.575630 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 106/253] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:50:27.592310 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f5f93638-ff44-483f-9c21-09ba3a397b08 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:27.593232 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f5f93638-ff44-483f-9c21-09ba3a397b08 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:27.598682 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:27.600400 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5f93638-ff44-483f-9c21-09ba3a397b08 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:27.601166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5f93638-ff44-483f-9c21-09ba3a397b08 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:27.604783 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5f93638-ff44-483f-9c21-09ba3a397b08 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:27.605844 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5f93638-ff44-483f-9c21-09ba3a397b08 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:27.606486 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5f93638-ff44-483f-9c21-09ba3a397b08 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:27.607071 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5f93638-ff44-483f-9c21-09ba3a397b08 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:27.652982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e4e83b7c-c3cf-4ba1-b2a1-95b30eaacafe tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:27.665736 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e4e83b7c-c3cf-4ba1-b2a1-95b30eaacafe tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1319 microversion: 2.1 time: 0.276981 Oct 10 18:50:27.666338 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 148/254] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:27 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:27.673049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f2e430ae-6806-4a23-b6c4-3c7af92b65f0 tempest-SecurityGroupsTestAdminJSON-2109297482 tempest-SecurityGroupsTestAdminJSON-2109297482-project] Calling method '.version_select at 0x7f318e87e8b0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:27.737631 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f5f93638-ff44-483f-9c21-09ba3a397b08 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:27.745944 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f5f93638-ff44-483f-9c21-09ba3a397b08 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:27.747947 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f5f93638-ff44-483f-9c21-09ba3a397b08 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:27.758890 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f5f93638-ff44-483f-9c21-09ba3a397b08 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.182065 Oct 10 18:50:27.761376 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 107/255] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:27 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:27.769137 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-65f28e3c-a83e-4ee6-94a0-8cb9ab06fba7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:27.773993 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-65f28e3c-a83e-4ee6-94a0-8cb9ab06fba7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:27.845706 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-65f28e3c-a83e-4ee6-94a0-8cb9ab06fba7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:27.853652 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-65f28e3c-a83e-4ee6-94a0-8cb9ab06fba7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1223 microversion: 2.1 time: 0.089095 Oct 10 18:50:27.860716 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 108/256] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:27 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:28.041111 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f2e430ae-6806-4a23-b6c4-3c7af92b65f0 tempest-SecurityGroupsTestAdminJSON-2109297482 tempest-SecurityGroupsTestAdminJSON-2109297482-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/e2eee828-75b6-45f5-8252-49c792ebdb77" status: 202 len: 0 microversion: 2.1 time: 0.373717 Oct 10 18:50:28.041877 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 149/257] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:50:27 2022] DELETE /compute/v2.1/os-security-groups/e2eee828-75b6-45f5-8252-49c792ebdb77 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:28.052561 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-df8abf28-1b01-4347-aca1-6e58a512effe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:28.053420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-df8abf28-1b01-4347-aca1-6e58a512effe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:28.064320 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df8abf28-1b01-4347-aca1-6e58a512effe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:28.065130 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df8abf28-1b01-4347-aca1-6e58a512effe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:28.066506 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df8abf28-1b01-4347-aca1-6e58a512effe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:28.068091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df8abf28-1b01-4347-aca1-6e58a512effe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:28.069907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df8abf28-1b01-4347-aca1-6e58a512effe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:28.074093 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df8abf28-1b01-4347-aca1-6e58a512effe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:28.196518 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5c9c45d6-40d2-4ccd-930f-5d8da4b666be tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:28.200585 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c9c45d6-40d2-4ccd-930f-5d8da4b666be tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:28.201060 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c9c45d6-40d2-4ccd-930f-5d8da4b666be tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:28.201489 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c9c45d6-40d2-4ccd-930f-5d8da4b666be tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:28.202214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c9c45d6-40d2-4ccd-930f-5d8da4b666be tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:28.202667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c9c45d6-40d2-4ccd-930f-5d8da4b666be tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:28.203080 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c9c45d6-40d2-4ccd-930f-5d8da4b666be tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:28.234256 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5c9c45d6-40d2-4ccd-930f-5d8da4b666be tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.376909 Oct 10 18:50:28.245492 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 109/258] 10.222.0.43 () {58 vars in 1176 bytes} [Mon Oct 10 18:50:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:28.256116 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f28bd11a-d5a0-44ff-a3e5-b0cce50b9b68 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1087025764"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:28.258436 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.aggregate [None req-f28bd11a-d5a0-44ff-a3e5-b0cce50b9b68 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Generated uuid 720263c6-b2af-445d-97bd-eea5501963a2 for aggregate {{(pid=127289) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:28.324389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-df8abf28-1b01-4347-aca1-6e58a512effe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:28.333204 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-df8abf28-1b01-4347-aca1-6e58a512effe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1332 microversion: 2.1 time: 0.288971 Oct 10 18:50:28.334108 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 150/259] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:28 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1332 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:28.376995 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f28bd11a-d5a0-44ff-a3e5-b0cce50b9b68 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.128227 Oct 10 18:50:28.377584 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 110/260] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:28.389373 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3152262a-5471-4096-a7a8-e1c01c596f43 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860863-1"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:28.403371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3152262a-5471-4096-a7a8-e1c01c596f43 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:28.404142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3152262a-5471-4096-a7a8-e1c01c596f43 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:28.404805 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3152262a-5471-4096-a7a8-e1c01c596f43 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:28.690512 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c3a1dc08-d20c-4838-9359-57deab9d75a9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:28.691509 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c3a1dc08-d20c-4838-9359-57deab9d75a9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:28.706373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c3a1dc08-d20c-4838-9359-57deab9d75a9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:28.706869 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c3a1dc08-d20c-4838-9359-57deab9d75a9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:28.711150 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c3a1dc08-d20c-4838-9359-57deab9d75a9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:28.712866 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c3a1dc08-d20c-4838-9359-57deab9d75a9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:28.713805 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c3a1dc08-d20c-4838-9359-57deab9d75a9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:28.714243 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c3a1dc08-d20c-4838-9359-57deab9d75a9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:28.786637 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3152262a-5471-4096-a7a8-e1c01c596f43 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.401628 Oct 10 18:50:28.795658 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 151/261] 10.222.0.43 () {60 vars in 1194 bytes} [Mon Oct 10 18:50:28 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:28.795658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a17c5d31-bff0-46f5-b196-9077f96ed37d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:28.795658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a17c5d31-bff0-46f5-b196-9077f96ed37d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:28.801292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a17c5d31-bff0-46f5-b196-9077f96ed37d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:28.801934 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a17c5d31-bff0-46f5-b196-9077f96ed37d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:28.802525 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a17c5d31-bff0-46f5-b196-9077f96ed37d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:28.803393 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a17c5d31-bff0-46f5-b196-9077f96ed37d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:28.803832 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a17c5d31-bff0-46f5-b196-9077f96ed37d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:28.804285 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a17c5d31-bff0-46f5-b196-9077f96ed37d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:28.897960 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a17c5d31-bff0-46f5-b196-9077f96ed37d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:28.907428 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c3a1dc08-d20c-4838-9359-57deab9d75a9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:28.915972 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c3a1dc08-d20c-4838-9359-57deab9d75a9 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1469 microversion: 2.1 time: 0.230523 Oct 10 18:50:28.916941 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 111/262] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:28 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1469 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:28.920345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a17c5d31-bff0-46f5-b196-9077f96ed37d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:28.921908 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-17da5242-dbdf-4ff5-8890-4babf3bea47e tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860863-1"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:28.922386 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a17c5d31-bff0-46f5-b196-9077f96ed37d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:28.928924 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a17c5d31-bff0-46f5-b196-9077f96ed37d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.140497 Oct 10 18:50:28.940742 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-17da5242-dbdf-4ff5-8890-4babf3bea47e tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:28.944813 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 152/263] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:28 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:28.944932 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-17da5242-dbdf-4ff5-8890-4babf3bea47e tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:28.944932 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-17da5242-dbdf-4ff5-8890-4babf3bea47e tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:28.958235 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-97ee764f-f6f5-42b9-ba8a-00bb9e2de9be tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:28.959716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-97ee764f-f6f5-42b9-ba8a-00bb9e2de9be tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:29.012946 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-17da5242-dbdf-4ff5-8890-4babf3bea47e tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-860863-1. Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-17da5242-dbdf-4ff5-8890-4babf3bea47e tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Request method failure captured: Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 39 Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGlzaPkzK5Mr8I5docnPV4VRzFHrZo7N5B5xPZVL5DsSrEluCtFgaqop38luuVUROH0YVEREG99xts7mklwUR03iuaeLus2zlx48JNdjv_jwHQ8V6blKk71OGUAKmQtQ9YGl2-3OvMFtEnqk9iuW9bpViYVUNecW9uqNX2_ivqZTvi8 Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:29.032849 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:29.034390 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_80c5e4b04132467881a6745148f41dfe", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}] Oct 10 18:50:29.034390 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:29.034390 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:29.034390 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:29.034390 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:29.034390 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:29.034390 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:29.034390 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 693ec289ca374d2aa3392f8a6949c0b5 Oct 10 18:50:29.034390 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:29.034390 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:50:29.034390 n-d-860863-1 devstack@n-api.service[127289]: {"add_host": {"host": "n-h1-860863-1"}} Oct 10 18:50:29.034390 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:29.034390 n-d-860863-1 devstack@n-api.service[127289]: exception: Aggregate 11 already has host n-h1-860863-1. Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-860863-1'}}} Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result.read() Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 18:50:29.035708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-860863-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi session.flush() Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 18:50:29.037566 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 18:50:29.038904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 18:50:29.040488 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result.read() Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-860863-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 10, 18, 50, 28, 967997), 'updated_at': None, 'host': 'n-h1-860863-1', 'aggregate_id': 11}] Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:29.041807 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-860863-1. Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:29.059655 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-860863-1. Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:29.067376 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:29.069307 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-860863-1. Oct 10 18:50:29.069307 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:29.069579 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-97ee764f-f6f5-42b9-ba8a-00bb9e2de9be tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:29.069579 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-97ee764f-f6f5-42b9-ba8a-00bb9e2de9be tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1223 microversion: 2.1 time: 0.099222 Oct 10 18:50:29.069579 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 153/264] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:28 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:29.069579 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3aaaaf86-3658-48ed-8ccf-e4fc5704f945 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:29.070060 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3aaaaf86-3658-48ed-8ccf-e4fc5704f945 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:29.070190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-17da5242-dbdf-4ff5-8890-4babf3bea47e tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-860863-1. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:29.070190 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-17da5242-dbdf-4ff5-8890-4babf3bea47e tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.144403 Oct 10 18:50:29.070190 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 112/265] 10.222.0.43 () {60 vars in 1194 bytes} [Mon Oct 10 18:50:28 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 10 18:50:29.070557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3aaaaf86-3658-48ed-8ccf-e4fc5704f945 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:29.070557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3aaaaf86-3658-48ed-8ccf-e4fc5704f945 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:29.070557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3aaaaf86-3658-48ed-8ccf-e4fc5704f945 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:29.070557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3aaaaf86-3658-48ed-8ccf-e4fc5704f945 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:29.071067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3aaaaf86-3658-48ed-8ccf-e4fc5704f945 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:29.071067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3aaaaf86-3658-48ed-8ccf-e4fc5704f945 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:29.077811 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7dfe4aaf-452c-4691-a343-476ae0ccc9f6 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860863-1"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:29.098220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7dfe4aaf-452c-4691-a343-476ae0ccc9f6 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:29.098220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7dfe4aaf-452c-4691-a343-476ae0ccc9f6 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:29.098220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7dfe4aaf-452c-4691-a343-476ae0ccc9f6 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:29.438953 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3aaaaf86-3658-48ed-8ccf-e4fc5704f945 tempest-DeleteServersAdminTestJSON-1332338326 tempest-DeleteServersAdminTestJSON-1332338326-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3/action" status: 202 len: 0 microversion: 2.1 time: 0.388964 Oct 10 18:50:29.442282 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 154/266] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:50:29 2022] POST /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:29.444914 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c4a91be4-90d4-42fb-a8a6-a9124014fb0c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:29.445706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c4a91be4-90d4-42fb-a8a6-a9124014fb0c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:29.454522 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4a91be4-90d4-42fb-a8a6-a9124014fb0c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:29.455244 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4a91be4-90d4-42fb-a8a6-a9124014fb0c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:29.455670 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4a91be4-90d4-42fb-a8a6-a9124014fb0c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:29.456386 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4a91be4-90d4-42fb-a8a6-a9124014fb0c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:29.456864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4a91be4-90d4-42fb-a8a6-a9124014fb0c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:29.457277 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4a91be4-90d4-42fb-a8a6-a9124014fb0c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:29.483881 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:29.542281 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7dfe4aaf-452c-4691-a343-476ae0ccc9f6 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.469307 Oct 10 18:50:29.551715 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 113/267] 10.222.0.43 () {60 vars in 1194 bytes} [Mon Oct 10 18:50:29 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:29.557822 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c9807170-62e4-493d-9054-9c1aca3b4b38 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:29.558556 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c9807170-62e4-493d-9054-9c1aca3b4b38 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:29.593990 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9807170-62e4-493d-9054-9c1aca3b4b38 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:29.594525 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9807170-62e4-493d-9054-9c1aca3b4b38 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:29.596380 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9807170-62e4-493d-9054-9c1aca3b4b38 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:29.598565 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9807170-62e4-493d-9054-9c1aca3b4b38 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:29.599379 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9807170-62e4-493d-9054-9c1aca3b4b38 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:29.605276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9807170-62e4-493d-9054-9c1aca3b4b38 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:29.706093 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9807170-62e4-493d-9054-9c1aca3b4b38 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:29.706899 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9807170-62e4-493d-9054-9c1aca3b4b38 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:29.710922 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9807170-62e4-493d-9054-9c1aca3b4b38 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:29.710922 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-c9807170-62e4-493d-9054-9c1aca3b4b38 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lazy-loading 'fault' on Instance uuid 907f0a12-5167-416e-a0a7-b1e3a398ebe3 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:50:29.719301 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c4a91be4-90d4-42fb-a8a6-a9124014fb0c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:29.729790 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c4a91be4-90d4-42fb-a8a6-a9124014fb0c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1332 microversion: 2.1 time: 0.288990 Oct 10 18:50:29.732462 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 155/268] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:29 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1332 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:29.742322 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f339cfeb-7df1-4edb-850e-f0a45f7592d7 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:29.892229 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f339cfeb-7df1-4edb-850e-f0a45f7592d7 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.152485 Oct 10 18:50:29.892229 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 156/269] 10.222.0.43 () {58 vars in 1155 bytes} [Mon Oct 10 18:50:29 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:29.898150 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-529541ea-c021-4976-9926-a7cfc7a060b2 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-6981189"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:29.906686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.aggregate [None req-529541ea-c021-4976-9926-a7cfc7a060b2 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Generated uuid 74344a3f-4f76-41c6-9dae-25fb02848b2f for aggregate {{(pid=127288) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:29.936310 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c9807170-62e4-493d-9054-9c1aca3b4b38 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:29.945109 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c9807170-62e4-493d-9054-9c1aca3b4b38 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1452 microversion: 2.1 time: 0.397408 Oct 10 18:50:29.946173 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 114/270] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:29 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1452 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:29.960866 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8120a6bb-eff5-4ee1-a622-bb5a22977df5 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:29.961862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8120a6bb-eff5-4ee1-a622-bb5a22977df5 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:29.968749 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8120a6bb-eff5-4ee1-a622-bb5a22977df5 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:29.969496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8120a6bb-eff5-4ee1-a622-bb5a22977df5 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:29.970384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8120a6bb-eff5-4ee1-a622-bb5a22977df5 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:29.971093 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8120a6bb-eff5-4ee1-a622-bb5a22977df5 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:29.971696 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8120a6bb-eff5-4ee1-a622-bb5a22977df5 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:29.972119 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8120a6bb-eff5-4ee1-a622-bb5a22977df5 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:30.026822 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-529541ea-c021-4976-9926-a7cfc7a060b2 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.132621 Oct 10 18:50:30.028556 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 157/271] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:29 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:50:30.034173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-431de87f-8e8c-4300-9193-0661b0df59f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:30.035456 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-431de87f-8e8c-4300-9193-0661b0df59f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:30.046167 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8120a6bb-eff5-4ee1-a622-bb5a22977df5 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:30.058613 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8120a6bb-eff5-4ee1-a622-bb5a22977df5 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:30.061273 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8120a6bb-eff5-4ee1-a622-bb5a22977df5 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:30.064009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-431de87f-8e8c-4300-9193-0661b0df59f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:30.067684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-431de87f-8e8c-4300-9193-0661b0df59f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:30.068147 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-431de87f-8e8c-4300-9193-0661b0df59f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:30.068709 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8120a6bb-eff5-4ee1-a622-bb5a22977df5 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.111252 Oct 10 18:50:30.068906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-431de87f-8e8c-4300-9193-0661b0df59f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:30.069982 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 115/272] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:29 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:50:30.070588 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-431de87f-8e8c-4300-9193-0661b0df59f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:30.071032 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-431de87f-8e8c-4300-9193-0661b0df59f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:30.113143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-431de87f-8e8c-4300-9193-0661b0df59f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:50:30.443459 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-431de87f-8e8c-4300-9193-0661b0df59f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "DELETE /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 204 len: 0 microversion: 2.1 time: 0.413364 Oct 10 18:50:30.444130 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 158/273] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:50:30 2022] DELETE /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:50:30.449776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5bb49e7f-be34-4272-a794-7b7b2314d9fd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:30.450673 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5bb49e7f-be34-4272-a794-7b7b2314d9fd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:30.458615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5bb49e7f-be34-4272-a794-7b7b2314d9fd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:30.459343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5bb49e7f-be34-4272-a794-7b7b2314d9fd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:30.459769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5bb49e7f-be34-4272-a794-7b7b2314d9fd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:30.460584 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5bb49e7f-be34-4272-a794-7b7b2314d9fd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:30.461205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5bb49e7f-be34-4272-a794-7b7b2314d9fd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:30.462135 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5bb49e7f-be34-4272-a794-7b7b2314d9fd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:30.540018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5bb49e7f-be34-4272-a794-7b7b2314d9fd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:30.550219 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5bb49e7f-be34-4272-a794-7b7b2314d9fd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1275 microversion: 2.1 time: 0.104781 Oct 10 18:50:30.555467 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 159/274] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:30 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:30.560320 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0989fe44-3c7c-42c9-b3ee-fa88cfa8b02c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:30.565122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0989fe44-3c7c-42c9-b3ee-fa88cfa8b02c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:30.571795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0989fe44-3c7c-42c9-b3ee-fa88cfa8b02c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:30.572348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0989fe44-3c7c-42c9-b3ee-fa88cfa8b02c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:30.572809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0989fe44-3c7c-42c9-b3ee-fa88cfa8b02c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:30.573515 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0989fe44-3c7c-42c9-b3ee-fa88cfa8b02c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:30.573970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0989fe44-3c7c-42c9-b3ee-fa88cfa8b02c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:30.574428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0989fe44-3c7c-42c9-b3ee-fa88cfa8b02c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:30.597731 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7dd30472-fe23-47c5-a722-1627371b6e38 tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860863-1"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:30.603986 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7dd30472-fe23-47c5-a722-1627371b6e38 tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '576855fe48f74531a26424c0046fbe7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264987dfb7ae43f1aaa08c6688cc7c12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7dd30472-fe23-47c5-a722-1627371b6e38 tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Request method failure captured: Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 39 Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGly3zrIce5yvcnOcOgNmRWNaxsadNr15u-O-8xMehhBLJXonIrWZg51Aa0zIzy5p77B-18ku-Plknp9aFkDfHsTPki84I_zxArnsU5RoBVISXSwCv02abklWVpZfZy5ujax7tOZokxmtrebqi1-Y91UQuJDX7lBZiHY2nzWyChSRl4 Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 264987dfb7ae43f1aaa08c6688cc7c12 Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:50:30.608058 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:50:30.609714 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_264987dfb7ae43f1aaa08c6688cc7c12", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/264987dfb7ae43f1aaa08c6688cc7c12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/264987dfb7ae43f1aaa08c6688cc7c12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/264987dfb7ae43f1aaa08c6688cc7c12"}]}] Oct 10 18:50:30.609714 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:30.609714 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 264987dfb7ae43f1aaa08c6688cc7c12 Oct 10 18:50:30.609714 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:30.609714 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AggregatesAdminNegativeTestJSON-1007197959-project Oct 10 18:50:30.609714 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:30.609714 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:30.609714 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 576855fe48f74531a26424c0046fbe7e Oct 10 18:50:30.609714 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959-project Oct 10 18:50:30.609714 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:50:30.609714 n-d-860863-1 devstack@n-api.service[127289]: {"add_host": {"host": "n-h1-860863-1"}} Oct 10 18:50:30.609714 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:30.609714 n-d-860863-1 devstack@n-api.service[127289]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-860863-1'}}} Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:30.610645 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 10 18:50:30.612337 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:30.618459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7dd30472-fe23-47c5-a722-1627371b6e38 tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:30.618459 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7dd30472-fe23-47c5-a722-1627371b6e38 tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.542760 Oct 10 18:50:30.618459 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 116/275] 10.222.0.43 () {60 vars in 1194 bytes} [Mon Oct 10 18:50:30 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 544 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:30.632417 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0989fe44-3c7c-42c9-b3ee-fa88cfa8b02c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:30.633121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0989fe44-3c7c-42c9-b3ee-fa88cfa8b02c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:30.633556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0989fe44-3c7c-42c9-b3ee-fa88cfa8b02c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:30.634013 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-0989fe44-3c7c-42c9-b3ee-fa88cfa8b02c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lazy-loading 'fault' on Instance uuid 907f0a12-5167-416e-a0a7-b1e3a398ebe3 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:50:30.637783 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-30d1d3ef-ae16-4017-9114-445ae703be9f tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:30.769011 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-30d1d3ef-ae16-4017-9114-445ae703be9f tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.149019 Oct 10 18:50:30.774816 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 117/276] 10.222.0.43 () {58 vars in 1155 bytes} [Mon Oct 10 18:50:30 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:30.781080 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-41d1b3ae-3c43-4530-babb-5c8023d425a2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:30.782037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-41d1b3ae-3c43-4530-babb-5c8023d425a2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:30.799244 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41d1b3ae-3c43-4530-babb-5c8023d425a2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:30.800189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41d1b3ae-3c43-4530-babb-5c8023d425a2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:30.800911 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41d1b3ae-3c43-4530-babb-5c8023d425a2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:30.803209 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41d1b3ae-3c43-4530-babb-5c8023d425a2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:30.803923 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41d1b3ae-3c43-4530-babb-5c8023d425a2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:30.804659 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41d1b3ae-3c43-4530-babb-5c8023d425a2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:30.967715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0989fe44-3c7c-42c9-b3ee-fa88cfa8b02c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:30.976432 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0989fe44-3c7c-42c9-b3ee-fa88cfa8b02c tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1458 microversion: 2.1 time: 0.419840 Oct 10 18:50:30.979768 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 160/277] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:30 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1458 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:30.986918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c8880034-ea50-434c-af27-f4058e5b680e tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1856348356"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:30.991637 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.aggregate [None req-c8880034-ea50-434c-af27-f4058e5b680e tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Generated uuid c34d1527-23d4-474d-85ea-72b449693f33 for aggregate {{(pid=127288) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:31.060646 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-41d1b3ae-3c43-4530-babb-5c8023d425a2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:31.073925 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-41d1b3ae-3c43-4530-babb-5c8023d425a2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1332 microversion: 2.1 time: 0.297105 Oct 10 18:50:31.076643 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 118/278] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:30 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1332 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:31.101614 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9acd31b6-93fd-4643-b0e6-28e97b5b30e3 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:31.102999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9acd31b6-93fd-4643-b0e6-28e97b5b30e3 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:31.108847 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c8880034-ea50-434c-af27-f4058e5b680e tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.127862 Oct 10 18:50:31.117298 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 161/279] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:31.119421 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9acd31b6-93fd-4643-b0e6-28e97b5b30e3 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:31.120237 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9acd31b6-93fd-4643-b0e6-28e97b5b30e3 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:31.120940 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9acd31b6-93fd-4643-b0e6-28e97b5b30e3 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:31.122466 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9acd31b6-93fd-4643-b0e6-28e97b5b30e3 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:31.123201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9acd31b6-93fd-4643-b0e6-28e97b5b30e3 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:31.123808 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9acd31b6-93fd-4643-b0e6-28e97b5b30e3 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:31.128960 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-940fa595-d00f-40be-a885-0a9b609329f0 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-262719317"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:31.150654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-940fa595-d00f-40be-a885-0a9b609329f0 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:31.151149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-940fa595-d00f-40be-a885-0a9b609329f0 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:31.156288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-940fa595-d00f-40be-a885-0a9b609329f0 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:31.198090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-940fa595-d00f-40be-a885-0a9b609329f0 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:31.198588 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-940fa595-d00f-40be-a885-0a9b609329f0 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:31.204031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-940fa595-d00f-40be-a885-0a9b609329f0 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:31.204177 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9acd31b6-93fd-4643-b0e6-28e97b5b30e3 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:31.213665 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9acd31b6-93fd-4643-b0e6-28e97b5b30e3 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:31.218413 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9acd31b6-93fd-4643-b0e6-28e97b5b30e3 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:31.225786 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9acd31b6-93fd-4643-b0e6-28e97b5b30e3 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.128493 Oct 10 18:50:31.227064 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 119/280] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:31 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:50:31.243037 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-940fa595-d00f-40be-a885-0a9b609329f0 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-262719317 could not be found. Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-940fa595-d00f-40be-a885-0a9b609329f0 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Request method failure captured: Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 57 Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGlzaPkzK5Mr8I5docnPV4VRzFHrZo7N5B5xPZVL5DsSrEluCtFgaqop38luuVUROH0YVEREG99xts7mklwUR03iuaeLus2zlx48JNdjv_jwHQ8V6blKk71OGUAKmQtQ9YGl2-3OvMFtEnqk9iuW9bpViYVUNecW9uqNX2_ivqZTvi8 Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:50:31.252082 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:50:31.257024 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_80c5e4b04132467881a6745148f41dfe", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}] Oct 10 18:50:31.257024 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:31.257024 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:31.257024 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:31.257024 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:31.257024 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:31.257024 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:31.257024 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 693ec289ca374d2aa3392f8a6949c0b5 Oct 10 18:50:31.257024 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:31.257024 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:50:31.257024 n-d-860863-1 devstack@n-api.service[127288]: {"add_host": {"host": "tempest-nonexist_host-262719317"}} Oct 10 18:50:31.257024 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: exception: Compute host tempest-nonexist_host-262719317 could not be found. Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-262719317'}}} Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-262719317' is not mapped to any cell Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.257786 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 10 18:50:31.262157 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-262719317 could not be found. Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-262719317 could not be found. Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:31.263736 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.265263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.265263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:31.265263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:31.265263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:31.265263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:31.265263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-262719317 could not be found. Oct 10 18:50:31.265263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.265263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-940fa595-d00f-40be-a885-0a9b609329f0 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-262719317 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:31.265263 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-940fa595-d00f-40be-a885-0a9b609329f0 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.129765 Oct 10 18:50:31.265263 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 162/281] 10.222.0.43 () {60 vars in 1194 bytes} [Mon Oct 10 18:50:31 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:31.267615 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-42cc2fbf-b4c3-464e-831d-d921a36be534 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:31.391192 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-42cc2fbf-b4c3-464e-831d-d921a36be534 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.128465 Oct 10 18:50:31.392831 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 120/282] 10.222.0.43 () {58 vars in 1155 bytes} [Mon Oct 10 18:50:31 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:31.401238 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ce9b2cda-1688-4df6-b28c-ef1e33298182 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ce9b2cda-1688-4df6-b28c-ef1e33298182 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Request method failure captured: Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 283 Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGlzaPkzK5Mr8I5docnPV4VRzFHrZo7N5B5xPZVL5DsSrEluCtFgaqop38luuVUROH0YVEREG99xts7mklwUR03iuaeLus2zlx48JNdjv_jwHQ8V6blKk71OGUAKmQtQ9YGl2-3OvMFtEnqk9iuW9bpViYVUNecW9uqNX2_ivqZTvi8 Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:50:31.415794 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:50:31.417293 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_80c5e4b04132467881a6745148f41dfe", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}] Oct 10 18:50:31.417293 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:31.417293 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:31.417293 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:31.417293 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:31.417293 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:31.417293 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:31.417293 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 693ec289ca374d2aa3392f8a6949c0b5 Oct 10 18:50:31.417293 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:31.417293 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:50:31.418684 n-d-860863-1 devstack@n-api.service[127288]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 10 18:50:31.418684 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:31.418684 n-d-860863-1 devstack@n-api.service[127288]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 18:50:31.418684 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 10 18:50:31.418684 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:31.418684 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.418684 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 18:50:31.418684 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 18:50:31.418684 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 18:50:31.418684 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise error Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:31.419293 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:31.421095 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:31.430446 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 18:50:31.430446 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 18:50:31.430446 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 10 18:50:31.430446 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.430446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ce9b2cda-1688-4df6-b28c-ef1e33298182 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:31.430782 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ce9b2cda-1688-4df6-b28c-ef1e33298182 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.027552 Oct 10 18:50:31.430782 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 163/283] 10.222.0.43 () {60 vars in 1165 bytes} [Mon Oct 10 18:50:31 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:50:31.443116 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ac1cf06a-4fa8-4850-b7a7-d108257d559c tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ac1cf06a-4fa8-4850-b7a7-d108257d559c tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Request method failure captured: Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 27 Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGlzaPkzK5Mr8I5docnPV4VRzFHrZo7N5B5xPZVL5DsSrEluCtFgaqop38luuVUROH0YVEREG99xts7mklwUR03iuaeLus2zlx48JNdjv_jwHQ8V6blKk71OGUAKmQtQ9YGl2-3OvMFtEnqk9iuW9bpViYVUNecW9uqNX2_ivqZTvi8 Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:31.457289 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:31.458858 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_80c5e4b04132467881a6745148f41dfe", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}] Oct 10 18:50:31.458858 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:31.458858 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:31.458858 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:31.458858 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:31.458858 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:31.458858 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:31.458858 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 693ec289ca374d2aa3392f8a6949c0b5 Oct 10 18:50:31.458858 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:31.458858 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:50:31.458858 n-d-860863-1 devstack@n-api.service[127289]: {"aggregate": {"name": ""}} Oct 10 18:50:31.458858 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:31.458858 n-d-860863-1 devstack@n-api.service[127289]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise error Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi '' Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:31.459966 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 10 18:50:31.461850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.463936 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ac1cf06a-4fa8-4850-b7a7-d108257d559c tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:31.463936 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ac1cf06a-4fa8-4850-b7a7-d108257d559c tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.019710 Oct 10 18:50:31.463936 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 121/284] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:31 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 18:50:31.471380 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6cee7540-6927-4bb8-8812-f74144bf540a tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-545551203"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:31.476488 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6cee7540-6927-4bb8-8812-f74144bf540a tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '576855fe48f74531a26424c0046fbe7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264987dfb7ae43f1aaa08c6688cc7c12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6cee7540-6927-4bb8-8812-f74144bf540a tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Request method failure captured: Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 59 Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGly3zrIce5yvcnOcOgNmRWNaxsadNr15u-O-8xMehhBLJXonIrWZg51Aa0zIzy5p77B-18ku-Plknp9aFkDfHsTPki84I_zxArnsU5RoBVISXSwCv02abklWVpZfZy5ujax7tOZokxmtrebqi1-Y91UQuJDX7lBZiHY2nzWyChSRl4 Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 264987dfb7ae43f1aaa08c6688cc7c12 Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:31.478104 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:31.479506 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_264987dfb7ae43f1aaa08c6688cc7c12", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/264987dfb7ae43f1aaa08c6688cc7c12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/264987dfb7ae43f1aaa08c6688cc7c12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/264987dfb7ae43f1aaa08c6688cc7c12"}]}] Oct 10 18:50:31.479506 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:31.479506 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 264987dfb7ae43f1aaa08c6688cc7c12 Oct 10 18:50:31.479506 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:31.479506 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-AggregatesAdminNegativeTestJSON-1007197959-project Oct 10 18:50:31.479506 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:31.479506 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:31.479506 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 576855fe48f74531a26424c0046fbe7e Oct 10 18:50:31.479506 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959-project Oct 10 18:50:31.479506 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:50:31.479506 n-d-860863-1 devstack@n-api.service[127288]: {"aggregate": {"name": "tempest-test_aggregate-545551203"}} Oct 10 18:50:31.479506 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:31.479506 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-545551203'}}} Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:50:31.480263 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:50:31.483733 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 10 18:50:31.484956 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.484956 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6cee7540-6927-4bb8-8812-f74144bf540a tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:31.484956 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6cee7540-6927-4bb8-8812-f74144bf540a tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.013800 Oct 10 18:50:31.492851 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 164/285] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:31 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:31.502398 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-68defed7-fb8d-448b-bf72-6ab37a622bf1 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-964273179"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:31.507603 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.aggregate [None req-68defed7-fb8d-448b-bf72-6ab37a622bf1 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Generated uuid 2bf7fb22-dca9-4462-9fe2-cb194215a9e1 for aggregate {{(pid=127289) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:31.573152 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-38913e5b-d9a9-4e3a-b4ac-1a4802af0a35 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:31.574048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-38913e5b-d9a9-4e3a-b4ac-1a4802af0a35 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:31.581199 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-38913e5b-d9a9-4e3a-b4ac-1a4802af0a35 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:31.581877 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-38913e5b-d9a9-4e3a-b4ac-1a4802af0a35 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:31.582811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-38913e5b-d9a9-4e3a-b4ac-1a4802af0a35 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:31.584006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-38913e5b-d9a9-4e3a-b4ac-1a4802af0a35 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:31.584660 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-38913e5b-d9a9-4e3a-b4ac-1a4802af0a35 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:31.585260 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-38913e5b-d9a9-4e3a-b4ac-1a4802af0a35 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:31.650513 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-68defed7-fb8d-448b-bf72-6ab37a622bf1 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.156001 Oct 10 18:50:31.651135 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 122/286] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:50:31.665966 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-703d24a7-b561-47ec-ac49-9c013e3938d1 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-964273179"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:31.671151 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.aggregate [None req-703d24a7-b561-47ec-ac49-9c013e3938d1 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Generated uuid c082126d-368b-480e-a779-884af3a9a634 for aggregate {{(pid=127289) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:31.674107 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-38913e5b-d9a9-4e3a-b4ac-1a4802af0a35 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:31.683214 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-703d24a7-b561-47ec-ac49-9c013e3938d1 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-964273179 already exists. Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-703d24a7-b561-47ec-ac49-9c013e3938d1 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Request method failure captured: Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 59 Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGlzaPkzK5Mr8I5docnPV4VRzFHrZo7N5B5xPZVL5DsSrEluCtFgaqop38luuVUROH0YVEREG99xts7mklwUR03iuaeLus2zlx48JNdjv_jwHQ8V6blKk71OGUAKmQtQ9YGl2-3OvMFtEnqk9iuW9bpViYVUNecW9uqNX2_ivqZTvi8 Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:31.685328 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:31.700953 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_80c5e4b04132467881a6745148f41dfe", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}] Oct 10 18:50:31.700953 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:31.700953 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:31.700953 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:31.700953 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:31.700953 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:31.700953 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:31.700953 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 693ec289ca374d2aa3392f8a6949c0b5 Oct 10 18:50:31.700953 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:31.700953 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:50:31.700953 n-d-860863-1 devstack@n-api.service[127289]: {"aggregate": {"name": "tempest-test_aggregate-964273179"}} Oct 10 18:50:31.700953 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:31.700953 n-d-860863-1 devstack@n-api.service[127289]: exception: Aggregate tempest-test_aggregate-964273179 already exists. Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-964273179'}}} Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 10 18:50:31.701774 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-964273179 already exists. Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:31.702948 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 10 18:50:31.705338 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 10 18:50:31.705338 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-964273179 already exists. Oct 10 18:50:31.705338 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.705338 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:31.705338 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.705338 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:31.705338 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:31.705338 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:31.705338 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:31.705338 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:31.705338 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-964273179 already exists. Oct 10 18:50:31.705338 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:31.705338 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-703d24a7-b561-47ec-ac49-9c013e3938d1 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-964273179 already exists. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:31.705338 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-703d24a7-b561-47ec-ac49-9c013e3938d1 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.025872 Oct 10 18:50:31.707018 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-38913e5b-d9a9-4e3a-b4ac-1a4802af0a35 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1281 microversion: 2.1 time: 0.115832 Oct 10 18:50:31.707148 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 123/287] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:31 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 27 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:31.707288 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 165/288] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:31 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:31.707424 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c530d429-359a-4f47-a251-5e2bcc29723a tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:31.856170 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c530d429-359a-4f47-a251-5e2bcc29723a tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.162213 Oct 10 18:50:31.856782 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 124/289] 10.222.0.43 () {58 vars in 1155 bytes} [Mon Oct 10 18:50:31 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:31.868952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-10e4da31-6d46-4f83-9286-ddd9727bc69e tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-874776596"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:31.874850 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.aggregate [None req-10e4da31-6d46-4f83-9286-ddd9727bc69e tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Generated uuid a25722b5-9359-41cc-ac77-40bfcbdfb0ab for aggregate {{(pid=127288) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:32.009481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-96aa33fd-3177-4b80-a4c1-dcb24704a78a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:32.010369 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-96aa33fd-3177-4b80-a4c1-dcb24704a78a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:32.027605 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96aa33fd-3177-4b80-a4c1-dcb24704a78a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:32.028732 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96aa33fd-3177-4b80-a4c1-dcb24704a78a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:32.029786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96aa33fd-3177-4b80-a4c1-dcb24704a78a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:32.035242 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-10e4da31-6d46-4f83-9286-ddd9727bc69e tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.172286 Oct 10 18:50:32.037429 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 166/290] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:32.045857 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96aa33fd-3177-4b80-a4c1-dcb24704a78a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:32.046681 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96aa33fd-3177-4b80-a4c1-dcb24704a78a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:32.047921 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96aa33fd-3177-4b80-a4c1-dcb24704a78a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:32.053445 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e7fb360f-89c7-4844-93aa-347f306a246f tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:32.057783 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e7fb360f-89c7-4844-93aa-347f306a246f tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '576855fe48f74531a26424c0046fbe7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264987dfb7ae43f1aaa08c6688cc7c12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e7fb360f-89c7-4844-93aa-347f306a246f tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Request method failure captured: Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGly3zrIce5yvcnOcOgNmRWNaxsadNr15u-O-8xMehhBLJXonIrWZg51Aa0zIzy5p77B-18ku-Plknp9aFkDfHsTPki84I_zxArnsU5RoBVISXSwCv02abklWVpZfZy5ujax7tOZokxmtrebqi1-Y91UQuJDX7lBZiHY2nzWyChSRl4 Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 264987dfb7ae43f1aaa08c6688cc7c12 Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:32.061290 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:32.062759 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_264987dfb7ae43f1aaa08c6688cc7c12", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/264987dfb7ae43f1aaa08c6688cc7c12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/264987dfb7ae43f1aaa08c6688cc7c12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/264987dfb7ae43f1aaa08c6688cc7c12"}]}] Oct 10 18:50:32.062759 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:32.062759 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 264987dfb7ae43f1aaa08c6688cc7c12 Oct 10 18:50:32.062759 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:32.062759 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-AggregatesAdminNegativeTestJSON-1007197959-project Oct 10 18:50:32.062759 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:32.062759 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:32.062759 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 576855fe48f74531a26424c0046fbe7e Oct 10 18:50:32.062759 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959-project Oct 10 18:50:32.062759 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:32.062759 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 10 18:50:32.062759 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '15'} Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:32.063483 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 10 18:50:32.064696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.067680 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e7fb360f-89c7-4844-93aa-347f306a246f tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:32.076234 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e7fb360f-89c7-4844-93aa-347f306a246f tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.025989 Oct 10 18:50:32.078095 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 167/291] 10.222.0.43 () {58 vars in 1155 bytes} [Mon Oct 10 18:50:32 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 10 18:50:32.088214 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d94086e8-1e58-4818-86ce-149ebe9d0377 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:32.126642 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:32.132449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96aa33fd-3177-4b80-a4c1-dcb24704a78a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:32.133186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96aa33fd-3177-4b80-a4c1-dcb24704a78a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:32.133633 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96aa33fd-3177-4b80-a4c1-dcb24704a78a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:32.134091 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-96aa33fd-3177-4b80-a4c1-dcb24704a78a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lazy-loading 'fault' on Instance uuid 907f0a12-5167-416e-a0a7-b1e3a398ebe3 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:50:32.231350 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d94086e8-1e58-4818-86ce-149ebe9d0377 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.148150 Oct 10 18:50:32.233277 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 168/292] 10.222.0.43 () {58 vars in 1155 bytes} [Mon Oct 10 18:50:32 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:32.240293 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6547b9e2-0014-4087-87d6-e10d1a8e5b87 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:32.244071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6547b9e2-0014-4087-87d6-e10d1a8e5b87 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:32.261130 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6547b9e2-0014-4087-87d6-e10d1a8e5b87 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:32.266277 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6547b9e2-0014-4087-87d6-e10d1a8e5b87 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:32.268300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6547b9e2-0014-4087-87d6-e10d1a8e5b87 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:32.269449 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6547b9e2-0014-4087-87d6-e10d1a8e5b87 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:32.271236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6547b9e2-0014-4087-87d6-e10d1a8e5b87 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:32.274206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6547b9e2-0014-4087-87d6-e10d1a8e5b87 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:32.456654 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-96aa33fd-3177-4b80-a4c1-dcb24704a78a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:32.464289 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-96aa33fd-3177-4b80-a4c1-dcb24704a78a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1458 microversion: 2.1 time: 0.464288 Oct 10 18:50:32.464904 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 125/293] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:31 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1458 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:32.474649 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b9ff4f1d-323b-482a-ae84-ca87dbf5b1a5 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:32.501735 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-b9ff4f1d-323b-482a-ae84-ca87dbf5b1a5 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b9ff4f1d-323b-482a-ae84-ca87dbf5b1a5 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Request method failure captured: Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGlzaPkzK5Mr8I5docnPV4VRzFHrZo7N5B5xPZVL5DsSrEluCtFgaqop38luuVUROH0YVEREG99xts7mklwUR03iuaeLus2zlx48JNdjv_jwHQ8V6blKk71OGUAKmQtQ9YGl2-3OvMFtEnqk9iuW9bpViYVUNecW9uqNX2_ivqZTvi8 Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:32.503787 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:32.505258 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_80c5e4b04132467881a6745148f41dfe", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}] Oct 10 18:50:32.505258 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:32.505258 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:32.505258 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:32.505258 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:32.505258 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:32.505258 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:32.505258 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 693ec289ca374d2aa3392f8a6949c0b5 Oct 10 18:50:32.505258 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:32.505258 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:32.505258 n-d-860863-1 devstack@n-api.service[127289]: exception: Aggregate -1 could not be found. Oct 10 18:50:32.505258 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '-1'} Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 18:50:32.505982 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.507070 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:32.508344 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:32.508344 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:32.508344 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:32.508344 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:32.508344 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 10 18:50:32.508344 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.508344 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b9ff4f1d-323b-482a-ae84-ca87dbf5b1a5 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:32.509723 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b9ff4f1d-323b-482a-ae84-ca87dbf5b1a5 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035614 Oct 10 18:50:32.509723 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 126/294] 10.222.0.43 () {58 vars in 1155 bytes} [Mon Oct 10 18:50:32 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:32.516749 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-d1f48b28-7a4c-4e36-a3ae-9e1206ec21b7 req-4bb4389c-dc78-4bbb-bd1a-a49d77c7e15b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a71922-7bbf-4415-b3f5-2c2716b7c7c1", "name": "network-vif-plugged", "status": "completed", "tag": "c279876a-95a9-436e-bc98-b4a82d21aa0b"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:32.528972 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d1f48b28-7a4c-4e36-a3ae-9e1206ec21b7 req-4bb4389c-dc78-4bbb-bd1a-a49d77c7e15b service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:32.530158 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d1f48b28-7a4c-4e36-a3ae-9e1206ec21b7 req-4bb4389c-dc78-4bbb-bd1a-a49d77c7e15b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:32.530158 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d1f48b28-7a4c-4e36-a3ae-9e1206ec21b7 req-4bb4389c-dc78-4bbb-bd1a-a49d77c7e15b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:32.540809 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-d1f48b28-7a4c-4e36-a3ae-9e1206ec21b7 req-4bb4389c-dc78-4bbb-bd1a-a49d77c7e15b service nova] Creating event network-vif-plugged:c279876a-95a9-436e-bc98-b4a82d21aa0b for instance f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 on n-h1-860863-1 Oct 10 18:50:32.552637 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-d1f48b28-7a4c-4e36-a3ae-9e1206ec21b7 req-4bb4389c-dc78-4bbb-bd1a-a49d77c7e15b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039606 Oct 10 18:50:32.554259 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 127/295] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:32.560828 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-19a73e74-a32b-4a10-8a12-c8a548fc9481 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:32.561531 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-19a73e74-a32b-4a10-8a12-c8a548fc9481 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:32.573453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19a73e74-a32b-4a10-8a12-c8a548fc9481 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:32.573973 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19a73e74-a32b-4a10-8a12-c8a548fc9481 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:32.574550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19a73e74-a32b-4a10-8a12-c8a548fc9481 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:32.575477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19a73e74-a32b-4a10-8a12-c8a548fc9481 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:32.575939 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19a73e74-a32b-4a10-8a12-c8a548fc9481 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:32.576380 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19a73e74-a32b-4a10-8a12-c8a548fc9481 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:32.586125 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6547b9e2-0014-4087-87d6-e10d1a8e5b87 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:32.593795 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6547b9e2-0014-4087-87d6-e10d1a8e5b87 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1332 microversion: 2.1 time: 0.359124 Oct 10 18:50:32.609959 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 169/296] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:32 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1332 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:32.609959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-833fb0e9-84a8-43b1-971d-3ef1fe16633f tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-697340244"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:32.609959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.aggregate [None req-833fb0e9-84a8-43b1-971d-3ef1fe16633f tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Generated uuid cbb99c5c-f826-4070-9fcc-9bbeb28798e5 for aggregate {{(pid=127288) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:32.703034 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-833fb0e9-84a8-43b1-971d-3ef1fe16633f tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.102100 Oct 10 18:50:32.709509 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 170/297] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:32.718966 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d559b0ff-9287-4ac9-8c6a-3a5000f958a6 tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:32.720563 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d559b0ff-9287-4ac9-8c6a-3a5000f958a6 tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '576855fe48f74531a26424c0046fbe7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264987dfb7ae43f1aaa08c6688cc7c12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d559b0ff-9287-4ac9-8c6a-3a5000f958a6 tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Request method failure captured: Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGly3zrIce5yvcnOcOgNmRWNaxsadNr15u-O-8xMehhBLJXonIrWZg51Aa0zIzy5p77B-18ku-Plknp9aFkDfHsTPki84I_zxArnsU5RoBVISXSwCv02abklWVpZfZy5ujax7tOZokxmtrebqi1-Y91UQuJDX7lBZiHY2nzWyChSRl4 Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 264987dfb7ae43f1aaa08c6688cc7c12 Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:32.729342 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:32.731243 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_264987dfb7ae43f1aaa08c6688cc7c12", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/264987dfb7ae43f1aaa08c6688cc7c12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/264987dfb7ae43f1aaa08c6688cc7c12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/264987dfb7ae43f1aaa08c6688cc7c12"}]}] Oct 10 18:50:32.731243 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:32.731243 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 264987dfb7ae43f1aaa08c6688cc7c12 Oct 10 18:50:32.731243 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:32.731243 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-AggregatesAdminNegativeTestJSON-1007197959-project Oct 10 18:50:32.731243 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:32.731243 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:32.731243 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 576855fe48f74531a26424c0046fbe7e Oct 10 18:50:32.731243 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959-project Oct 10 18:50:32.731243 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:32.731243 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 10 18:50:32.731243 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '16'} Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:32.731930 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.733142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d559b0ff-9287-4ac9-8c6a-3a5000f958a6 tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:32.734098 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d559b0ff-9287-4ac9-8c6a-3a5000f958a6 tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] 10.222.0.43 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.019465 Oct 10 18:50:32.734098 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 171/298] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:50:32 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:32.744729 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e344d1f3-aaa1-4667-bf78-fec2385d9229 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:32.745264 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e344d1f3-aaa1-4667-bf78-fec2385d9229 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:32.756102 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e344d1f3-aaa1-4667-bf78-fec2385d9229 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:32.756677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e344d1f3-aaa1-4667-bf78-fec2385d9229 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:32.757047 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e344d1f3-aaa1-4667-bf78-fec2385d9229 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:32.757903 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e344d1f3-aaa1-4667-bf78-fec2385d9229 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:32.758553 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e344d1f3-aaa1-4667-bf78-fec2385d9229 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:32.759420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e344d1f3-aaa1-4667-bf78-fec2385d9229 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:32.774217 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-19a73e74-a32b-4a10-8a12-c8a548fc9481 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:32.790845 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-19a73e74-a32b-4a10-8a12-c8a548fc9481 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:32.794000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-19a73e74-a32b-4a10-8a12-c8a548fc9481 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:32.811112 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-19a73e74-a32b-4a10-8a12-c8a548fc9481 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.253746 Oct 10 18:50:32.812048 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 128/299] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:32 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:32.819137 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a4e4eb33-5402-419b-9081-a70e502cc4aa tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:32.911981 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a4e4eb33-5402-419b-9081-a70e502cc4aa tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.097395 Oct 10 18:50:32.913507 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 129/300] 10.222.0.43 () {58 vars in 1155 bytes} [Mon Oct 10 18:50:32 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:32.921607 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-2ba82d00-9720-4649-8731-0fc216ed5568 req-76ae4efc-fcd2-47ba-aa82-634724a38ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907f0a12-5167-416e-a0a7-b1e3a398ebe3", "name": "network-vif-deleted", "tag": "7fea10e4-e3f5-4276-8a1e-5ec237e34644"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:32.940684 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-2ba82d00-9720-4649-8731-0fc216ed5568 req-76ae4efc-fcd2-47ba-aa82-634724a38ebb service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:32.941343 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-2ba82d00-9720-4649-8731-0fc216ed5568 req-76ae4efc-fcd2-47ba-aa82-634724a38ebb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:32.941949 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-2ba82d00-9720-4649-8731-0fc216ed5568 req-76ae4efc-fcd2-47ba-aa82-634724a38ebb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:32.957885 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-2ba82d00-9720-4649-8731-0fc216ed5568 req-76ae4efc-fcd2-47ba-aa82-634724a38ebb service nova] Creating event network-vif-deleted:7fea10e4-e3f5-4276-8a1e-5ec237e34644 for instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 on n-h1-860863-1 Oct 10 18:50:32.966727 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-2ba82d00-9720-4649-8731-0fc216ed5568 req-76ae4efc-fcd2-47ba-aa82-634724a38ebb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049547 Oct 10 18:50:32.966727 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 130/301] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:32.976846 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-efc7c52a-e2be-42d0-a531-2b3530d68ff1 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:32.985775 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-efc7c52a-e2be-42d0-a531-2b3530d68ff1 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-efc7c52a-e2be-42d0-a531-2b3530d68ff1 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Request method failure captured: Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGlzaPkzK5Mr8I5docnPV4VRzFHrZo7N5B5xPZVL5DsSrEluCtFgaqop38luuVUROH0YVEREG99xts7mklwUR03iuaeLus2zlx48JNdjv_jwHQ8V6blKk71OGUAKmQtQ9YGl2-3OvMFtEnqk9iuW9bpViYVUNecW9uqNX2_ivqZTvi8 Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:32.988084 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:32.989630 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_80c5e4b04132467881a6745148f41dfe", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}] Oct 10 18:50:32.989630 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:32.989630 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:32.989630 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:32.989630 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:32.989630 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:32.989630 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:32.989630 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 693ec289ca374d2aa3392f8a6949c0b5 Oct 10 18:50:32.989630 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:32.989630 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:32.989630 n-d-860863-1 devstack@n-api.service[127289]: exception: Aggregate -1 could not be found. Oct 10 18:50:32.989630 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '-1'} Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:32.990498 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 10 18:50:32.991850 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:32.995313 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-efc7c52a-e2be-42d0-a531-2b3530d68ff1 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:32.995313 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-efc7c52a-e2be-42d0-a531-2b3530d68ff1 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.022726 Oct 10 18:50:32.996005 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 131/302] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:50:32 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:33.008316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a08abe92-2bf9-407c-bac9-f3364da55f7c tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:33.010263 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a08abe92-2bf9-407c-bac9-f3364da55f7c tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '576855fe48f74531a26424c0046fbe7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264987dfb7ae43f1aaa08c6688cc7c12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a08abe92-2bf9-407c-bac9-f3364da55f7c tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Request method failure captured: Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGly3zrIce5yvcnOcOgNmRWNaxsadNr15u-O-8xMehhBLJXonIrWZg51Aa0zIzy5p77B-18ku-Plknp9aFkDfHsTPki84I_zxArnsU5RoBVISXSwCv02abklWVpZfZy5ujax7tOZokxmtrebqi1-Y91UQuJDX7lBZiHY2nzWyChSRl4 Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 264987dfb7ae43f1aaa08c6688cc7c12 Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:50:33.012376 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:50:33.013922 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_264987dfb7ae43f1aaa08c6688cc7c12", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/264987dfb7ae43f1aaa08c6688cc7c12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/264987dfb7ae43f1aaa08c6688cc7c12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/264987dfb7ae43f1aaa08c6688cc7c12"}]}] Oct 10 18:50:33.013922 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:33.013922 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 264987dfb7ae43f1aaa08c6688cc7c12 Oct 10 18:50:33.013922 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:33.013922 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AggregatesAdminNegativeTestJSON-1007197959-project Oct 10 18:50:33.013922 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:33.013922 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:33.013922 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 576855fe48f74531a26424c0046fbe7e Oct 10 18:50:33.013922 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959-project Oct 10 18:50:33.013922 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:33.013922 n-d-860863-1 devstack@n-api.service[127289]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 10 18:50:33.013922 n-d-860863-1 devstack@n-api.service[127289]: action_args: {} Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:33.014651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 10 18:50:33.015709 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:33.018287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a08abe92-2bf9-407c-bac9-f3364da55f7c tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:33.019355 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a08abe92-2bf9-407c-bac9-f3364da55f7c tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.018008 Oct 10 18:50:33.020310 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 132/303] 10.222.0.43 () {58 vars in 1143 bytes} [Mon Oct 10 18:50:33 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:33.040170 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b958d9d2-2215-4e90-b293-6bbac609cd74 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1176654714"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:33.045845 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.aggregate [None req-b958d9d2-2215-4e90-b293-6bbac609cd74 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Generated uuid 0835425d-1200-4c7f-983d-d8385d399415 for aggregate {{(pid=127289) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:33.125535 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e344d1f3-aaa1-4667-bf78-fec2385d9229 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:33.134984 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e344d1f3-aaa1-4667-bf78-fec2385d9229 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1323 microversion: 2.1 time: 0.401799 Oct 10 18:50:33.138026 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 172/304] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:32 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1323 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:33.138240 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b958d9d2-2215-4e90-b293-6bbac609cd74 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.106059 Oct 10 18:50:33.139023 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 133/305] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:33 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:33.172971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6cf53d38-c103-4cb4-8318-128621a7db4d tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-860863-1"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:33.185926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cf53d38-c103-4cb4-8318-128621a7db4d tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:33.186513 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cf53d38-c103-4cb4-8318-128621a7db4d tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:33.187635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cf53d38-c103-4cb4-8318-128621a7db4d tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:33.517723 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6cf53d38-c103-4cb4-8318-128621a7db4d tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.360009 Oct 10 18:50:33.518325 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 173/306] 10.222.0.43 () {60 vars in 1194 bytes} [Mon Oct 10 18:50:33 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:33.524378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-4ce07525-a74a-4a00-933b-9e1310d18535 req-1da5a617-40ea-40b3-9e18-8241a4d91e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0af7e1f-fea0-4343-9d8d-4ca0f78c1948", "tag": "c9a0326e-ae77-42a1-8db7-434146a99516"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:33.536556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4ce07525-a74a-4a00-933b-9e1310d18535 req-1da5a617-40ea-40b3-9e18-8241a4d91e72 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:33.536955 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3172e593-9541-4944-a444-2e82bda13ba5 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:33.537065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4ce07525-a74a-4a00-933b-9e1310d18535 req-1da5a617-40ea-40b3-9e18-8241a4d91e72 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:33.537473 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4ce07525-a74a-4a00-933b-9e1310d18535 req-1da5a617-40ea-40b3-9e18-8241a4d91e72 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:33.538778 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3172e593-9541-4944-a444-2e82bda13ba5 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:33.539255 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3172e593-9541-4944-a444-2e82bda13ba5 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:33.539698 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3172e593-9541-4944-a444-2e82bda13ba5 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:33.540474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3172e593-9541-4944-a444-2e82bda13ba5 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:33.540971 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3172e593-9541-4944-a444-2e82bda13ba5 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:33.541378 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3172e593-9541-4944-a444-2e82bda13ba5 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:33.550344 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-4ce07525-a74a-4a00-933b-9e1310d18535 req-1da5a617-40ea-40b3-9e18-8241a4d91e72 service nova] Creating event network-changed:c9a0326e-ae77-42a1-8db7-434146a99516 for instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 on n-h2-860863-1 Oct 10 18:50:33.555522 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-4ce07525-a74a-4a00-933b-9e1310d18535 req-1da5a617-40ea-40b3-9e18-8241a4d91e72 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035863 Oct 10 18:50:33.556587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:33.558432 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 174/307] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:33.565023 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-edc10b96-bfba-493f-be20-12a7f0663750 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:33.566136 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-edc10b96-bfba-493f-be20-12a7f0663750 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:33.572409 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edc10b96-bfba-493f-be20-12a7f0663750 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:33.572908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edc10b96-bfba-493f-be20-12a7f0663750 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:33.573367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edc10b96-bfba-493f-be20-12a7f0663750 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:33.574089 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edc10b96-bfba-493f-be20-12a7f0663750 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:33.575286 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edc10b96-bfba-493f-be20-12a7f0663750 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:33.575990 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edc10b96-bfba-493f-be20-12a7f0663750 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:33.582898 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3172e593-9541-4944-a444-2e82bda13ba5 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] 10.222.0.43 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.226793 Oct 10 18:50:33.584456 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 134/308] 10.222.0.43 () {58 vars in 1164 bytes} [Mon Oct 10 18:50:33 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 18:50:33.597979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ebd8631a-7973-4cc3-b498-72ab1835f5ee tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860863-1"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:33.601749 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ebd8631a-7973-4cc3-b498-72ab1835f5ee tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '576855fe48f74531a26424c0046fbe7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264987dfb7ae43f1aaa08c6688cc7c12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ebd8631a-7973-4cc3-b498-72ab1835f5ee tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Request method failure captured: Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 42 Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGly3zrIce5yvcnOcOgNmRWNaxsadNr15u-O-8xMehhBLJXonIrWZg51Aa0zIzy5p77B-18ku-Plknp9aFkDfHsTPki84I_zxArnsU5RoBVISXSwCv02abklWVpZfZy5ujax7tOZokxmtrebqi1-Y91UQuJDX7lBZiHY2nzWyChSRl4 Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 264987dfb7ae43f1aaa08c6688cc7c12 Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:50:33.603664 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:50:33.605058 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_264987dfb7ae43f1aaa08c6688cc7c12", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/264987dfb7ae43f1aaa08c6688cc7c12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/264987dfb7ae43f1aaa08c6688cc7c12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/264987dfb7ae43f1aaa08c6688cc7c12"}]}] Oct 10 18:50:33.605058 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:33.605058 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 264987dfb7ae43f1aaa08c6688cc7c12 Oct 10 18:50:33.605058 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959 Oct 10 18:50:33.605058 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AggregatesAdminNegativeTestJSON-1007197959-project Oct 10 18:50:33.605058 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:33.605058 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:33.605058 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 576855fe48f74531a26424c0046fbe7e Oct 10 18:50:33.605058 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1007197959-project Oct 10 18:50:33.605058 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:50:33.605058 n-d-860863-1 devstack@n-api.service[127289]: {"remove_host": {"host": "n-h1-860863-1"}} Oct 10 18:50:33.605058 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:33.605058 n-d-860863-1 devstack@n-api.service[127289]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-860863-1'}}} Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:33.605885 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 10 18:50:33.607075 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:33.608948 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ebd8631a-7973-4cc3-b498-72ab1835f5ee tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:33.608948 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ebd8631a-7973-4cc3-b498-72ab1835f5ee tempest-AggregatesAdminNegativeTestJSON-1007197959 tempest-AggregatesAdminNegativeTestJSON-1007197959-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.021173 Oct 10 18:50:33.610616 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 135/309] 10.222.0.43 () {60 vars in 1194 bytes} [Mon Oct 10 18:50:33 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:33.616048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edc10b96-bfba-493f-be20-12a7f0663750 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:33.616421 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1f22c376-ac38-42c8-a20b-3a51b0a1f800 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:33.616517 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edc10b96-bfba-493f-be20-12a7f0663750 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:33.616811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edc10b96-bfba-493f-be20-12a7f0663750 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:33.617308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-edc10b96-bfba-493f-be20-12a7f0663750 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lazy-loading 'fault' on Instance uuid 907f0a12-5167-416e-a0a7-b1e3a398ebe3 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:50:33.617767 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1f22c376-ac38-42c8-a20b-3a51b0a1f800 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:33.618245 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1f22c376-ac38-42c8-a20b-3a51b0a1f800 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:33.618678 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1f22c376-ac38-42c8-a20b-3a51b0a1f800 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:33.619432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1f22c376-ac38-42c8-a20b-3a51b0a1f800 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:33.619865 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1f22c376-ac38-42c8-a20b-3a51b0a1f800 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:33.620291 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1f22c376-ac38-42c8-a20b-3a51b0a1f800 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:33.630163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:33.648902 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1f22c376-ac38-42c8-a20b-3a51b0a1f800 tempest-AZAdminV2TestJSON-2065710679 tempest-AZAdminV2TestJSON-2065710679-project-admin] 10.222.0.43 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.037172 Oct 10 18:50:33.649502 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 136/310] 10.222.0.43 () {58 vars in 1185 bytes} [Mon Oct 10 18:50:33 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:33.654472 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-39184c39-9476-4f38-84b4-cb62d5de3fa5 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-860863-1"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:33.666472 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39184c39-9476-4f38-84b4-cb62d5de3fa5 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:33.666957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39184c39-9476-4f38-84b4-cb62d5de3fa5 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:33.673948 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39184c39-9476-4f38-84b4-cb62d5de3fa5 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:33.710099 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-edc10b96-bfba-493f-be20-12a7f0663750 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162d1d44a68b4ce69b2eaf4627974335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3977c93857c3448a9c51227abad2ecfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:33.735720 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-edc10b96-bfba-493f-be20-12a7f0663750 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 200 len: 1309 microversion: 2.1 time: 0.172707 Oct 10 18:50:33.748706 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 175/311] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:33 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 1309 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:33.763064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-331663bb-9e46-4520-b49c-233d01bba6fe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:33.763064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-331663bb-9e46-4520-b49c-233d01bba6fe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:33.775501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-331663bb-9e46-4520-b49c-233d01bba6fe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:33.776476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-331663bb-9e46-4520-b49c-233d01bba6fe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:33.776948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-331663bb-9e46-4520-b49c-233d01bba6fe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:33.778440 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-331663bb-9e46-4520-b49c-233d01bba6fe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:33.778901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-331663bb-9e46-4520-b49c-233d01bba6fe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:33.779433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-331663bb-9e46-4520-b49c-233d01bba6fe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:33.958757 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-39184c39-9476-4f38-84b4-cb62d5de3fa5 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.307684 Oct 10 18:50:33.959505 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 137/312] 10.222.0.43 () {60 vars in 1194 bytes} [Mon Oct 10 18:50:33 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:33.970689 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c2175185-060d-46ca-b2a9-ef35a95d578d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:33.971649 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c2175185-060d-46ca-b2a9-ef35a95d578d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:33.979411 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c2175185-060d-46ca-b2a9-ef35a95d578d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:33.979895 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c2175185-060d-46ca-b2a9-ef35a95d578d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:33.984948 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c2175185-060d-46ca-b2a9-ef35a95d578d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:33.984948 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c2175185-060d-46ca-b2a9-ef35a95d578d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:33.984948 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c2175185-060d-46ca-b2a9-ef35a95d578d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:33.984948 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c2175185-060d-46ca-b2a9-ef35a95d578d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:34.091907 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c2175185-060d-46ca-b2a9-ef35a95d578d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:34.110392 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c2175185-060d-46ca-b2a9-ef35a95d578d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:34.111864 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c2175185-060d-46ca-b2a9-ef35a95d578d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:34.117192 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c2175185-060d-46ca-b2a9-ef35a95d578d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.151173 Oct 10 18:50:34.117782 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 138/313] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:33 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:34.122886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-24fbca21-6e41-4631-9eb5-0d75da208225 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:34.250658 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-24fbca21-6e41-4631-9eb5-0d75da208225 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.131815 Oct 10 18:50:34.251300 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 139/314] 10.222.0.43 () {58 vars in 1155 bytes} [Mon Oct 10 18:50:34 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 10 18:50:34.256566 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-db08265c-edcb-49fe-a7bd-c4357a1a26dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:34.257172 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-db08265c-edcb-49fe-a7bd-c4357a1a26dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:34.260164 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-331663bb-9e46-4520-b49c-233d01bba6fe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:34.265891 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-db08265c-edcb-49fe-a7bd-c4357a1a26dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:34.266378 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-db08265c-edcb-49fe-a7bd-c4357a1a26dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:34.266804 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-db08265c-edcb-49fe-a7bd-c4357a1a26dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:34.271997 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-db08265c-edcb-49fe-a7bd-c4357a1a26dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:34.273381 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-331663bb-9e46-4520-b49c-233d01bba6fe tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1332 microversion: 2.1 time: 0.533903 Oct 10 18:50:34.282729 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 176/315] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:33 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1332 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:34.283287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-db08265c-edcb-49fe-a7bd-c4357a1a26dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:34.283287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-db08265c-edcb-49fe-a7bd-c4357a1a26dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:34.283469 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-98d09fb1-1c0a-4843-a78e-8b83693f3567 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-964108213"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:34.287875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.aggregate [None req-98d09fb1-1c0a-4843-a78e-8b83693f3567 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Generated uuid e3db5a67-b793-4668-a32b-0811bb38d63b for aggregate {{(pid=127288) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 10 18:50:34.367144 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-98d09fb1-1c0a-4843-a78e-8b83693f3567 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.091184 Oct 10 18:50:34.368774 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 177/316] 10.222.0.43 () {60 vars in 1164 bytes} [Mon Oct 10 18:50:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:34.380170 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cdb0a4ad-1c81-4f9e-9c05-cc976b49bde9 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:34.392257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdb0a4ad-1c81-4f9e-9c05-cc976b49bde9 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:34.392823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdb0a4ad-1c81-4f9e-9c05-cc976b49bde9 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:34.393471 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdb0a4ad-1c81-4f9e-9c05-cc976b49bde9 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:34.405145 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdb0a4ad-1c81-4f9e-9c05-cc976b49bde9 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:34.405632 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdb0a4ad-1c81-4f9e-9c05-cc976b49bde9 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:34.406064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdb0a4ad-1c81-4f9e-9c05-cc976b49bde9 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:34.414126 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.compute.aggregates [None req-cdb0a4ad-1c81-4f9e-9c05-cc976b49bde9 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 10 18:50:34.414851 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-cdb0a4ad-1c81-4f9e-9c05-cc976b49bde9 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cdb0a4ad-1c81-4f9e-9c05-cc976b49bde9 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Request method failure captured: Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 42 Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGlzaPkzK5Mr8I5docnPV4VRzFHrZo7N5B5xPZVL5DsSrEluCtFgaqop38luuVUROH0YVEREG99xts7mklwUR03iuaeLus2zlx48JNdjv_jwHQ8V6blKk71OGUAKmQtQ9YGl2-3OvMFtEnqk9iuW9bpViYVUNecW9uqNX2_ivqZTvi8 Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:50:34.417016 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:50:34.420804 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_80c5e4b04132467881a6745148f41dfe", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/80c5e4b04132467881a6745148f41dfe"}]}] Oct 10 18:50:34.420804 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:34.420804 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 80c5e4b04132467881a6745148f41dfe Oct 10 18:50:34.420804 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807 Oct 10 18:50:34.420804 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:34.420804 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:34.420804 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:34.420804 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 693ec289ca374d2aa3392f8a6949c0b5 Oct 10 18:50:34.420804 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin Oct 10 18:50:34.420804 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:50:34.420804 n-d-860863-1 devstack@n-api.service[127288]: {"remove_host": {"host": "nonexist_host"}} Oct 10 18:50:34.420804 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:34.420804 n-d-860863-1 devstack@n-api.service[127288]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 10 18:50:34.421743 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 10 18:50:34.423118 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.424498 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.426096 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:34.426096 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:34.426096 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:34.426096 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:34.426096 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 10 18:50:34.426096 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.426096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cdb0a4ad-1c81-4f9e-9c05-cc976b49bde9 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:34.426096 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cdb0a4ad-1c81-4f9e-9c05-cc976b49bde9 tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.043198 Oct 10 18:50:34.427033 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 178/317] 10.222.0.43 () {60 vars in 1194 bytes} [Mon Oct 10 18:50:34 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:34.436092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9694bdea-03ca-4f3b-94cc-38b67ee74c7b tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:34.458432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-db08265c-edcb-49fe-a7bd-c4357a1a26dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:34.467821 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-db08265c-edcb-49fe-a7bd-c4357a1a26dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1323 microversion: 2.1 time: 0.215506 Oct 10 18:50:34.484238 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 140/318] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:34 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1323 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:34.531274 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9694bdea-03ca-4f3b-94cc-38b67ee74c7b tempest-AggregatesAdminNegativeTestJSON-1396798807 tempest-AggregatesAdminNegativeTestJSON-1396798807-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.099640 Oct 10 18:50:34.532126 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 179/319] 10.222.0.43 () {58 vars in 1155 bytes} [Mon Oct 10 18:50:34 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 10 18:50:34.771101 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4af816b2-cc77-46a4-9e61-661906bdf40a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:34.771984 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4af816b2-cc77-46a4-9e61-661906bdf40a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:34.779351 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4af816b2-cc77-46a4-9e61-661906bdf40a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:34.780078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4af816b2-cc77-46a4-9e61-661906bdf40a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:34.780293 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4af816b2-cc77-46a4-9e61-661906bdf40a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:34.780975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4af816b2-cc77-46a4-9e61-661906bdf40a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:34.781670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4af816b2-cc77-46a4-9e61-661906bdf40a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:34.781872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4af816b2-cc77-46a4-9e61-661906bdf40a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:34.806390 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-4af816b2-cc77-46a4-9e61-661906bdf40a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] HTTP exception thrown: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4af816b2-cc77-46a4-9e61-661906bdf40a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Request method failure captured: Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 HTTP/1.1 Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGk0JnuzvtPAiYB1qYrT7OTm4ss9X-4nZ-pZZpIQOnLeFLX82PDM4AfRZwC4DXf32c9v6BcrO9RzbnLlAFOp4cBEbow-SaTUs2aHqPYBd3m-aebWTBDKhuXNb695bnAlmS9mRCNiFKLZCZ1PyYrhqUpxtm0QuMyggQEDIK-Lzje0hSI Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 3977c93857c3448a9c51227abad2ecfb Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:50:34.808286 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:50:34.809712 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3977c93857c3448a9c51227abad2ecfb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3977c93857c3448a9c51227abad2ecfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3977c93857c3448a9c51227abad2ecfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3977c93857c3448a9c51227abad2ecfb"}]}] Oct 10 18:50:34.809712 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:34.809712 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 3977c93857c3448a9c51227abad2ecfb Oct 10 18:50:34.809712 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:34.809712 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersAdminTestJSON-34767308-project Oct 10 18:50:34.809712 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:34.809712 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:34.809712 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 162d1d44a68b4ce69b2eaf4627974335 Oct 10 18:50:34.809712 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersAdminTestJSON-34767308-project Oct 10 18:50:34.809712 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:34.809712 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.809712 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '907f0a12-5167-416e-a0a7-b1e3a398ebe3'} Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:34.810601 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.811755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.814063 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4af816b2-cc77-46a4-9e61-661906bdf40a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Returning 404 to user: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:34.814063 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4af816b2-cc77-46a4-9e61-661906bdf40a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 404 len: 111 microversion: 2.1 time: 0.042722 Oct 10 18:50:34.825616 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b2e10c49-9206-432e-9ea9-2c9e3dc6d16a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:34.826124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b2e10c49-9206-432e-9ea9-2c9e3dc6d16a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:34.831693 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 141/320] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:34 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:34.834520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2e10c49-9206-432e-9ea9-2c9e3dc6d16a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:34.835007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2e10c49-9206-432e-9ea9-2c9e3dc6d16a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:34.835437 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2e10c49-9206-432e-9ea9-2c9e3dc6d16a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:34.836492 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2e10c49-9206-432e-9ea9-2c9e3dc6d16a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:34.842256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2e10c49-9206-432e-9ea9-2c9e3dc6d16a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:34.843007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2e10c49-9206-432e-9ea9-2c9e3dc6d16a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:34.858845 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-b2e10c49-9206-432e-9ea9-2c9e3dc6d16a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] HTTP exception thrown: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b2e10c49-9206-432e-9ea9-2c9e3dc6d16a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Request method failure captured: Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 HTTP/1.1 Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk0JnuzvtPAiYB1qYrT7OTm4ss9X-4nZ-pZZpIQOnLeFLX82PDM4AfRZwC4DXf32c9v6BcrO9RzbnLlAFOp4cBEbow-SaTUs2aHqPYBd3m-aebWTBDKhuXNb695bnAlmS9mRCNiFKLZCZ1PyYrhqUpxtm0QuMyggQEDIK-Lzje0hSI Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 3977c93857c3448a9c51227abad2ecfb Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:34.860803 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:34.862066 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3977c93857c3448a9c51227abad2ecfb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3977c93857c3448a9c51227abad2ecfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3977c93857c3448a9c51227abad2ecfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3977c93857c3448a9c51227abad2ecfb"}]}] Oct 10 18:50:34.862066 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:34.862066 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 3977c93857c3448a9c51227abad2ecfb Oct 10 18:50:34.862066 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:34.862066 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-DeleteServersAdminTestJSON-34767308-project Oct 10 18:50:34.862066 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:34.862066 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:34.862066 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 162d1d44a68b4ce69b2eaf4627974335 Oct 10 18:50:34.862066 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-DeleteServersAdminTestJSON-34767308-project Oct 10 18:50:34.862066 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:34.862066 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.862066 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '907f0a12-5167-416e-a0a7-b1e3a398ebe3'} Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:34.862757 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.863877 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.868585 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b2e10c49-9206-432e-9ea9-2c9e3dc6d16a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Returning 404 to user: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:34.869752 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b2e10c49-9206-432e-9ea9-2c9e3dc6d16a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "DELETE /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 404 len: 111 microversion: 2.1 time: 0.049228 Oct 10 18:50:34.879407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b8ba96e1-39c1-4d61-85a2-f606508d77f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:34.880192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b8ba96e1-39c1-4d61-85a2-f606508d77f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: 907f0a12-5167-416e-a0a7-b1e3a398ebe3] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:34.885053 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 180/321] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:50:34 2022] DELETE /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:34.888844 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8ba96e1-39c1-4d61-85a2-f606508d77f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:34.889599 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8ba96e1-39c1-4d61-85a2-f606508d77f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:34.890186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8ba96e1-39c1-4d61-85a2-f606508d77f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:34.891092 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8ba96e1-39c1-4d61-85a2-f606508d77f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:34.891691 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8ba96e1-39c1-4d61-85a2-f606508d77f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:34.892264 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8ba96e1-39c1-4d61-85a2-f606508d77f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:34.910264 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-b8ba96e1-39c1-4d61-85a2-f606508d77f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] HTTP exception thrown: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b8ba96e1-39c1-4d61-85a2-f606508d77f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Request method failure captured: Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 HTTP/1.1 Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGk0JnuzvtPAiYB1qYrT7OTm4ss9X-4nZ-pZZpIQOnLeFLX82PDM4AfRZwC4DXf32c9v6BcrO9RzbnLlAFOp4cBEbow-SaTUs2aHqPYBd3m-aebWTBDKhuXNb695bnAlmS9mRCNiFKLZCZ1PyYrhqUpxtm0QuMyggQEDIK-Lzje0hSI Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 3977c93857c3448a9c51227abad2ecfb Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:50:34.911970 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:50:34.916443 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3977c93857c3448a9c51227abad2ecfb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3977c93857c3448a9c51227abad2ecfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3977c93857c3448a9c51227abad2ecfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3977c93857c3448a9c51227abad2ecfb"}]}] Oct 10 18:50:34.916443 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:34.916443 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 3977c93857c3448a9c51227abad2ecfb Oct 10 18:50:34.916443 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:34.916443 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersAdminTestJSON-34767308-project Oct 10 18:50:34.916443 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:34.916443 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:34.916443 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 162d1d44a68b4ce69b2eaf4627974335 Oct 10 18:50:34.916443 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersAdminTestJSON-34767308-project Oct 10 18:50:34.916443 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:34.916443 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.916443 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '907f0a12-5167-416e-a0a7-b1e3a398ebe3'} Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:34.920402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. Oct 10 18:50:34.921651 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.922667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b8ba96e1-39c1-4d61-85a2-f606508d77f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Returning 404 to user: Instance 907f0a12-5167-416e-a0a7-b1e3a398ebe3 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:34.922667 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b8ba96e1-39c1-4d61-85a2-f606508d77f6 tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3" status: 404 len: 111 microversion: 2.1 time: 0.041011 Oct 10 18:50:34.922667 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 142/322] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:34 2022] GET /compute/v2.1/servers/907f0a12-5167-416e-a0a7-b1e3a398ebe3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:34.928298 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d8f49d75-960f-4157-84c5-a145ab6bdb8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:34.929044 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d8f49d75-960f-4157-84c5-a145ab6bdb8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:34.937781 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8f49d75-960f-4157-84c5-a145ab6bdb8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:34.938525 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8f49d75-960f-4157-84c5-a145ab6bdb8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:34.940913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8f49d75-960f-4157-84c5-a145ab6bdb8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:34.941839 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8f49d75-960f-4157-84c5-a145ab6bdb8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:34.944702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8f49d75-960f-4157-84c5-a145ab6bdb8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:34.944702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8f49d75-960f-4157-84c5-a145ab6bdb8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:34.963903 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-d8f49d75-960f-4157-84c5-a145ab6bdb8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] HTTP exception thrown: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d8f49d75-960f-4157-84c5-a145ab6bdb8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Request method failure captured: Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c HTTP/1.1 Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk0JnuzvtPAiYB1qYrT7OTm4ss9X-4nZ-pZZpIQOnLeFLX82PDM4AfRZwC4DXf32c9v6BcrO9RzbnLlAFOp4cBEbow-SaTUs2aHqPYBd3m-aebWTBDKhuXNb695bnAlmS9mRCNiFKLZCZ1PyYrhqUpxtm0QuMyggQEDIK-Lzje0hSI Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 3977c93857c3448a9c51227abad2ecfb Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:34.965518 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:34.966791 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3977c93857c3448a9c51227abad2ecfb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3977c93857c3448a9c51227abad2ecfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3977c93857c3448a9c51227abad2ecfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3977c93857c3448a9c51227abad2ecfb"}]}] Oct 10 18:50:34.966791 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:34.966791 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 3977c93857c3448a9c51227abad2ecfb Oct 10 18:50:34.966791 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:34.966791 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-DeleteServersAdminTestJSON-34767308-project Oct 10 18:50:34.966791 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:34.966791 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:34.966791 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 162d1d44a68b4ce69b2eaf4627974335 Oct 10 18:50:34.966791 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-DeleteServersAdminTestJSON-34767308-project Oct 10 18:50:34.966791 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:34.966791 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:34.966791 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'd9fa1631-80e1-46e3-80f8-907534151a0c'} Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:34.967489 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:34.968659 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:34.969840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d8f49d75-960f-4157-84c5-a145ab6bdb8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Returning 404 to user: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:34.969840 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d8f49d75-960f-4157-84c5-a145ab6bdb8a tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 404 len: 111 microversion: 2.1 time: 0.042574 Oct 10 18:50:34.971665 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 181/323] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:50:34 2022] DELETE /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:34.975979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ce1c5c86-689d-4fe2-b755-5777a5188c0b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:34.976629 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ce1c5c86-689d-4fe2-b755-5777a5188c0b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] [instance: d9fa1631-80e1-46e3-80f8-907534151a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:34.986850 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce1c5c86-689d-4fe2-b755-5777a5188c0b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:34.986850 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce1c5c86-689d-4fe2-b755-5777a5188c0b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:34.986850 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce1c5c86-689d-4fe2-b755-5777a5188c0b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:34.986850 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce1c5c86-689d-4fe2-b755-5777a5188c0b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:34.987166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce1c5c86-689d-4fe2-b755-5777a5188c0b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:34.987166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce1c5c86-689d-4fe2-b755-5777a5188c0b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:35.000713 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-ce1c5c86-689d-4fe2-b755-5777a5188c0b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] HTTP exception thrown: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ce1c5c86-689d-4fe2-b755-5777a5188c0b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Request method failure captured: Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c HTTP/1.1 Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGk0JnuzvtPAiYB1qYrT7OTm4ss9X-4nZ-pZZpIQOnLeFLX82PDM4AfRZwC4DXf32c9v6BcrO9RzbnLlAFOp4cBEbow-SaTUs2aHqPYBd3m-aebWTBDKhuXNb695bnAlmS9mRCNiFKLZCZ1PyYrhqUpxtm0QuMyggQEDIK-Lzje0hSI Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 3977c93857c3448a9c51227abad2ecfb Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:50:35.002238 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:50:35.003763 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3977c93857c3448a9c51227abad2ecfb", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3977c93857c3448a9c51227abad2ecfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3977c93857c3448a9c51227abad2ecfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3977c93857c3448a9c51227abad2ecfb"}]}] Oct 10 18:50:35.003763 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:35.003763 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 3977c93857c3448a9c51227abad2ecfb Oct 10 18:50:35.003763 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-34767308 Oct 10 18:50:35.003763 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersAdminTestJSON-34767308-project Oct 10 18:50:35.003763 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:35.003763 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:35.003763 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 162d1d44a68b4ce69b2eaf4627974335 Oct 10 18:50:35.003763 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersAdminTestJSON-34767308-project Oct 10 18:50:35.003763 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:35.003763 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:35.003763 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'd9fa1631-80e1-46e3-80f8-907534151a0c'} Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:35.004475 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. Oct 10 18:50:35.005691 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:35.006804 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ce1c5c86-689d-4fe2-b755-5777a5188c0b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] Returning 404 to user: Instance d9fa1631-80e1-46e3-80f8-907534151a0c could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:35.008004 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ce1c5c86-689d-4fe2-b755-5777a5188c0b tempest-DeleteServersAdminTestJSON-34767308 tempest-DeleteServersAdminTestJSON-34767308-project] 10.222.0.43 "GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c" status: 404 len: 111 microversion: 2.1 time: 0.036036 Oct 10 18:50:35.008643 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 143/324] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:34 2022] GET /compute/v2.1/servers/d9fa1631-80e1-46e3-80f8-907534151a0c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:35.148996 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9063b45d-1839-4cb6-9bd0-78fa17f9dece tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:35.149643 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9063b45d-1839-4cb6-9bd0-78fa17f9dece tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:35.158336 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9063b45d-1839-4cb6-9bd0-78fa17f9dece tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:35.159351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9063b45d-1839-4cb6-9bd0-78fa17f9dece tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:35.159986 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9063b45d-1839-4cb6-9bd0-78fa17f9dece tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:35.161027 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9063b45d-1839-4cb6-9bd0-78fa17f9dece tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:35.161689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9063b45d-1839-4cb6-9bd0-78fa17f9dece tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:35.162333 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9063b45d-1839-4cb6-9bd0-78fa17f9dece tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:35.230813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9063b45d-1839-4cb6-9bd0-78fa17f9dece tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:35.240462 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9063b45d-1839-4cb6-9bd0-78fa17f9dece tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:35.242209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9063b45d-1839-4cb6-9bd0-78fa17f9dece tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:35.247996 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9063b45d-1839-4cb6-9bd0-78fa17f9dece tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.105535 Oct 10 18:50:35.248675 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 182/325] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:35 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:35.305389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-724f41eb-b7f0-46b5-a210-96e6c2cd1c2f tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:35.306145 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-724f41eb-b7f0-46b5-a210-96e6c2cd1c2f tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:35.313239 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-724f41eb-b7f0-46b5-a210-96e6c2cd1c2f tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:35.313805 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-724f41eb-b7f0-46b5-a210-96e6c2cd1c2f tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:35.314300 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-724f41eb-b7f0-46b5-a210-96e6c2cd1c2f tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:35.315064 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-724f41eb-b7f0-46b5-a210-96e6c2cd1c2f tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:35.315601 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-724f41eb-b7f0-46b5-a210-96e6c2cd1c2f tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:35.316067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-724f41eb-b7f0-46b5-a210-96e6c2cd1c2f tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:35.492951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f08e8d75-2e69-4b01-b125-14bfaed27d22 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:35.495350 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f08e8d75-2e69-4b01-b125-14bfaed27d22 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:35.510040 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f08e8d75-2e69-4b01-b125-14bfaed27d22 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:35.512297 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f08e8d75-2e69-4b01-b125-14bfaed27d22 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:35.513945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f08e8d75-2e69-4b01-b125-14bfaed27d22 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:35.515347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f08e8d75-2e69-4b01-b125-14bfaed27d22 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:35.516027 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f08e8d75-2e69-4b01-b125-14bfaed27d22 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:35.516716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f08e8d75-2e69-4b01-b125-14bfaed27d22 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:35.601367 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-724f41eb-b7f0-46b5-a210-96e6c2cd1c2f tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:35.610694 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-724f41eb-b7f0-46b5-a210-96e6c2cd1c2f tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1536 microversion: 2.1 time: 0.309034 Oct 10 18:50:35.638087 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 144/326] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:35 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1536 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:35.659259 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4afccc45-4954-4d88-a2d6-9160c76abab5 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Action: 'create', calling method: .version_select at 0x7f318e7efee0>, body: {"pool": "f1d4af5b-71b6-463b-9712-d164bf8b9149"} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:35.997466 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f08e8d75-2e69-4b01-b125-14bfaed27d22 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:36.006486 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f08e8d75-2e69-4b01-b125-14bfaed27d22 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1323 microversion: 2.1 time: 0.519207 Oct 10 18:50:36.009195 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 183/327] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:35 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1323 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:50:36.275808 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e1de1d09-e991-4a8d-918e-a743ed884c2e tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:36.276528 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e1de1d09-e991-4a8d-918e-a743ed884c2e tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:36.284233 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1de1d09-e991-4a8d-918e-a743ed884c2e tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:36.285066 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1de1d09-e991-4a8d-918e-a743ed884c2e tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:36.285760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1de1d09-e991-4a8d-918e-a743ed884c2e tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:36.286920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1de1d09-e991-4a8d-918e-a743ed884c2e tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:36.287604 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1de1d09-e991-4a8d-918e-a743ed884c2e tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:36.288242 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1de1d09-e991-4a8d-918e-a743ed884c2e tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:36.378921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e1de1d09-e991-4a8d-918e-a743ed884c2e tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:36.388018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e1de1d09-e991-4a8d-918e-a743ed884c2e tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:36.394228 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e1de1d09-e991-4a8d-918e-a743ed884c2e tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:36.405932 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e1de1d09-e991-4a8d-918e-a743ed884c2e tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.133820 Oct 10 18:50:36.420562 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 184/328] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:36 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:50:37.035357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2de23854-05cd-4357-accc-5fd8a6b30851 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:37.036870 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2de23854-05cd-4357-accc-5fd8a6b30851 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:37.046226 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2de23854-05cd-4357-accc-5fd8a6b30851 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:37.046972 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2de23854-05cd-4357-accc-5fd8a6b30851 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:37.047635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2de23854-05cd-4357-accc-5fd8a6b30851 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:37.048586 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2de23854-05cd-4357-accc-5fd8a6b30851 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:37.049445 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2de23854-05cd-4357-accc-5fd8a6b30851 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:37.050844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2de23854-05cd-4357-accc-5fd8a6b30851 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:37.096407 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:37.346016 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2de23854-05cd-4357-accc-5fd8a6b30851 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:37.365109 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2de23854-05cd-4357-accc-5fd8a6b30851 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1323 microversion: 2.1 time: 0.337128 Oct 10 18:50:37.365948 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 185/329] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:37 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1323 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:50:37.437350 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a33fc4ad-4c83-4bf9-81ef-77b225327cc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:37.437951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a33fc4ad-4c83-4bf9-81ef-77b225327cc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:37.443936 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a33fc4ad-4c83-4bf9-81ef-77b225327cc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:37.444700 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a33fc4ad-4c83-4bf9-81ef-77b225327cc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:37.445131 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a33fc4ad-4c83-4bf9-81ef-77b225327cc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:37.446023 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a33fc4ad-4c83-4bf9-81ef-77b225327cc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:37.446478 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a33fc4ad-4c83-4bf9-81ef-77b225327cc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:37.446900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a33fc4ad-4c83-4bf9-81ef-77b225327cc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:37.563473 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a33fc4ad-4c83-4bf9-81ef-77b225327cc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:37.573223 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a33fc4ad-4c83-4bf9-81ef-77b225327cc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:37.575499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a33fc4ad-4c83-4bf9-81ef-77b225327cc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:37.581859 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a33fc4ad-4c83-4bf9-81ef-77b225327cc4 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.148576 Oct 10 18:50:37.582874 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 186/330] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:37 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:50:37.849489 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=16 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:38.387589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f51fc809-d282-478f-a3a7-85d7977c85d1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:38.388034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f51fc809-d282-478f-a3a7-85d7977c85d1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:38.400930 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f51fc809-d282-478f-a3a7-85d7977c85d1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:38.401791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f51fc809-d282-478f-a3a7-85d7977c85d1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:38.402886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f51fc809-d282-478f-a3a7-85d7977c85d1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:38.403829 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f51fc809-d282-478f-a3a7-85d7977c85d1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:38.404512 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f51fc809-d282-478f-a3a7-85d7977c85d1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:38.405179 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f51fc809-d282-478f-a3a7-85d7977c85d1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:38.787155 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4afccc45-4954-4d88-a2d6-9160c76abab5 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.135202 Oct 10 18:50:38.787748 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 145/331] 10.222.0.43 () {60 vars in 1170 bytes} [Mon Oct 10 18:50:35 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:38.792442 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0f04465f-7388-4d36-a859-a9c4ebaac4a9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:38.795739 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0f04465f-7388-4d36-a859-a9c4ebaac4a9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:38.806327 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f04465f-7388-4d36-a859-a9c4ebaac4a9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:38.806815 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f04465f-7388-4d36-a859-a9c4ebaac4a9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:38.807298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f04465f-7388-4d36-a859-a9c4ebaac4a9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:38.808015 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f04465f-7388-4d36-a859-a9c4ebaac4a9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:38.808582 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f04465f-7388-4d36-a859-a9c4ebaac4a9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:38.809358 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f04465f-7388-4d36-a859-a9c4ebaac4a9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:38.927479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0f04465f-7388-4d36-a859-a9c4ebaac4a9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:38.935675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0f04465f-7388-4d36-a859-a9c4ebaac4a9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:38.937158 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0f04465f-7388-4d36-a859-a9c4ebaac4a9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:38.948058 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0f04465f-7388-4d36-a859-a9c4ebaac4a9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.159104 Oct 10 18:50:38.949022 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 146/332] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:38 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:38.955390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-970bfe09-fe03-40b7-9d8e-88a5b58aa99a tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Action: 'action', calling method: .version_select at 0x7f31906a18b0>, body: {"addFloatingIp": {"address": "172.25.5.17"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:38.961901 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-970bfe09-fe03-40b7-9d8e-88a5b58aa99a tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:38.969418 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-970bfe09-fe03-40b7-9d8e-88a5b58aa99a tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:38.969911 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-970bfe09-fe03-40b7-9d8e-88a5b58aa99a tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:38.970420 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-970bfe09-fe03-40b7-9d8e-88a5b58aa99a tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:38.971235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-970bfe09-fe03-40b7-9d8e-88a5b58aa99a tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:38.971763 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-970bfe09-fe03-40b7-9d8e-88a5b58aa99a tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:38.972277 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-970bfe09-fe03-40b7-9d8e-88a5b58aa99a tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:38.972415 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f51fc809-d282-478f-a3a7-85d7977c85d1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:38.980887 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f51fc809-d282-478f-a3a7-85d7977c85d1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1323 microversion: 2.1 time: 0.596930 Oct 10 18:50:38.989012 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 187/333] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:38 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1323 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:50:39.071789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-970bfe09-fe03-40b7-9d8e-88a5b58aa99a tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "refresh_cache-f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 18:50:39.072208 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-970bfe09-fe03-40b7-9d8e-88a5b58aa99a tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquired lock "refresh_cache-f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 18:50:39.976034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ea135b2f-17b7-4667-9064-a4f29ad963ea tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:39.976738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ea135b2f-17b7-4667-9064-a4f29ad963ea tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:39.978626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:39.993386 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea135b2f-17b7-4667-9064-a4f29ad963ea tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:39.994396 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea135b2f-17b7-4667-9064-a4f29ad963ea tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:39.996953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea135b2f-17b7-4667-9064-a4f29ad963ea tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:39.997835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea135b2f-17b7-4667-9064-a4f29ad963ea tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:40.003638 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea135b2f-17b7-4667-9064-a4f29ad963ea tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:40.004440 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea135b2f-17b7-4667-9064-a4f29ad963ea tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:40.163797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ea135b2f-17b7-4667-9064-a4f29ad963ea tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:40.175998 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ea135b2f-17b7-4667-9064-a4f29ad963ea tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:40.180172 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ea135b2f-17b7-4667-9064-a4f29ad963ea tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:40.203172 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ea135b2f-17b7-4667-9064-a4f29ad963ea tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.231706 Oct 10 18:50:40.203935 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 188/334] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:39 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:50:40.231049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-db859b98-eb1e-4486-836b-f0ca54e21e65 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:40.231791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-db859b98-eb1e-4486-836b-f0ca54e21e65 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:40.238196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db859b98-eb1e-4486-836b-f0ca54e21e65 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:40.238914 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db859b98-eb1e-4486-836b-f0ca54e21e65 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:40.239540 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db859b98-eb1e-4486-836b-f0ca54e21e65 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:40.240426 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db859b98-eb1e-4486-836b-f0ca54e21e65 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:40.241206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db859b98-eb1e-4486-836b-f0ca54e21e65 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:40.242113 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db859b98-eb1e-4486-836b-f0ca54e21e65 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:40.500444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-db859b98-eb1e-4486-836b-f0ca54e21e65 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:40.510628 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-db859b98-eb1e-4486-836b-f0ca54e21e65 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1323 microversion: 2.1 time: 0.288558 Oct 10 18:50:40.512068 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 189/335] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:40 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:40.532378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-d25ea782-fef5-41f9-8bfb-28bc7f0b8ad1 req-2c7c3774-f139-450f-8e67-7161c11382b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0af7e1f-fea0-4343-9d8d-4ca0f78c1948", "name": "network-vif-plugged", "status": "completed", "tag": "c9a0326e-ae77-42a1-8db7-434146a99516"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:40.558136 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d25ea782-fef5-41f9-8bfb-28bc7f0b8ad1 req-2c7c3774-f139-450f-8e67-7161c11382b5 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:40.558858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d25ea782-fef5-41f9-8bfb-28bc7f0b8ad1 req-2c7c3774-f139-450f-8e67-7161c11382b5 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:40.559507 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d25ea782-fef5-41f9-8bfb-28bc7f0b8ad1 req-2c7c3774-f139-450f-8e67-7161c11382b5 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:40.578019 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-d25ea782-fef5-41f9-8bfb-28bc7f0b8ad1 req-2c7c3774-f139-450f-8e67-7161c11382b5 service nova] Creating event network-vif-plugged:c9a0326e-ae77-42a1-8db7-434146a99516 for instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 on n-h2-860863-1 Oct 10 18:50:40.590423 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-d25ea782-fef5-41f9-8bfb-28bc7f0b8ad1 req-2c7c3774-f139-450f-8e67-7161c11382b5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068676 Oct 10 18:50:40.591602 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 190/336] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:41.238116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e16c231c-4516-470a-b09e-cf28e467c631 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:41.240110 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e16c231c-4516-470a-b09e-cf28e467c631 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:41.257752 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e16c231c-4516-470a-b09e-cf28e467c631 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:41.259416 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e16c231c-4516-470a-b09e-cf28e467c631 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:41.261456 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e16c231c-4516-470a-b09e-cf28e467c631 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:41.262941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e16c231c-4516-470a-b09e-cf28e467c631 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:41.263814 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e16c231c-4516-470a-b09e-cf28e467c631 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:41.266358 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e16c231c-4516-470a-b09e-cf28e467c631 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:41.854997 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-970bfe09-fe03-40b7-9d8e-88a5b58aa99a tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Building network info cache for instance {{(pid=127289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 18:50:41.979139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e16c231c-4516-470a-b09e-cf28e467c631 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:41.995311 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e16c231c-4516-470a-b09e-cf28e467c631 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:42.003537 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e16c231c-4516-470a-b09e-cf28e467c631 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:42.019370 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e16c231c-4516-470a-b09e-cf28e467c631 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.786638 Oct 10 18:50:42.022666 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 191/337] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:41 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:50:42.034539 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-22c9ae07-4b4d-48e3-a6db-dbcb3059119e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:42.036665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-22c9ae07-4b4d-48e3-a6db-dbcb3059119e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:42.053776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c9ae07-4b4d-48e3-a6db-dbcb3059119e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:42.054818 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c9ae07-4b4d-48e3-a6db-dbcb3059119e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:42.057666 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c9ae07-4b4d-48e3-a6db-dbcb3059119e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:42.060702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c9ae07-4b4d-48e3-a6db-dbcb3059119e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:42.061209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c9ae07-4b4d-48e3-a6db-dbcb3059119e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:42.063090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c9ae07-4b4d-48e3-a6db-dbcb3059119e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:42.427258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-22c9ae07-4b4d-48e3-a6db-dbcb3059119e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:42.438825 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-22c9ae07-4b4d-48e3-a6db-dbcb3059119e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1323 microversion: 2.1 time: 0.411098 Oct 10 18:50:42.440490 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 192/338] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:42 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1323 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:42.446210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-008f2494-044a-46b6-9d21-f5eaf952910e req-29a89fbd-83da-4d45-be3c-7521315664d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a71922-7bbf-4415-b3f5-2c2716b7c7c1", "tag": "c279876a-95a9-436e-bc98-b4a82d21aa0b"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:42.458149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-008f2494-044a-46b6-9d21-f5eaf952910e req-29a89fbd-83da-4d45-be3c-7521315664d6 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:42.458880 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-008f2494-044a-46b6-9d21-f5eaf952910e req-29a89fbd-83da-4d45-be3c-7521315664d6 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:42.459468 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-008f2494-044a-46b6-9d21-f5eaf952910e req-29a89fbd-83da-4d45-be3c-7521315664d6 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:42.472320 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-008f2494-044a-46b6-9d21-f5eaf952910e req-29a89fbd-83da-4d45-be3c-7521315664d6 service nova] Creating event network-changed:c279876a-95a9-436e-bc98-b4a82d21aa0b for instance f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 on n-h1-860863-1 Oct 10 18:50:42.479979 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-008f2494-044a-46b6-9d21-f5eaf952910e req-29a89fbd-83da-4d45-be3c-7521315664d6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037947 Oct 10 18:50:42.481346 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 193/339] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:42.966741 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-154e0c6f-50de-4635-aadf-be66c31980d4 tempest-FlavorsV261TestJSON-1105918562 tempest-FlavorsV261TestJSON-1105918562-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-125669841", "id": 1878757306, "os-flavor-access:is_public": "True"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:43.061155 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-154e0c6f-50de-4635-aadf-be66c31980d4 tempest-FlavorsV261TestJSON-1105918562 tempest-FlavorsV261TestJSON-1105918562-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.578308 Oct 10 18:50:43.062908 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 194/340] 10.222.0.43 () {62 vars in 1188 bytes} [Mon Oct 10 18:50:42 2022] POST /compute/v2.1/flavors => generated 467 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:50:43.096587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-970bfe09-fe03-40b7-9d8e-88a5b58aa99a tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Updating instance_info_cache with network_info: [{"id": "c279876a-95a9-436e-bc98-b4a82d21aa0b", "address": "fa:16:3e:99:11:75", "network": {"id": "bc198aba-4d54-4cd2-9a46-68327b084cae", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-128063861-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d610c145b1284aa293c1f456bf476602", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc279876a-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 18:50:43.175687 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-970bfe09-fe03-40b7-9d8e-88a5b58aa99a tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Releasing lock "refresh_cache-f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 18:50:43.177694 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-970bfe09-fe03-40b7-9d8e-88a5b58aa99a tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action" status: 202 len: 0 microversion: 2.1 time: 4.227134 Oct 10 18:50:43.178312 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 147/341] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:50:38 2022] POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action => generated 0 bytes in 4229 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 18:50:43.183398 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a691e9e3-c873-4257-80bb-b5a3c75570cf tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:43.184016 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a691e9e3-c873-4257-80bb-b5a3c75570cf tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:43.200106 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a691e9e3-c873-4257-80bb-b5a3c75570cf tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:43.200635 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a691e9e3-c873-4257-80bb-b5a3c75570cf tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:43.201071 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a691e9e3-c873-4257-80bb-b5a3c75570cf tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:43.202054 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a691e9e3-c873-4257-80bb-b5a3c75570cf tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:43.203385 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a691e9e3-c873-4257-80bb-b5a3c75570cf tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:43.205655 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a691e9e3-c873-4257-80bb-b5a3c75570cf tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:43.342066 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a691e9e3-c873-4257-80bb-b5a3c75570cf tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:43.355859 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a691e9e3-c873-4257-80bb-b5a3c75570cf tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:43.358898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a691e9e3-c873-4257-80bb-b5a3c75570cf tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:43.368681 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a691e9e3-c873-4257-80bb-b5a3c75570cf tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.189123 Oct 10 18:50:43.369764 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 148/342] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:43 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:43.607955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4fb87075-05cb-4a54-b992-65be77074053 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Action: 'create', calling method: .version_select at 0x7f318e87e5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-606861748", "description": "tempest-description-1889280043"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:43.630205 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=9 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:43.842044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-591b2db9-2dd6-486f-9826-a46289f3109d tempest-FlavorsV261TestJSON-1902917372 tempest-FlavorsV261TestJSON-1902917372-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:43.856973 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-591b2db9-2dd6-486f-9826-a46289f3109d tempest-FlavorsV261TestJSON-1902917372 tempest-FlavorsV261TestJSON-1902917372-project] 10.222.0.43 "GET /compute/v2.1/flavors/1878757306" status: 200 len: 467 microversion: 2.61 time: 0.485744 Oct 10 18:50:43.857769 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 149/343] 10.222.0.43 () {60 vars in 1199 bytes} [Mon Oct 10 18:50:43 2022] GET /compute/v2.1/flavors/1878757306 => generated 467 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:50:43.869743 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cbdca17e-c247-4431-ba87-bb6e14f8c178 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Action: 'create', calling method: .version_select at 0x7f318e7efdc0>, body: {"pool": "f1d4af5b-71b6-463b-9712-d164bf8b9149"} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:44.028155 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4fb87075-05cb-4a54-b992-65be77074053 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.960027 Oct 10 18:50:44.028155 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 195/344] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:50:43 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:44.037529 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a3beae4a-f455-489c-83fa-d68737f840b5 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:44.038422 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a3beae4a-f455-489c-83fa-d68737f840b5 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:44.057018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3beae4a-f455-489c-83fa-d68737f840b5 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:44.057246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3beae4a-f455-489c-83fa-d68737f840b5 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:44.057937 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3beae4a-f455-489c-83fa-d68737f840b5 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:44.059343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3beae4a-f455-489c-83fa-d68737f840b5 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:44.061078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3beae4a-f455-489c-83fa-d68737f840b5 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:44.061668 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3beae4a-f455-489c-83fa-d68737f840b5 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:44.201630 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a3beae4a-f455-489c-83fa-d68737f840b5 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:44.209770 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a3beae4a-f455-489c-83fa-d68737f840b5 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1520 microversion: 2.1 time: 0.182214 Oct 10 18:50:44.221521 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 196/345] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:44 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:44.402225 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f1647cf8-63ed-4971-830b-7e4f7f6e4793 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1491164358", "id": 1203118925, "os-flavor-access:is_public": "True"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:44.408199 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:44.501237 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f1647cf8-63ed-4971-830b-7e4f7f6e4793 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.289668 Oct 10 18:50:44.501759 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 197/346] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:44 2022] POST /compute/v2.1/flavors => generated 430 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:44.509152 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0a248a68-43d5-4edf-88af-b3d324735138 tempest-FlavorsV261TestJSON-1105918562 tempest-FlavorsV261TestJSON-1105918562-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:44.602662 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0a248a68-43d5-4edf-88af-b3d324735138 tempest-FlavorsV261TestJSON-1105918562 tempest-FlavorsV261TestJSON-1105918562-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/1878757306" status: 200 len: 468 microversion: 2.61 time: 0.099581 Oct 10 18:50:44.612739 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 198/347] 10.222.0.43 () {62 vars in 1219 bytes} [Mon Oct 10 18:50:44 2022] PUT /compute/v2.1/flavors/1878757306 => generated 468 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:50:44.618478 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6a609b63-71ee-43da-a596-6800cd6e66ee tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Action: 'create', calling method: .version_select at 0x7f318e81a280>, body: {"security_group_rule": {"parent_group_id": "6d518de2-57eb-4841-bdff-48efd0ab90bb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:45.132797 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6a609b63-71ee-43da-a596-6800cd6e66ee tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.517976 Oct 10 18:50:45.133388 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 199/348] 10.222.0.43 () {60 vars in 1195 bytes} [Mon Oct 10 18:50:44 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:45.146030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a666ac76-eb92-4036-b802-f50be1986d71 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Action: 'create', calling method: .version_select at 0x7f318e84b280>, body: {"pool": null} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:45.439286 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cbdca17e-c247-4431-ba87-bb6e14f8c178 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.580271 Oct 10 18:50:45.446993 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 150/349] 10.222.0.43 () {60 vars in 1170 bytes} [Mon Oct 10 18:50:43 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:45.446993 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-015037d1-8a82-4169-bd70-ab16393603b1 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:45.447760 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-015037d1-8a82-4169-bd70-ab16393603b1 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:45.456057 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-015037d1-8a82-4169-bd70-ab16393603b1 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:45.456578 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-015037d1-8a82-4169-bd70-ab16393603b1 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:45.457203 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-015037d1-8a82-4169-bd70-ab16393603b1 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:45.458118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-015037d1-8a82-4169-bd70-ab16393603b1 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:45.458584 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-015037d1-8a82-4169-bd70-ab16393603b1 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:45.459016 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-015037d1-8a82-4169-bd70-ab16393603b1 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:45.528735 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-015037d1-8a82-4169-bd70-ab16393603b1 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:45.537521 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-015037d1-8a82-4169-bd70-ab16393603b1 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:45.539474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-015037d1-8a82-4169-bd70-ab16393603b1 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:45.545328 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-015037d1-8a82-4169-bd70-ab16393603b1 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.103407 Oct 10 18:50:45.546515 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 151/350] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:45 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:45.568415 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-33ed2f60-771c-4aa6-aaf8-136415b4e020 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:45.663991 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-33ed2f60-771c-4aa6-aaf8-136415b4e020 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1203118925" status: 202 len: 0 microversion: 2.1 time: 0.116148 Oct 10 18:50:45.664726 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 152/351] 10.222.0.43 () {58 vars in 1161 bytes} [Mon Oct 10 18:50:45 2022] DELETE /compute/v2.1/flavors/1203118925 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:45.846590 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-deca74a8-6643-449a-a2c0-f9e9147a4c09 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2083801020", "id": 665869340, "os-flavor-access:is_public": "False"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:45.932222 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-deca74a8-6643-449a-a2c0-f9e9147a4c09 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.266208 Oct 10 18:50:45.932871 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 153/352] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:45 2022] POST /compute/v2.1/flavors => generated 436 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:45.938258 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a8c74aed-47a6-450f-bbf8-acfaaec49016 tempest-FlavorsV261TestJSON-1902917372 tempest-FlavorsV261TestJSON-1902917372-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:45.962345 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a8c74aed-47a6-450f-bbf8-acfaaec49016 tempest-FlavorsV261TestJSON-1902917372 tempest-FlavorsV261TestJSON-1902917372-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 7157 microversion: 2.61 time: 0.027866 Oct 10 18:50:45.962895 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 154/353] 10.222.0.43 () {60 vars in 1187 bytes} [Mon Oct 10 18:50:45 2022] GET /compute/v2.1/flavors/detail => generated 7157 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:45.967484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cdbc25ff-1476-402d-860b-4d25e914420e tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Action: 'create', calling method: .version_select at 0x7f318ea4e5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1322556149", "description": "tempest-description-1994851211"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:46.291975 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cdbc25ff-1476-402d-860b-4d25e914420e tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.327897 Oct 10 18:50:46.300669 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 155/354] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:50:45 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:46.300669 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.45"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:46.301139 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:46.307102 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:46.307584 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:46.308014 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:46.308782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:46.309233 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:46.309655 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:46.334881 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "refresh_cache-f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 18:50:46.335283 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquired lock "refresh_cache-f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 18:50:46.740953 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a666ac76-eb92-4036-b802-f50be1986d71 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.598697 Oct 10 18:50:46.740953 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 200/355] 10.222.0.43 () {60 vars in 1170 bytes} [Mon Oct 10 18:50:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:46.740953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d1793e6a-260f-4b58-91d9-3b40cb8ec2f5 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:46.762877 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d1793e6a-260f-4b58-91d9-3b40cb8ec2f5 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6236 microversion: 2.1 time: 0.027312 Oct 10 18:50:46.763783 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 201/356] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:46 2022] GET /compute/v2.1/flavors/detail => generated 6236 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:46.770757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4213a950-c5d1-4940-ad0c-d3d066b47c20 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4416773dfead4be59d6aa65815c84370"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:46.845316 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:DELETE=4,nova_api:SELECT=90,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:46.915230 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4213a950-c5d1-4940-ad0c-d3d066b47c20 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/665869340/action" status: 200 len: 96 microversion: 2.1 time: 0.150383 Oct 10 18:50:46.915823 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 202/357] 10.222.0.43 () {60 vars in 1197 bytes} [Mon Oct 10 18:50:46 2022] POST /compute/v2.1/flavors/665869340/action => generated 96 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:50:46.920901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5c6c8684-bfc2-47c0-85fa-31db54ce9c1a tempest-FlavorsV261TestJSON-1902917372 tempest-FlavorsV261TestJSON-1902917372-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:46.923175 n-d-860863-1 devstack@n-api.service[127289]: DEBUG neutronclient.v2_0.client [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.5.45 (5b4009ca-9eb0-40ee-ac42-1cee8f2aa51d) with port c279876a-95a9-436e-bc98-b4a82d21aa0b using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network f1d4af5b-71b6-463b-9712-d164bf8b9149.", "detail": ""}} {{(pid=127289) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:50:46.923824 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Releasing lock "refresh_cache-f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 18:50:46.924405 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] HTTP exception thrown: Cannot associate floating IP 172.25.5.45 (5b4009ca-9eb0-40ee-ac42-1cee8f2aa51d) with port c279876a-95a9-436e-bc98-b4a82d21aa0b using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network f1d4af5b-71b6-463b-9712-d164bf8b9149. Oct 10 18:50:46.924405 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-3dfa8651-0788-409c-bb5f-2355088c3652'] Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Request method failure captured: Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action HTTP/1.1 Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 45 Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGlnAzOw3cwjSWoGabvksBE7PAMlvc1ztA75na0o-QeMrwu-fr7dk5eZInf6ScvS7dbW2x5CphxsqDbGxYRxKUayN4VcdDss6qSK0mb8EaN6pPnv5tLxGv6YKZ6dXIwKAOxiecc9u_vXL88i6HnB5ILNHIPADpc9IrOB2Z2HrTr68r4 Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: d610c145b1284aa293c1f456bf476602 Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:50:46.930713 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:50:46.932063 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d610c145b1284aa293c1f456bf476602", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d610c145b1284aa293c1f456bf476602"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d610c145b1284aa293c1f456bf476602"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d610c145b1284aa293c1f456bf476602"}]}] Oct 10 18:50:46.932063 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:46.932063 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: d610c145b1284aa293c1f456bf476602 Oct 10 18:50:46.932063 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:46.932063 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project Oct 10 18:50:46.932063 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:46.932063 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:46.932063 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 831696709a6b473fbd54b99883d38c8d Oct 10 18:50:46.932063 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project Oct 10 18:50:46.932063 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:50:46.932063 n-d-860863-1 devstack@n-api.service[127289]: {"addFloatingIp": {"address": "172.25.5.45"}} Oct 10 18:50:46.932063 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: exception: Cannot associate floating IP 172.25.5.45 (5b4009ca-9eb0-40ee-ac42-1cee8f2aa51d) with port c279876a-95a9-436e-bc98-b4a82d21aa0b using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network f1d4af5b-71b6-463b-9712-d164bf8b9149. Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-3dfa8651-0788-409c-bb5f-2355088c3652'] Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'f5a71922-7bbf-4415-b3f5-2c2716b7c7c1', 'body': {'addFloatingIp': {'address': '172.25.5.45'}}} Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:50:46.932928 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:50:46.934445 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.5.45 (5b4009ca-9eb0-40ee-ac42-1cee8f2aa51d) with port c279876a-95a9-436e-bc98-b4a82d21aa0b using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network f1d4af5b-71b6-463b-9712-d164bf8b9149. Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dfa8651-0788-409c-bb5f-2355088c3652'] Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.5.45 (5b4009ca-9eb0-40ee-ac42-1cee8f2aa51d) with port c279876a-95a9-436e-bc98-b4a82d21aa0b using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network f1d4af5b-71b6-463b-9712-d164bf8b9149. Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dfa8651-0788-409c-bb5f-2355088c3652'] Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:46.935413 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.5.45 (5b4009ca-9eb0-40ee-ac42-1cee8f2aa51d) with port c279876a-95a9-436e-bc98-b4a82d21aa0b using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network f1d4af5b-71b6-463b-9712-d164bf8b9149. Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dfa8651-0788-409c-bb5f-2355088c3652'] Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:46.936355 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:46.943373 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:46.943373 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:46.943373 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:46.943373 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:46.943373 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:46.943373 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:46.943373 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.5.45 (5b4009ca-9eb0-40ee-ac42-1cee8f2aa51d) with port c279876a-95a9-436e-bc98-b4a82d21aa0b using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network f1d4af5b-71b6-463b-9712-d164bf8b9149. Oct 10 18:50:46.943373 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3dfa8651-0788-409c-bb5f-2355088c3652'] Oct 10 18:50:46.943373 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:46.943373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Returning 400 to user: Cannot associate floating IP 172.25.5.45 (5b4009ca-9eb0-40ee-ac42-1cee8f2aa51d) with port c279876a-95a9-436e-bc98-b4a82d21aa0b using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network f1d4af5b-71b6-463b-9712-d164bf8b9149. Oct 10 18:50:46.943373 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-3dfa8651-0788-409c-bb5f-2355088c3652'] {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:46.944086 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b0e6d5a9-3172-4d38-b209-a2c637c1d577 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action" status: 400 len: 381 microversion: 2.1 time: 0.637801 Oct 10 18:50:46.944086 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 156/358] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:50:46 2022] POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action => generated 381 bytes in 639 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:50:46.944086 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-39bdf759-4efb-4377-b07b-37a1f96e83f5 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Action: 'create', calling method: .version_select at 0x7f318e674280>, body: {"security_group_rule": {"parent_group_id": "6a73c828-c516-47b5-bb03-a418461809e8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:46.944335 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5c6c8684-bfc2-47c0-85fa-31db54ce9c1a tempest-FlavorsV261TestJSON-1902917372 tempest-FlavorsV261TestJSON-1902917372-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 3684 microversion: 2.61 time: 0.027311 Oct 10 18:50:46.944914 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 203/359] 10.222.0.43 () {60 vars in 1166 bytes} [Mon Oct 10 18:50:46 2022] GET /compute/v2.1/flavors => generated 3684 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:46.950300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-997dc62d-3bf1-4c51-b3c2-475e49689bd2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:46.950882 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-997dc62d-3bf1-4c51-b3c2-475e49689bd2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:46.957578 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-997dc62d-3bf1-4c51-b3c2-475e49689bd2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:46.958062 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-997dc62d-3bf1-4c51-b3c2-475e49689bd2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:46.958488 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-997dc62d-3bf1-4c51-b3c2-475e49689bd2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:46.959175 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-997dc62d-3bf1-4c51-b3c2-475e49689bd2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:46.959620 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-997dc62d-3bf1-4c51-b3c2-475e49689bd2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:46.960036 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-997dc62d-3bf1-4c51-b3c2-475e49689bd2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:47.022926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-997dc62d-3bf1-4c51-b3c2-475e49689bd2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:47.031176 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-997dc62d-3bf1-4c51-b3c2-475e49689bd2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:47.032790 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-997dc62d-3bf1-4c51-b3c2-475e49689bd2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:47.037472 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-997dc62d-3bf1-4c51-b3c2-475e49689bd2 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1446 microversion: 2.75 time: 0.091601 Oct 10 18:50:47.038032 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 204/360] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:46 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:47.042250 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c1deb152-4d09-4acd-8877-e86d6571c8aa tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1514687852", "id": 476683145, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:47.142216 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c1deb152-4d09-4acd-8877-e86d6571c8aa tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.103098 Oct 10 18:50:47.143181 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 205/361] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:47 2022] POST /compute/v2.1/flavors => generated 414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:47.155376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1211192789", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "c5f3fcff-69f9-404c-aeaa-2f1924041f8b"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:47.210319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] validate_networks() for [('c5f3fcff-69f9-404c-aeaa-2f1924041f8b', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:50:47.328754 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-39bdf759-4efb-4377-b07b-37a1f96e83f5 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.389912 Oct 10 18:50:47.340176 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 157/362] 10.222.0.43 () {60 vars in 1195 bytes} [Mon Oct 10 18:50:46 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:47.345719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fff8fa8e-b89e-4f02-ac08-b523bf10c043 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4416773dfead4be59d6aa65815c84370"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:47.473896 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-fff8fa8e-b89e-4f02-ac08-b523bf10c043 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] HTTP exception thrown: Flavor access already exists for flavor 22 and project 4416773dfead4be59d6aa65815c84370 combination. Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fff8fa8e-b89e-4f02-ac08-b523bf10c043 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Request method failure captured: Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/flavors/665869340/action HTTP/1.1 Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 67 Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmDbG6szSt2eSH_HjFJJBuJnzoN-jpHMxOguqBEYvUxe6Wauko0CoKFVCud3AAO2_ztiHLgVX0G7b9hJ-nfG5N8mMdK7QwEQqoSkKR601B06Gu0R1Atxb4vD8h74NzK4rpJGiKr7ymwMKH--0QpE5YGv_usblRSLkDGO5wfsn-MEoE Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 7cb0fa5676524795b1e25892a1846c11 Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1086239416 Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:47.477276 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:47.479038 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7cb0fa5676524795b1e25892a1846c11", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7cb0fa5676524795b1e25892a1846c11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7cb0fa5676524795b1e25892a1846c11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7cb0fa5676524795b1e25892a1846c11"}]}] Oct 10 18:50:47.479038 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1086239416 Oct 10 18:50:47.479038 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 7cb0fa5676524795b1e25892a1846c11 Oct 10 18:50:47.479038 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1086239416 Oct 10 18:50:47.479038 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin Oct 10 18:50:47.479038 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:47.479038 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:47.479038 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: cc5e5a2cd9cc4d74bb20565d8461881d Oct 10 18:50:47.479038 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin Oct 10 18:50:47.479038 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:50:47.479038 n-d-860863-1 devstack@n-api.service[127289]: {"addTenantAccess": {"tenant": "4416773dfead4be59d6aa65815c84370"}} Oct 10 18:50:47.479038 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: exception: Flavor access already exists for flavor 22 and project 4416773dfead4be59d6aa65815c84370 combination. Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '665869340', 'body': {'addTenantAccess': {'tenant': '4416773dfead4be59d6aa65815c84370'}}} Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result.read() Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 18:50:47.480507 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '22-4416773dfead4be59d6aa65815c84370' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi session.flush() Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 18:50:47.481786 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 18:50:47.483468 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 18:50:47.485213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result.read() Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '22-4416773dfead4be59d6aa65815c84370' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 10, 18, 50, 47, 430564), 'updated_at': None, 'flavor_id': 22, 'project_id': '4416773dfead4be59d6aa65815c84370'}] Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:47.486434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 22 and project 4416773dfead4be59d6aa65815c84370 combination. Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:47.487687 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 22 and project 4416773dfead4be59d6aa65815c84370 combination. Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:47.489015 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:47.490394 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 22 and project 4416773dfead4be59d6aa65815c84370 combination. Oct 10 18:50:47.490394 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:47.490394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fff8fa8e-b89e-4f02-ac08-b523bf10c043 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Returning 409 to user: Flavor access already exists for flavor 22 and project 4416773dfead4be59d6aa65815c84370 combination. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:47.490394 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fff8fa8e-b89e-4f02-ac08-b523bf10c043 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/665869340/action" status: 409 len: 152 microversion: 2.1 time: 0.137156 Oct 10 18:50:47.490394 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 158/363] 10.222.0.43 () {60 vars in 1197 bytes} [Mon Oct 10 18:50:47 2022] POST /compute/v2.1/flavors/665869340/action => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:47.490394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-74e677f3-855a-4c32-9f64-91d059c671fb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '.version_select at 0x7f318e674550>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:47.811810 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:50:47.812369 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:50:47.812756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:50:47.813162 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:50:47.813568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:50:47.822577 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:47.822979 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:47.823409 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:47.824159 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:47.824803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:47.825224 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:47.852806 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Getting quotas for project 38266e43742d4a9598d44340cac9bf92. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:50:47.858277 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Getting quotas for user fc8eaa5f3d6b44cfaff60781c3381e80 and project 38266e43742d4a9598d44340cac9bf92. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:50:47.869741 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:50:47.872188 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:50:48.015624 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4adc5dca-3e21-44d9-b68c-5b31175b90e7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870798 Oct 10 18:50:48.020711 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 206/364] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:50:48.029020 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-30fcbb7d-df8c-4e86-abdc-ac398413101f tempest-FlavorsV261TestJSON-1105918562 tempest-FlavorsV261TestJSON-1105918562-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:48.118827 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-30fcbb7d-df8c-4e86-abdc-ac398413101f tempest-FlavorsV261TestJSON-1105918562 tempest-FlavorsV261TestJSON-1105918562-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1878757306" status: 202 len: 0 microversion: 2.61 time: 0.095406 Oct 10 18:50:48.120236 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 207/365] 10.222.0.43 () {60 vars in 1202 bytes} [Mon Oct 10 18:50:48 2022] DELETE /compute/v2.1/flavors/1878757306 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:50:48.125229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-42bfa820-78ba-4e40-bc2b-b349c197eee7 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:48.148576 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-42bfa820-78ba-4e40-bc2b-b349c197eee7 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.026981 Oct 10 18:50:48.149683 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 208/366] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:48 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:48.155271 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5f217a85-6df5-4021-8c47-79bef9a4ee4e tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Action: 'create', calling method: .version_select at 0x7f318e81a670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1121153652", "description": "tempest-description-1287819567"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:48.325579 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-74e677f3-855a-4c32-9f64-91d059c671fb tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/5b4009ca-9eb0-40ee-ac42-1cee8f2aa51d" status: 202 len: 0 microversion: 2.1 time: 0.844294 Oct 10 18:50:48.326767 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 159/367] 10.222.0.43 () {58 vars in 1263 bytes} [Mon Oct 10 18:50:47 2022] DELETE /compute/v2.1/os-floating-ips/5b4009ca-9eb0-40ee-ac42-1cee8f2aa51d => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:48.331343 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ed8da92f-b682-45b2-9868-7c0f0a014e53 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4416773dfead4be59d6aa65815c84370"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:48.475566 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ed8da92f-b682-45b2-9868-7c0f0a014e53 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/665869340/action" status: 200 len: 21 microversion: 2.1 time: 0.147903 Oct 10 18:50:48.479066 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 160/368] 10.222.0.43 () {60 vars in 1197 bytes} [Mon Oct 10 18:50:48 2022] POST /compute/v2.1/flavors/665869340/action => generated 21 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:50:48.480963 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-173f1544-e691-43c8-912c-f8841f22a6bf tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:48.481584 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-173f1544-e691-43c8-912c-f8841f22a6bf tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:48.536471 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-173f1544-e691-43c8-912c-f8841f22a6bf tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:48.543740 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-173f1544-e691-43c8-912c-f8841f22a6bf tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca" status: 200 len: 1224 microversion: 2.1 time: 0.066337 Oct 10 18:50:48.553443 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 161/369] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:48 2022] GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca => generated 1224 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:48.562921 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-92b8c59e-6f88-49ba-9c49-c0b41f288781 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:48.563622 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-92b8c59e-6f88-49ba-9c49-c0b41f288781 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:48.565599 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5f217a85-6df5-4021-8c47-79bef9a4ee4e tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.414417 Oct 10 18:50:48.566217 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 209/370] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:50:48 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:48.569782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-92b8c59e-6f88-49ba-9c49-c0b41f288781 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:48.570375 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-92b8c59e-6f88-49ba-9c49-c0b41f288781 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:48.570828 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b1a70751-997f-46c8-b00c-b0bfb723bfa1 tempest-FlavorsV261TestJSON-1105918562 tempest-FlavorsV261TestJSON-1105918562-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:48.571012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-92b8c59e-6f88-49ba-9c49-c0b41f288781 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:48.571810 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-92b8c59e-6f88-49ba-9c49-c0b41f288781 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:48.572366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-92b8c59e-6f88-49ba-9c49-c0b41f288781 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:48.572915 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-92b8c59e-6f88-49ba-9c49-c0b41f288781 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:48.594832 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b1a70751-997f-46c8-b00c-b0bfb723bfa1 tempest-FlavorsV261TestJSON-1105918562 tempest-FlavorsV261TestJSON-1105918562-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 7143 microversion: 2.61 time: 0.027255 Oct 10 18:50:48.595410 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 210/371] 10.222.0.43 () {60 vars in 1187 bytes} [Mon Oct 10 18:50:48 2022] GET /compute/v2.1/flavors/detail => generated 7143 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:48.599647 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3d24a74d-5ea0-4926-9d53-1eb6180be19f tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:48.645771 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-92b8c59e-6f88-49ba-9c49-c0b41f288781 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:48.654349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-92b8c59e-6f88-49ba-9c49-c0b41f288781 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:48.655780 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-92b8c59e-6f88-49ba-9c49-c0b41f288781 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:48.660736 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-92b8c59e-6f88-49ba-9c49-c0b41f288781 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1452 microversion: 2.75 time: 0.105897 Oct 10 18:50:48.661566 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 162/372] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:48 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:48.666681 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bd38e8e0-5a67-4433-a928-5c3834efcd5c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Action: 'action', calling method: .version_select at 0x7f31906a1a60>, body: {"removeFloatingIp": {"address": "172.25.5.17"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:48.692279 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3d24a74d-5ea0-4926-9d53-1eb6180be19f tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/476683145" status: 202 len: 0 microversion: 2.1 time: 0.095649 Oct 10 18:50:48.694153 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 211/373] 10.222.0.43 () {58 vars in 1158 bytes} [Mon Oct 10 18:50:48 2022] DELETE /compute/v2.1/flavors/476683145 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:48.703149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-af910b7a-0245-40a8-89d6-7540b255054f tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:48.778182 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-af910b7a-0245-40a8-89d6-7540b255054f tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/665869340" status: 202 len: 0 microversion: 2.1 time: 0.082380 Oct 10 18:50:48.778937 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 212/374] 10.222.0.43 () {58 vars in 1158 bytes} [Mon Oct 10 18:50:48 2022] DELETE /compute/v2.1/flavors/665869340 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:48.784266 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9512b270-1493-4ade-9665-2e95e5fcf134 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Action: 'create', calling method: .version_select at 0x7f318e7e8790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1847115920", "description": "tempest-description-814557569"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:48.825580 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bd38e8e0-5a67-4433-a928-5c3834efcd5c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:48.831745 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bd38e8e0-5a67-4433-a928-5c3834efcd5c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:48.832231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bd38e8e0-5a67-4433-a928-5c3834efcd5c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:48.832705 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bd38e8e0-5a67-4433-a928-5c3834efcd5c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:48.833461 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bd38e8e0-5a67-4433-a928-5c3834efcd5c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:48.833898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bd38e8e0-5a67-4433-a928-5c3834efcd5c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:48.834323 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bd38e8e0-5a67-4433-a928-5c3834efcd5c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:49.039753 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bd38e8e0-5a67-4433-a928-5c3834efcd5c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "refresh_cache-f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 18:50:49.040156 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bd38e8e0-5a67-4433-a928-5c3834efcd5c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquired lock "refresh_cache-f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 18:50:49.178882 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9512b270-1493-4ade-9665-2e95e5fcf134 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.398551 Oct 10 18:50:49.180031 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 213/375] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:50:48 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:49.185039 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-374d2b5e-fd77-4119-868f-db6794f5092f tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:49.212164 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-374d2b5e-fd77-4119-868f-db6794f5092f tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.030875 Oct 10 18:50:49.212788 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 214/376] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:49 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:49.218541 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-34e75841-42d0-4f0b-9a97-01ed48c30db6 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:49.242323 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-34e75841-42d0-4f0b-9a97-01ed48c30db6 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.028280 Oct 10 18:50:49.242914 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 215/377] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:49 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:49.255432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-18c67524-a7be-4fa9-a42b-c6f8f9148729 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Action: 'create', calling method: .version_select at 0x7f318e7e8ca0>, body: {"security_group_rule": {"parent_group_id": "440d27ae-bb77-4d8c-aab8-717c86cedfab", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a06b561e-d413-42f7-8771-137eae20bdb2"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:49.804476 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-bd38e8e0-5a67-4433-a928-5c3834efcd5c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Building network info cache for instance {{(pid=127289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 18:50:49.905899 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-18c67524-a7be-4fa9-a42b-c6f8f9148729 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.660141 Oct 10 18:50:49.906571 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 216/378] 10.222.0.43 () {60 vars in 1195 bytes} [Mon Oct 10 18:50:49 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:49.911221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6967845d-a6d0-4cfe-8af5-c3271e2ae7f0 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2015898085", "id": 1034698328, "os-flavor-access:is_public": "True"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:50.030496 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6967845d-a6d0-4cfe-8af5-c3271e2ae7f0 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.122344 Oct 10 18:50:50.031599 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 217/379] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:49 2022] POST /compute/v2.1/flavors => generated 429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:50.036294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4bd9196a-ad3e-45ae-90a9-8f17cbc8539d tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1876148030", "id": 2069217390, "os-flavor-access:is_public": "True"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:50.116162 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4bd9196a-ad3e-45ae-90a9-8f17cbc8539d tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.083290 Oct 10 18:50:50.116940 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 218/380] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:50 2022] POST /compute/v2.1/flavors => generated 438 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:50.124773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c8ef33cd-e679-43b0-b54e-0511364705e6 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:50.125432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c8ef33cd-e679-43b0-b54e-0511364705e6 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:50.131630 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8ef33cd-e679-43b0-b54e-0511364705e6 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:50.132107 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8ef33cd-e679-43b0-b54e-0511364705e6 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:50.132527 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8ef33cd-e679-43b0-b54e-0511364705e6 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:50.133465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8ef33cd-e679-43b0-b54e-0511364705e6 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:50.133910 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8ef33cd-e679-43b0-b54e-0511364705e6 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:50.134490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8ef33cd-e679-43b0-b54e-0511364705e6 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:50.210464 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c8ef33cd-e679-43b0-b54e-0511364705e6 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:50.220360 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c8ef33cd-e679-43b0-b54e-0511364705e6 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca" status: 200 len: 1276 microversion: 2.1 time: 0.102143 Oct 10 18:50:50.237359 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 219/381] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:50 2022] GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca => generated 1276 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:50.244104 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f3aaeb81-f802-49f5-b976-7b96f740b2aa tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:50.245161 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f3aaeb81-f802-49f5-b976-7b96f740b2aa tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:50.255248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3aaeb81-f802-49f5-b976-7b96f740b2aa tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:50.255908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3aaeb81-f802-49f5-b976-7b96f740b2aa tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:50.256569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3aaeb81-f802-49f5-b976-7b96f740b2aa tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:50.258058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3aaeb81-f802-49f5-b976-7b96f740b2aa tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:50.259380 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3aaeb81-f802-49f5-b976-7b96f740b2aa tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:50.260139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3aaeb81-f802-49f5-b976-7b96f740b2aa tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:50.350511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f3aaeb81-f802-49f5-b976-7b96f740b2aa tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:50.359857 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f3aaeb81-f802-49f5-b976-7b96f740b2aa tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:50.361527 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f3aaeb81-f802-49f5-b976-7b96f740b2aa tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:50.371561 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f3aaeb81-f802-49f5-b976-7b96f740b2aa tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1452 microversion: 2.75 time: 0.132136 Oct 10 18:50:50.374002 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 220/382] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:50 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:50.388660 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-663b9a17-8193-4fcd-8401-e442639ae6f7 req-19ab7c49-b63c-40d2-9e99-303ad646cd7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a71922-7bbf-4415-b3f5-2c2716b7c7c1", "tag": "c279876a-95a9-436e-bc98-b4a82d21aa0b"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:50.393883 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-bd38e8e0-5a67-4433-a928-5c3834efcd5c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Updating instance_info_cache with network_info: [{"id": "c279876a-95a9-436e-bc98-b4a82d21aa0b", "address": "fa:16:3e:99:11:75", "network": {"id": "bc198aba-4d54-4cd2-9a46-68327b084cae", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-128063861-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d610c145b1284aa293c1f456bf476602", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc279876a-95", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 18:50:50.399329 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-663b9a17-8193-4fcd-8401-e442639ae6f7 req-19ab7c49-b63c-40d2-9e99-303ad646cd7a service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:50.400392 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-663b9a17-8193-4fcd-8401-e442639ae6f7 req-19ab7c49-b63c-40d2-9e99-303ad646cd7a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:50.400989 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-663b9a17-8193-4fcd-8401-e442639ae6f7 req-19ab7c49-b63c-40d2-9e99-303ad646cd7a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:50.412436 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-663b9a17-8193-4fcd-8401-e442639ae6f7 req-19ab7c49-b63c-40d2-9e99-303ad646cd7a service nova] Creating event network-changed:c279876a-95a9-436e-bc98-b4a82d21aa0b for instance f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 on n-h1-860863-1 Oct 10 18:50:50.418268 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-663b9a17-8193-4fcd-8401-e442639ae6f7 req-19ab7c49-b63c-40d2-9e99-303ad646cd7a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042350 Oct 10 18:50:50.419162 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 221/383] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:50.424989 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-36937634-c4e1-4480-8d43-0cb839e512a9 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Action: 'create', calling method: .version_select at 0x7f318e84b280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-305208439", "description": "tempest-description-1588201081"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:50.519901 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bd38e8e0-5a67-4433-a928-5c3834efcd5c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Releasing lock "refresh_cache-f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 18:50:50.521169 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bd38e8e0-5a67-4433-a928-5c3834efcd5c tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action" status: 202 len: 0 microversion: 2.1 time: 1.858809 Oct 10 18:50:50.521881 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 163/384] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:50:48 2022] POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action => generated 0 bytes in 1860 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 18:50:50.529379 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c8265b46-254d-499f-878e-4618d1131457 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:50.648033 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c8265b46-254d-499f-878e-4618d1131457 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1034698328" status: 202 len: 0 microversion: 2.1 time: 0.124611 Oct 10 18:50:50.649639 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 164/385] 10.222.0.43 () {58 vars in 1161 bytes} [Mon Oct 10 18:50:50 2022] DELETE /compute/v2.1/flavors/1034698328 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:50.659975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-210a2433-8b21-4222-bbd2-4a3cc9e6a07f tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:50.677622 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-210a2433-8b21-4222-bbd2-4a3cc9e6a07f tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-210a2433-8b21-4222-bbd2-4a3cc9e6a07f tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Request method failure captured: Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/flavors/2069217390/os-flavor-access HTTP/1.1 Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmDbG6szSt2eSH_HjFJJBuJnzoN-jpHMxOguqBEYvUxe6Wauko0CoKFVCud3AAO2_ztiHLgVX0G7b9hJ-nfG5N8mMdK7QwEQqoSkKR601B06Gu0R1Atxb4vD8h74NzK4rpJGiKr7ymwMKH--0QpE5YGv_usblRSLkDGO5wfsn-MEoE Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 7cb0fa5676524795b1e25892a1846c11 Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1086239416 Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:50.679715 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:50.686606 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7cb0fa5676524795b1e25892a1846c11", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7cb0fa5676524795b1e25892a1846c11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7cb0fa5676524795b1e25892a1846c11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7cb0fa5676524795b1e25892a1846c11"}]}] Oct 10 18:50:50.686606 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1086239416 Oct 10 18:50:50.686606 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 7cb0fa5676524795b1e25892a1846c11 Oct 10 18:50:50.686606 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1086239416 Oct 10 18:50:50.686606 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin Oct 10 18:50:50.686606 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:50.686606 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:50.686606 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: cc5e5a2cd9cc4d74bb20565d8461881d Oct 10 18:50:50.686606 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin Oct 10 18:50:50.686606 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:50.686606 n-d-860863-1 devstack@n-api.service[127289]: exception: Access list not available for public flavors. Oct 10 18:50:50.686606 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'flavor_id': '2069217390'} Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 10 18:50:50.688246 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:50.689892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-210a2433-8b21-4222-bbd2-4a3cc9e6a07f tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:50.689892 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-210a2433-8b21-4222-bbd2-4a3cc9e6a07f tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/2069217390/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.030959 Oct 10 18:50:50.689892 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 165/386] 10.222.0.43 () {58 vars in 1209 bytes} [Mon Oct 10 18:50:50 2022] GET /compute/v2.1/flavors/2069217390/os-flavor-access => generated 91 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:50.693777 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bddc7a28-2d38-48c7-bea9-1b52624f8058 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '.version_select at 0x7f318e6743a0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:50.945803 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-36937634-c4e1-4480-8d43-0cb839e512a9 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.525564 Oct 10 18:50:50.946655 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 222/387] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:50:50 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:50.951508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6970507f-67ea-4417-b3d6-05f760a99c70 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:50.980637 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6970507f-67ea-4417-b3d6-05f760a99c70 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.1 time: 0.031994 Oct 10 18:50:50.982025 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 223/388] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:50 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:50.988463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d2811b5e-3cf9-4d7b-b6eb-0aa826505ecf tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:51.080729 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d2811b5e-3cf9-4d7b-b6eb-0aa826505ecf tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/2069217390" status: 202 len: 0 microversion: 2.1 time: 0.097296 Oct 10 18:50:51.085279 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 224/389] 10.222.0.43 () {58 vars in 1161 bytes} [Mon Oct 10 18:50:50 2022] DELETE /compute/v2.1/flavors/2069217390 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:51.092352 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e49ab80f-36d4-4a93-b77f-38f8ab6cde18 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Action: 'create', calling method: .version_select at 0x7f318e81a040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-477559240", "description": "tempest-description-1920886561"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:51.576418 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e49ab80f-36d4-4a93-b77f-38f8ab6cde18 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.479770 Oct 10 18:50:51.576418 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 225/390] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:50:51 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:51.576418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e9a92b2d-52eb-456a-bea1-979a07fa542a tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-197778754", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:51.669554 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e9a92b2d-52eb-456a-bea1-979a07fa542a tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.100327 Oct 10 18:50:51.670166 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 226/391] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:51 2022] POST /compute/v2.1/flavors => generated 506 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:51.681174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6610d970-2b69-4bbe-837a-1c3888a9e6ec tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:51.705431 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6610d970-2b69-4bbe-837a-1c3888a9e6ec tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6315 microversion: 2.1 time: 0.034208 Oct 10 18:50:51.706022 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 227/392] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:51 2022] GET /compute/v2.1/flavors/detail => generated 6315 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:51.710781 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-830878e8-915d-4b7c-b91d-61ea868ae23e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:51.711685 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-830878e8-915d-4b7c-b91d-61ea868ae23e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:51.717988 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-830878e8-915d-4b7c-b91d-61ea868ae23e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:51.718464 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-830878e8-915d-4b7c-b91d-61ea868ae23e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:51.719038 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-830878e8-915d-4b7c-b91d-61ea868ae23e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:51.719747 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-830878e8-915d-4b7c-b91d-61ea868ae23e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:51.720197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-830878e8-915d-4b7c-b91d-61ea868ae23e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:51.720633 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-830878e8-915d-4b7c-b91d-61ea868ae23e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:51.806391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-830878e8-915d-4b7c-b91d-61ea868ae23e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:51.815356 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-830878e8-915d-4b7c-b91d-61ea868ae23e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca" status: 200 len: 1282 microversion: 2.1 time: 0.108135 Oct 10 18:50:51.819976 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 228/393] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:51 2022] GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca => generated 1282 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:51.824910 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-134f4cf4-aa13-4bbe-b4e6-36463e9f498f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:51.825997 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-134f4cf4-aa13-4bbe-b4e6-36463e9f498f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:51.834885 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-134f4cf4-aa13-4bbe-b4e6-36463e9f498f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:51.835868 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-134f4cf4-aa13-4bbe-b4e6-36463e9f498f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:51.837151 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-134f4cf4-aa13-4bbe-b4e6-36463e9f498f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:51.838556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-134f4cf4-aa13-4bbe-b4e6-36463e9f498f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:51.839333 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-134f4cf4-aa13-4bbe-b4e6-36463e9f498f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:51.840105 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-134f4cf4-aa13-4bbe-b4e6-36463e9f498f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:51.937441 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-134f4cf4-aa13-4bbe-b4e6-36463e9f498f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:51.937441 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-134f4cf4-aa13-4bbe-b4e6-36463e9f498f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:51.946835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-134f4cf4-aa13-4bbe-b4e6-36463e9f498f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:51.946835 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-134f4cf4-aa13-4bbe-b4e6-36463e9f498f tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1437 microversion: 2.75 time: 0.119878 Oct 10 18:50:51.946835 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 229/394] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:51 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1437 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:51.947215 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2f4d80ea-6867-4403-b9d3-631277efdeb7 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Action: 'create', calling method: .version_select at 0x7f318e81aa60>, body: {"security_group_rule": {"parent_group_id": "f82a5e0b-472b-44f2-b881-c8d9b54826b5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "83e02b2d-a4e6-4754-9d81-c3c88a2f7f74"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:52.492020 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bddc7a28-2d38-48c7-bea9-1b52624f8058 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/dcc19dd3-1222-45c7-9cb7-28b0fabfc294" status: 202 len: 0 microversion: 2.1 time: 1.806983 Oct 10 18:50:52.499124 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 166/395] 10.222.0.43 () {58 vars in 1263 bytes} [Mon Oct 10 18:50:50 2022] DELETE /compute/v2.1/os-floating-ips/dcc19dd3-1222-45c7-9cb7-28b0fabfc294 => generated 0 bytes in 1815 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:52.505617 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0208ce95-ec14-440f-9ad8-dcb9854adc35 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:52.524317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=13,nova_api:INSERT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:52.618574 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0208ce95-ec14-440f-9ad8-dcb9854adc35 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/72cb3c74-1213-4770-b895-68d2e50a2e6a" status: 202 len: 0 microversion: 2.1 time: 0.117318 Oct 10 18:50:52.619618 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 167/396] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:50:52 2022] DELETE /compute/v2.1/flavors/72cb3c74-1213-4770-b895-68d2e50a2e6a => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:52.624366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dd2c16c7-a813-4f41-b760-6787ea9e90a9 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1584903177", "id": 375453851, "os-flavor-access:is_public": "False"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:52.743281 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dd2c16c7-a813-4f41-b760-6787ea9e90a9 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.122184 Oct 10 18:50:52.744107 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 168/397] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:52 2022] POST /compute/v2.1/flavors => generated 436 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:52.806260 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2f4d80ea-6867-4403-b9d3-631277efdeb7 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.867638 Oct 10 18:50:52.807377 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 230/398] 10.222.0.43 () {60 vars in 1195 bytes} [Mon Oct 10 18:50:51 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:52.812453 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a66ece91-eaea-4566-a74a-964156b3ecc8 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Action: 'action', calling method: .version_select at 0x7f31906a18b0>, body: {"addFloatingIp": {"address": ""}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a66ece91-eaea-4566-a74a-964156b3ecc8 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Request method failure captured: Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action HTTP/1.1 Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 34 Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGlnAzOw3cwjSWoGabvksBE7PAMlvc1ztA75na0o-QeMrwu-fr7dk5eZInf6ScvS7dbW2x5CphxsqDbGxYRxKUayN4VcdDss6qSK0mb8EaN6pPnv5tLxGv6YKZ6dXIwKAOxiecc9u_vXL88i6HnB5ILNHIPADpc9IrOB2Z2HrTr68r4 Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: d610c145b1284aa293c1f456bf476602 Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:52.816900 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:52.818496 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d610c145b1284aa293c1f456bf476602", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d610c145b1284aa293c1f456bf476602"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d610c145b1284aa293c1f456bf476602"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d610c145b1284aa293c1f456bf476602"}]}] Oct 10 18:50:52.818496 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:52.818496 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: d610c145b1284aa293c1f456bf476602 Oct 10 18:50:52.818496 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:52.818496 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project Oct 10 18:50:52.818496 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:52.818496 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:52.818496 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 831696709a6b473fbd54b99883d38c8d Oct 10 18:50:52.818496 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project Oct 10 18:50:52.818496 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:50:52.818496 n-d-860863-1 devstack@n-api.service[127288]: {"addFloatingIp": {"address": ""}} Oct 10 18:50:52.818496 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:50:52.818496 n-d-860863-1 devstack@n-api.service[127288]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'f5a71922-7bbf-4415-b3f5-2c2716b7c7c1', 'body': {'addFloatingIp': {'address': ''}}} Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise error Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi '' Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:52.819428 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 18:50:52.821062 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 18:50:52.822399 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 10 18:50:52.822399 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:52.824479 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a66ece91-eaea-4566-a74a-964156b3ecc8 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:52.825788 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a66ece91-eaea-4566-a74a-964156b3ecc8 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action" status: 400 len: 142 microversion: 2.1 time: 0.017252 Oct 10 18:50:52.827268 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 231/399] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:50:52 2022] POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action => generated 142 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:50:52.831898 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5913ae51-b089-440a-a92e-48bd5927ecab tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:52.856936 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5913ae51-b089-440a-a92e-48bd5927ecab tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.028384 Oct 10 18:50:52.861343 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 232/400] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:52 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:53.049969 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:53.052740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-337b2122-5d6e-4164-bd38-7b4cbd02d206 tempest-FlavorsAccessNegativeTestJSON-326378230 tempest-FlavorsAccessNegativeTestJSON-326378230-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4416773dfead4be59d6aa65815c84370"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:53.053658 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:53.056303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-337b2122-5d6e-4164-bd38-7b4cbd02d206 tempest-FlavorsAccessNegativeTestJSON-326378230 tempest-FlavorsAccessNegativeTestJSON-326378230-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '57304595d585430c8f272e3211087f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4416773dfead4be59d6aa65815c84370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-337b2122-5d6e-4164-bd38-7b4cbd02d206 tempest-FlavorsAccessNegativeTestJSON-326378230 tempest-FlavorsAccessNegativeTestJSON-326378230-project] Request method failure captured: Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/flavors/375453851/action HTTP/1.1 Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 67 Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmBEjxR9evlPC2PDJ7jcHgmfOuK2PiarsF3HzrqpxN5F5VuaBOjGlaADRiNrY53Nb-j3QYN9vOONLVA5PFHqB8Q7vEuo1QcdY8z2-hdOi6tfGniHOu4SeS1OEMnOx6--zbIPr9hWVCwPDnFvyKzJ25UNSdOoN9y7Fmer1xVhoVMeHc Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 4416773dfead4be59d6aa65815c84370 Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-326378230 Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:53.059141 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:53.063698 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4416773dfead4be59d6aa65815c84370", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4416773dfead4be59d6aa65815c84370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4416773dfead4be59d6aa65815c84370"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4416773dfead4be59d6aa65815c84370"}]}] Oct 10 18:50:53.063698 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-326378230 Oct 10 18:50:53.063698 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 4416773dfead4be59d6aa65815c84370 Oct 10 18:50:53.063698 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-326378230 Oct 10 18:50:53.063698 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FlavorsAccessNegativeTestJSON-326378230-project Oct 10 18:50:53.063698 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:53.063698 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:53.063698 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 57304595d585430c8f272e3211087f0c Oct 10 18:50:53.063698 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-326378230-project Oct 10 18:50:53.063698 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:50:53.063698 n-d-860863-1 devstack@n-api.service[127288]: {"addTenantAccess": {"tenant": "4416773dfead4be59d6aa65815c84370"}} Oct 10 18:50:53.063698 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '375453851', 'body': {'addTenantAccess': {'tenant': '4416773dfead4be59d6aa65815c84370'}}} Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:50:53.064833 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 10 18:50:53.066185 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:53.067955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-337b2122-5d6e-4164-bd38-7b4cbd02d206 tempest-FlavorsAccessNegativeTestJSON-326378230 tempest-FlavorsAccessNegativeTestJSON-326378230-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:53.067955 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-337b2122-5d6e-4164-bd38-7b4cbd02d206 tempest-FlavorsAccessNegativeTestJSON-326378230 tempest-FlavorsAccessNegativeTestJSON-326378230-project] 10.222.0.43 "POST /compute/v2.1/flavors/375453851/action" status: 403 len: 130 microversion: 2.1 time: 0.202049 Oct 10 18:50:53.067955 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 233/401] 10.222.0.43 () {60 vars in 1197 bytes} [Mon Oct 10 18:50:52 2022] POST /compute/v2.1/flavors/375453851/action => generated 130 bytes in 203 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:53.072275 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-30cb878c-624e-43fe-a9da-8e7ecbbcd2eb tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Calling method '.version_select at 0x7f318e87e5e0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:53.076952 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:53.082524 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:53.082973 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:53.083704 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:53.084672 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:53.085134 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:53.224615 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:50:53.225235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:50:53.226032 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:50:53.226724 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:50:53.227286 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:50:53.442796 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-30cb878c-624e-43fe-a9da-8e7ecbbcd2eb tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/83e02b2d-a4e6-4754-9d81-c3c88a2f7f74" status: 202 len: 0 microversion: 2.1 time: 0.376412 Oct 10 18:50:53.442796 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 234/402] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:50:53 2022] DELETE /compute/v2.1/os-security-groups/83e02b2d-a4e6-4754-9d81-c3c88a2f7f74 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:53.447332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:53.451030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:53.457486 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:53.457975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:53.458501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:53.459398 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:53.459852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:53.460413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:53.529985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "refresh_cache-f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" {{(pid=127288) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 18:50:53.530486 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquired lock "refresh_cache-f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" {{(pid=127288) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 18:50:53.547588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:53.556867 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:53.557547 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:53.558901 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:53.560087 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:53.560722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:53.561293 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:53.676476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Releasing lock "refresh_cache-f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" {{(pid=127288) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 18:50:53.677070 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] HTTP exception thrown: floating IP not found Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Request method failure captured: Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action HTTP/1.1 Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 41 Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGlnAzOw3cwjSWoGabvksBE7PAMlvc1ztA75na0o-QeMrwu-fr7dk5eZInf6ScvS7dbW2x5CphxsqDbGxYRxKUayN4VcdDss6qSK0mb8EaN6pPnv5tLxGv6YKZ6dXIwKAOxiecc9u_vXL88i6HnB5ILNHIPADpc9IrOB2Z2HrTr68r4 Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: d610c145b1284aa293c1f456bf476602 Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:53.680477 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:53.681990 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d610c145b1284aa293c1f456bf476602", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d610c145b1284aa293c1f456bf476602"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d610c145b1284aa293c1f456bf476602"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d610c145b1284aa293c1f456bf476602"}]}] Oct 10 18:50:53.681990 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:53.681990 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: d610c145b1284aa293c1f456bf476602 Oct 10 18:50:53.681990 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:53.681990 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project Oct 10 18:50:53.681990 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:53.681990 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:53.681990 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 831696709a6b473fbd54b99883d38c8d Oct 10 18:50:53.681990 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project Oct 10 18:50:53.681990 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:50:53.681990 n-d-860863-1 devstack@n-api.service[127288]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 10 18:50:53.681990 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:50:53.681990 n-d-860863-1 devstack@n-api.service[127288]: exception: floating IP not found Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'f5a71922-7bbf-4415-b3f5-2c2716b7c7c1', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:53.683018 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 10 18:50:53.684346 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:53.685852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Returning 404 to user: floating IP not found {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:53.685852 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-eea71c6e-bb7d-47de-bf91-034424dbafe4 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action" status: 404 len: 67 microversion: 2.1 time: 0.241486 Oct 10 18:50:53.685852 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 235/403] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:50:53 2022] POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action => generated 67 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:53.689490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-569fea5a-7a49-4d5a-a015-63cc06246f54 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:53.690226 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-569fea5a-7a49-4d5a-a015-63cc06246f54 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:53.692625 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=80,nova_api:DELETE=12 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:53.721982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-569fea5a-7a49-4d5a-a015-63cc06246f54 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:53.722494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-569fea5a-7a49-4d5a-a015-63cc06246f54 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:53.722996 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-569fea5a-7a49-4d5a-a015-63cc06246f54 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:53.723865 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-569fea5a-7a49-4d5a-a015-63cc06246f54 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:53.724326 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-569fea5a-7a49-4d5a-a015-63cc06246f54 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:53.724779 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-569fea5a-7a49-4d5a-a015-63cc06246f54 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:53.724912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:50:53.761681 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:53.790977 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-44ab79b6-3398-46e6-892a-43827cf15030 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab/action" status: 202 len: 1940 microversion: 2.75 time: 1.045628 Oct 10 18:50:53.805196 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 169/404] 10.222.0.43 () {62 vars in 1319 bytes} [Mon Oct 10 18:50:52 2022] POST /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab/action => generated 1940 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 10 18:50:53.819648 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-75ed2a19-9816-4ddc-9820-08e3456be4d8 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1055634153", "id": "7a3133bf-c28b-4275-9f99-cb8ece8d167d", "os-flavor-access:is_public": "True"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:53.870958 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-569fea5a-7a49-4d5a-a015-63cc06246f54 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:53.878612 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-569fea5a-7a49-4d5a-a015-63cc06246f54 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca" status: 200 len: 1324 microversion: 2.1 time: 0.194489 Oct 10 18:50:53.879169 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 236/405] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:53 2022] GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca => generated 1324 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:53.883656 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ca175198-da82-41e0-b2e3-92f44e6d5e9f tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:53.916644 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-75ed2a19-9816-4ddc-9820-08e3456be4d8 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.110036 Oct 10 18:50:53.917290 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 170/406] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:53 2022] POST /compute/v2.1/flavors => generated 507 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:53.928922 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1d9ddb49-4913-484d-a03e-7132a898b9fd tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Calling method '.version_select at 0x7f318e61ad30>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:53.960687 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ca175198-da82-41e0-b2e3-92f44e6d5e9f tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/375453851" status: 202 len: 0 microversion: 2.1 time: 0.080243 Oct 10 18:50:53.961491 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 237/407] 10.222.0.43 () {58 vars in 1158 bytes} [Mon Oct 10 18:50:53 2022] DELETE /compute/v2.1/flavors/375453851 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:53.971231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-fc20aa3f-d62d-49d5-bb95-33c382d75719 req-13769657-bba7-47e7-a836-23e1ba258e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba31eefc-640b-41f5-8c00-a6d021cef3ca", "tag": "b8ce8642-3363-42a2-afad-1a4e62608841"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:53.976657 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-fc20aa3f-d62d-49d5-bb95-33c382d75719 req-13769657-bba7-47e7-a836-23e1ba258e85 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:53.977305 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-fc20aa3f-d62d-49d5-bb95-33c382d75719 req-13769657-bba7-47e7-a836-23e1ba258e85 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:53.977823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-fc20aa3f-d62d-49d5-bb95-33c382d75719 req-13769657-bba7-47e7-a836-23e1ba258e85 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:53.994795 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-fc20aa3f-d62d-49d5-bb95-33c382d75719 req-13769657-bba7-47e7-a836-23e1ba258e85 service nova] Creating event network-changed:b8ce8642-3363-42a2-afad-1a4e62608841 for instance ba31eefc-640b-41f5-8c00-a6d021cef3ca on n-h1-860863-1 Oct 10 18:50:54.003947 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-fc20aa3f-d62d-49d5-bb95-33c382d75719 req-13769657-bba7-47e7-a836-23e1ba258e85 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041158 Oct 10 18:50:54.004974 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 238/408] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:54.012329 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-670f13af-4284-4cf8-adb6-2ce5123b5a71 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Action: 'action', calling method: .version_select at 0x7f31906a19d0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:54.023915 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1d9ddb49-4913-484d-a03e-7132a898b9fd tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/f82a5e0b-472b-44f2-b881-c8d9b54826b5" status: 200 len: 247 microversion: 2.1 time: 0.102916 Oct 10 18:50:54.023915 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 171/409] 10.222.0.43 () {58 vars in 1269 bytes} [Mon Oct 10 18:50:53 2022] GET /compute/v2.1/os-security-groups/f82a5e0b-472b-44f2-b881-c8d9b54826b5 => generated 247 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:54.029443 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-04da4cd6-1434-496a-9b4d-cbd0b7192259 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:54.030335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-04da4cd6-1434-496a-9b4d-cbd0b7192259 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:54.036568 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04da4cd6-1434-496a-9b4d-cbd0b7192259 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:54.037064 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04da4cd6-1434-496a-9b4d-cbd0b7192259 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:54.037981 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04da4cd6-1434-496a-9b4d-cbd0b7192259 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:54.038953 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04da4cd6-1434-496a-9b4d-cbd0b7192259 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:54.039788 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04da4cd6-1434-496a-9b4d-cbd0b7192259 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:54.040219 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04da4cd6-1434-496a-9b4d-cbd0b7192259 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:54.167574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-04da4cd6-1434-496a-9b4d-cbd0b7192259 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:50:54.185262 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-04da4cd6-1434-496a-9b4d-cbd0b7192259 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.161400 Oct 10 18:50:54.186152 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 172/410] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:54 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:54.191039 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-27699db4-2e3c-4989-82c2-84501bc3f4f3 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:54.278478 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-670f13af-4284-4cf8-adb6-2ce5123b5a71 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 10 18:50:54.279051 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-27699db4-2e3c-4989-82c2-84501bc3f4f3 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/7a3133bf-c28b-4275-9f99-cb8ece8d167d" status: 202 len: 0 microversion: 2.1 time: 0.091671 Oct 10 18:50:54.279639 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 173/411] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:50:54 2022] DELETE /compute/v2.1/flavors/7a3133bf-c28b-4275-9f99-cb8ece8d167d => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-670f13af-4284-4cf8-adb6-2ce5123b5a71 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Request method failure captured: Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action HTTP/1.1 Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 44 Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGlnAzOw3cwjSWoGabvksBE7PAMlvc1ztA75na0o-QeMrwu-fr7dk5eZInf6ScvS7dbW2x5CphxsqDbGxYRxKUayN4VcdDss6qSK0mb8EaN6pPnv5tLxGv6YKZ6dXIwKAOxiecc9u_vXL88i6HnB5ILNHIPADpc9IrOB2Z2HrTr68r4 Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: d610c145b1284aa293c1f456bf476602 Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:54.280155 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:54.281705 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d610c145b1284aa293c1f456bf476602", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d610c145b1284aa293c1f456bf476602"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d610c145b1284aa293c1f456bf476602"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d610c145b1284aa293c1f456bf476602"}]}] Oct 10 18:50:54.281705 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:54.281705 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: d610c145b1284aa293c1f456bf476602 Oct 10 18:50:54.281705 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:54.281705 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project Oct 10 18:50:54.281705 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:54.281705 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:54.281705 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 831696709a6b473fbd54b99883d38c8d Oct 10 18:50:54.281705 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project Oct 10 18:50:54.281705 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:50:54.281705 n-d-860863-1 devstack@n-api.service[127288]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 10 18:50:54.281705 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:50:54.281705 n-d-860863-1 devstack@n-api.service[127288]: exception: Floating IP not found for address 0.0.0.0. Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'f5a71922-7bbf-4415-b3f5-2c2716b7c7c1', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:54.282696 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 10 18:50:54.284029 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:54.290494 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-650ce6a0-89c1-4a69-bcc8-db67aa9b22e5 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:54.290595 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-670f13af-4284-4cf8-adb6-2ce5123b5a71 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:54.290595 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-670f13af-4284-4cf8-adb6-2ce5123b5a71 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action" status: 404 len: 88 microversion: 2.1 time: 0.279903 Oct 10 18:50:54.290595 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 239/412] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:50:54 2022] POST /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1/action => generated 88 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:54.291312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-99afe4f7-ae0d-4e8f-a423-a5607b21d261 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Action: 'create', calling method: .version_select at 0x7f318e743c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-53736596", "description": "tempest-description-808070091"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:54.305676 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-650ce6a0-89c1-4a69-bcc8-db67aa9b22e5 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.024985 Oct 10 18:50:54.308811 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 174/413] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:54 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:54.429181 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bdfc818d-f2d2-4d90-81b7-6b0df8661352 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Calling method '.version_select at 0x7f318f93b040>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:54.434366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bdfc818d-f2d2-4d90-81b7-6b0df8661352 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:54.434858 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bdfc818d-f2d2-4d90-81b7-6b0df8661352 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:54.435302 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bdfc818d-f2d2-4d90-81b7-6b0df8661352 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:54.436162 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bdfc818d-f2d2-4d90-81b7-6b0df8661352 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:54.436682 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bdfc818d-f2d2-4d90-81b7-6b0df8661352 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:54.437114 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bdfc818d-f2d2-4d90-81b7-6b0df8661352 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:54.465112 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bdfc818d-f2d2-4d90-81b7-6b0df8661352 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.154887 Oct 10 18:50:54.465699 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 175/414] 10.222.0.43 () {58 vars in 1128 bytes} [Mon Oct 10 18:50:54 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:54.470422 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fab2afd5-ffe0-485c-be83-acfc9c1b19db tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:54.491285 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fab2afd5-ffe0-485c-be83-acfc9c1b19db tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.024555 Oct 10 18:50:54.491857 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 176/415] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:54 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:54.496827 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6add7045-06f0-48af-90fd-1e7cae93e311 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:54.497310 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6add7045-06f0-48af-90fd-1e7cae93e311 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:54.503113 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6add7045-06f0-48af-90fd-1e7cae93e311 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:54.503614 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6add7045-06f0-48af-90fd-1e7cae93e311 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:54.504039 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6add7045-06f0-48af-90fd-1e7cae93e311 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:54.504742 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6add7045-06f0-48af-90fd-1e7cae93e311 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:54.505191 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6add7045-06f0-48af-90fd-1e7cae93e311 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:54.505609 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6add7045-06f0-48af-90fd-1e7cae93e311 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:54.530839 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6add7045-06f0-48af-90fd-1e7cae93e311 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:50:54.699773 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-99afe4f7-ae0d-4e8f-a423-a5607b21d261 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.411976 Oct 10 18:50:54.700366 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 240/416] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:50:54 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:54.704778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-37938cc0-9f7d-4495-bad6-5556d3e0ea76 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-237538294", "id": 178342327, "os-flavor-access:is_public": "False"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:54.790945 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-37938cc0-9f7d-4495-bad6-5556d3e0ea76 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.084939 Oct 10 18:50:54.790945 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 241/417] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:54 2022] POST /compute/v2.1/flavors => generated 435 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:54.868869 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6add7045-06f0-48af-90fd-1e7cae93e311 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 204 len: 0 microversion: 2.1 time: 0.375729 Oct 10 18:50:54.869542 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 177/418] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:50:54 2022] DELETE /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:50:54.875493 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-224b0898-242f-4bd4-beb5-50c111465570 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-381934608", "id": 1990466839, "os-flavor-access:is_public": "True"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:54.888578 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-96940c15-cdbf-4789-8ebb-a9c3c22c2038 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Calling method '.version_select at 0x7f318e733040>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:54.891891 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-96940c15-cdbf-4789-8ebb-a9c3c22c2038 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'f96e88c8580242ab8d5bce9ce6c1f79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd341ddc2fb445db8112727ca8142206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-96940c15-cdbf-4789-8ebb-a9c3c22c2038 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Request method failure captured: Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmNskSx8cCY7y5y9Uj-AIsv3isSiTkaNjSy83Xd7r6A81z86bGAbloYaPUBbTeOlvWDx3sqG84SGKQZJMNhCiIBiskClhu82S2AfERJmCRfrOUV9lQc9b7Sc1bAxsS7Kl5m2pTlhWGLq2Q8_PmEAy9AYgYAAkN0vc-ssY7KtIuQd08 Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: dd341ddc2fb445db8112727ca8142206 Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:54.893754 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:54.895273 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dd341ddc2fb445db8112727ca8142206", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dd341ddc2fb445db8112727ca8142206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dd341ddc2fb445db8112727ca8142206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dd341ddc2fb445db8112727ca8142206"}]}] Oct 10 18:50:54.895273 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:54.895273 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: dd341ddc2fb445db8112727ca8142206 Oct 10 18:50:54.895273 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:54.895273 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-HostsAdminNegativeTestJSON-257003345-project Oct 10 18:50:54.895273 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:54.895273 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:54.895273 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: f96e88c8580242ab8d5bce9ce6c1f79a Oct 10 18:50:54.895273 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-HostsAdminNegativeTestJSON-257003345-project Oct 10 18:50:54.895273 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:50:54.895273 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 10 18:50:54.895273 n-d-860863-1 devstack@n-api.service[127288]: action_args: {} Oct 10 18:50:54.895273 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:54.896181 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 10 18:50:54.897317 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:54.898505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-96940c15-cdbf-4789-8ebb-a9c3c22c2038 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:54.898505 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-96940c15-cdbf-4789-8ebb-a9c3c22c2038 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.107287 Oct 10 18:50:54.898505 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 242/419] 10.222.0.43 () {58 vars in 1128 bytes} [Mon Oct 10 18:50:54 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 108 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:54.900832 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d820a8fb-137c-45f3-b8c0-9059783d4b97 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Action: 'create', calling method: .version_select at 0x7f318e743160>, body: {"security_group_rule": {"parent_group_id": "5f634545-a0e7-4f6e-8d86-504506726e1b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:54.958598 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-224b0898-242f-4bd4-beb5-50c111465570 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.087746 Oct 10 18:50:54.959190 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 178/420] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:54 2022] POST /compute/v2.1/flavors => generated 413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:54.964752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b717e501-b010-448d-b40d-13b321d4cb82 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4416773dfead4be59d6aa65815c84370"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:55.159703 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b717e501-b010-448d-b40d-13b321d4cb82 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/178342327/action" status: 200 len: 96 microversion: 2.1 time: 0.199188 Oct 10 18:50:55.160308 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 179/421] 10.222.0.43 () {60 vars in 1197 bytes} [Mon Oct 10 18:50:54 2022] POST /compute/v2.1/flavors/178342327/action => generated 96 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:50:55.164844 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-98c42313-9949-4b7e-a853-5ff25386dcd6 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:55.165578 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-98c42313-9949-4b7e-a853-5ff25386dcd6 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:55.173012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98c42313-9949-4b7e-a853-5ff25386dcd6 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:55.173494 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98c42313-9949-4b7e-a853-5ff25386dcd6 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:55.173926 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98c42313-9949-4b7e-a853-5ff25386dcd6 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:55.174623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98c42313-9949-4b7e-a853-5ff25386dcd6 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:55.175102 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98c42313-9949-4b7e-a853-5ff25386dcd6 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:55.175764 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98c42313-9949-4b7e-a853-5ff25386dcd6 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:55.318569 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d820a8fb-137c-45f3-b8c0-9059783d4b97 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.421480 Oct 10 18:50:55.319156 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 243/422] 10.222.0.43 () {60 vars in 1195 bytes} [Mon Oct 10 18:50:54 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:55.323846 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b5568f45-cfbf-416a-b35e-762e1ddcfb64 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:55.324606 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b5568f45-cfbf-416a-b35e-762e1ddcfb64 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:55.331694 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5568f45-cfbf-416a-b35e-762e1ddcfb64 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:55.332163 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5568f45-cfbf-416a-b35e-762e1ddcfb64 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:55.332606 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5568f45-cfbf-416a-b35e-762e1ddcfb64 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:55.333299 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5568f45-cfbf-416a-b35e-762e1ddcfb64 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:55.333744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5568f45-cfbf-416a-b35e-762e1ddcfb64 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:55.334160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5568f45-cfbf-416a-b35e-762e1ddcfb64 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:55.392786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-98c42313-9949-4b7e-a853-5ff25386dcd6 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:55.401012 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-98c42313-9949-4b7e-a853-5ff25386dcd6 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1542 microversion: 2.1 time: 0.239652 Oct 10 18:50:55.402145 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 180/423] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:55 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1542 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:55.407254 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-41b4e865-d706-426c-9f59-be14433ae088 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Calling method '.version_select at 0x7f318e4cdf70>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:55.409239 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-41b4e865-d706-426c-9f59-be14433ae088 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'f96e88c8580242ab8d5bce9ce6c1f79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd341ddc2fb445db8112727ca8142206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-41b4e865-d706-426c-9f59-be14433ae088 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Request method failure captured: Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-hosts/n-d-860863-1/reboot HTTP/1.1 Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmNskSx8cCY7y5y9Uj-AIsv3isSiTkaNjSy83Xd7r6A81z86bGAbloYaPUBbTeOlvWDx3sqG84SGKQZJMNhCiIBiskClhu82S2AfERJmCRfrOUV9lQc9b7Sc1bAxsS7Kl5m2pTlhWGLq2Q8_PmEAy9AYgYAAkN0vc-ssY7KtIuQd08 Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: dd341ddc2fb445db8112727ca8142206 Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:50:55.414033 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:50:55.415279 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dd341ddc2fb445db8112727ca8142206", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dd341ddc2fb445db8112727ca8142206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dd341ddc2fb445db8112727ca8142206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dd341ddc2fb445db8112727ca8142206"}]}] Oct 10 18:50:55.415279 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:55.415279 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: dd341ddc2fb445db8112727ca8142206 Oct 10 18:50:55.415279 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:55.415279 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HostsAdminNegativeTestJSON-257003345-project Oct 10 18:50:55.415279 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:55.415279 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:55.415279 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: f96e88c8580242ab8d5bce9ce6c1f79a Oct 10 18:50:55.415279 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HostsAdminNegativeTestJSON-257003345-project Oct 10 18:50:55.415279 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:50:55.415279 n-d-860863-1 devstack@n-api.service[127289]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 10 18:50:55.415279 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'n-d-860863-1'} Oct 10 18:50:55.415279 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:55.416048 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 10 18:50:55.417762 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:55.418758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-41b4e865-d706-426c-9f59-be14433ae088 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:55.418758 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-41b4e865-d706-426c-9f59-be14433ae088 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-860863-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.009200 Oct 10 18:50:55.418758 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 181/424] 10.222.0.43 () {58 vars in 1188 bytes} [Mon Oct 10 18:50:55 2022] GET /compute/v2.1/os-hosts/n-d-860863-1/reboot => generated 111 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:55.422641 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b4117e54-f9b1-42d9-9aca-88d7943ac8b1 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:55.429776 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b4117e54-f9b1-42d9-9aca-88d7943ac8b1 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/1990466839" status: 200 len: 413 microversion: 2.1 time: 0.015781 Oct 10 18:50:55.430774 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 182/425] 10.222.0.43 () {58 vars in 1158 bytes} [Mon Oct 10 18:50:55 2022] GET /compute/v2.1/flavors/1990466839 => generated 413 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:55.442708 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-faa6e90c-a362-4e6d-9808-f12a5836aa8f tempest-FlavorsAccessNegativeTestJSON-326378230 tempest-FlavorsAccessNegativeTestJSON-326378230-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4416773dfead4be59d6aa65815c84370"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:55.446139 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-faa6e90c-a362-4e6d-9808-f12a5836aa8f tempest-FlavorsAccessNegativeTestJSON-326378230 tempest-FlavorsAccessNegativeTestJSON-326378230-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '57304595d585430c8f272e3211087f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4416773dfead4be59d6aa65815c84370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-faa6e90c-a362-4e6d-9808-f12a5836aa8f tempest-FlavorsAccessNegativeTestJSON-326378230 tempest-FlavorsAccessNegativeTestJSON-326378230-project] Request method failure captured: Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/flavors/178342327/action HTTP/1.1 Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 70 Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmBEjxR9evlPC2PDJ7jcHgmfOuK2PiarsF3HzrqpxN5F5VuaBOjGlaADRiNrY53Nb-j3QYN9vOONLVA5PFHqB8Q7vEuo1QcdY8z2-hdOi6tfGniHOu4SeS1OEMnOx6--zbIPr9hWVCwPDnFvyKzJ25UNSdOoN9y7Fmer1xVhoVMeHc Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 4416773dfead4be59d6aa65815c84370 Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-326378230 Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:50:55.447816 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:50:55.449590 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4416773dfead4be59d6aa65815c84370", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4416773dfead4be59d6aa65815c84370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4416773dfead4be59d6aa65815c84370"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4416773dfead4be59d6aa65815c84370"}]}] Oct 10 18:50:55.449590 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-326378230 Oct 10 18:50:55.449590 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 4416773dfead4be59d6aa65815c84370 Oct 10 18:50:55.449590 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-326378230 Oct 10 18:50:55.449590 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-FlavorsAccessNegativeTestJSON-326378230-project Oct 10 18:50:55.449590 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:55.449590 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:55.449590 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 57304595d585430c8f272e3211087f0c Oct 10 18:50:55.449590 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-326378230-project Oct 10 18:50:55.449590 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:50:55.449590 n-d-860863-1 devstack@n-api.service[127289]: {"removeTenantAccess": {"tenant": "4416773dfead4be59d6aa65815c84370"}} Oct 10 18:50:55.449590 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '178342327', 'body': {'removeTenantAccess': {'tenant': '4416773dfead4be59d6aa65815c84370'}}} Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi context.can( Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:55.450339 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 10 18:50:55.451499 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:55.452672 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-faa6e90c-a362-4e6d-9808-f12a5836aa8f tempest-FlavorsAccessNegativeTestJSON-326378230 tempest-FlavorsAccessNegativeTestJSON-326378230-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:55.452672 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-faa6e90c-a362-4e6d-9808-f12a5836aa8f tempest-FlavorsAccessNegativeTestJSON-326378230 tempest-FlavorsAccessNegativeTestJSON-326378230-project] 10.222.0.43 "POST /compute/v2.1/flavors/178342327/action" status: 403 len: 133 microversion: 2.1 time: 0.012163 Oct 10 18:50:55.452672 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 183/426] 10.222.0.43 () {60 vars in 1197 bytes} [Mon Oct 10 18:50:55 2022] POST /compute/v2.1/flavors/178342327/action => generated 133 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:55.454235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4ef5c453-14ea-4759-8c98-a2073411f880 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:55.454823 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4ef5c453-14ea-4759-8c98-a2073411f880 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:55.461494 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ef5c453-14ea-4759-8c98-a2073411f880 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:55.461979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ef5c453-14ea-4759-8c98-a2073411f880 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:55.462474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ef5c453-14ea-4759-8c98-a2073411f880 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:55.463166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ef5c453-14ea-4759-8c98-a2073411f880 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:55.463625 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ef5c453-14ea-4759-8c98-a2073411f880 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:55.464599 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ef5c453-14ea-4759-8c98-a2073411f880 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:55.485595 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b5568f45-cfbf-416a-b35e-762e1ddcfb64 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:55.489171 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:55.493776 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b5568f45-cfbf-416a-b35e-762e1ddcfb64 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca" status: 200 len: 1324 microversion: 2.1 time: 0.173670 Oct 10 18:50:55.494643 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 244/427] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:55 2022] GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca => generated 1324 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:55.499040 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-627d0c72-175c-4b89-9939-baa1802e5d2c tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Action: 'create', calling method: .version_select at 0x7f318e743700>, body: {"security_group_rule": {"parent_group_id": "5f634545-a0e7-4f6e-8d86-504506726e1b", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:55.539209 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-4ef5c453-14ea-4759-8c98-a2073411f880 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:50:55.559597 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4ef5c453-14ea-4759-8c98-a2073411f880 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.108801 Oct 10 18:50:55.560345 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 184/428] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:55 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:55.569064 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5579684f-3724-4757-9cf1-934f79a942d7 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Calling method '.version_select at 0x7f318e4a9c10>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:55.578267 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-5579684f-3724-4757-9cf1-934f79a942d7 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5579684f-3724-4757-9cf1-934f79a942d7 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Request method failure captured: Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmOoy0ouqpq8yssRNz2-_pNmKiWiTryw5YxHlBaOshBXcjsXpVkIyQGsy9fbiHLfyPN_4WfsK8WTby1wwpD5_feaAjDuqD7ahrGUZlHWDCYUkoQRWtlIf9-DFxvyRrK4pfnf7aD9CHcD97ZG348gjUmHL7i1h5FI-Kl6x7GTQzGeUI Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:55.580364 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:55.582062 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_695ed78a31364f1582558fbab558a7e7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}] Oct 10 18:50:55.582062 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:55.582062 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:55.582062 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:55.582062 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:55.582062 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:55.582062 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:55.582062 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: d5685aa630294e55a2c24c6de9e072b0 Oct 10 18:50:55.582062 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:55.582062 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:50:55.582062 n-d-860863-1 devstack@n-api.service[127289]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:55.582062 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'nonexistent_hostname'} Oct 10 18:50:55.582062 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:55.583201 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 10 18:50:55.584697 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:55.586197 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:55.586197 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:55.586197 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:55.586197 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:55.586197 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:55.586197 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:55.586197 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:55.586197 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:55.586197 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:55.586197 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:55.586197 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:55.586197 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5579684f-3724-4757-9cf1-934f79a942d7 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:55.586197 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5579684f-3724-4757-9cf1-934f79a942d7 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.020379 Oct 10 18:50:55.586197 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 185/429] 10.222.0.43 () {58 vars in 1212 bytes} [Mon Oct 10 18:50:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:55.689484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-258c1918-0525-4011-b2e4-e2e24235149e tempest-FlavorsAdminTestJSON-1049395815 tempest-FlavorsAdminTestJSON-1049395815-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:55.712850 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-258c1918-0525-4011-b2e4-e2e24235149e tempest-FlavorsAdminTestJSON-1049395815 tempest-FlavorsAdminTestJSON-1049395815-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6222 microversion: 2.1 time: 0.129565 Oct 10 18:50:55.713442 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 186/430] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:55 2022] GET /compute/v2.1/flavors/detail => generated 6222 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:55.718667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4e2cd626-5779-44b5-954b-bed9f4304329 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4416773dfead4be59d6aa65815c84370"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:55.845612 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4e2cd626-5779-44b5-954b-bed9f4304329 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/178342327/action" status: 200 len: 21 microversion: 2.1 time: 0.130968 Oct 10 18:50:55.855488 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 187/431] 10.222.0.43 () {60 vars in 1197 bytes} [Mon Oct 10 18:50:55 2022] POST /compute/v2.1/flavors/178342327/action => generated 21 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:50:55.855488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3bf72171-64eb-4bef-b2fd-3b3613a91a38 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Calling method '.version_select at 0x7f318e742160>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:55.855488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3bf72171-64eb-4bef-b2fd-3b3613a91a38 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'f96e88c8580242ab8d5bce9ce6c1f79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd341ddc2fb445db8112727ca8142206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:55.855488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3bf72171-64eb-4bef-b2fd-3b3613a91a38 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Request method failure captured: Oct 10 18:50:55.855488 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-hosts/n-d-860863-1 HTTP/1.1 Oct 10 18:50:55.855488 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:55.855488 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:55.855488 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:55.855488 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:55.855488 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:55.855488 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:55.855488 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:55.855488 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmNskSx8cCY7y5y9Uj-AIsv3isSiTkaNjSy83Xd7r6A81z86bGAbloYaPUBbTeOlvWDx3sqG84SGKQZJMNhCiIBiskClhu82S2AfERJmCRfrOUV9lQc9b7Sc1bAxsS7Kl5m2pTlhWGLq2Q8_PmEAy9AYgYAAkN0vc-ssY7KtIuQd08 Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: dd341ddc2fb445db8112727ca8142206 Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dd341ddc2fb445db8112727ca8142206", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dd341ddc2fb445db8112727ca8142206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dd341ddc2fb445db8112727ca8142206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dd341ddc2fb445db8112727ca8142206"}]}] Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: dd341ddc2fb445db8112727ca8142206 Oct 10 18:50:55.856480 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HostsAdminNegativeTestJSON-257003345-project Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: f96e88c8580242ab8d5bce9ce6c1f79a Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HostsAdminNegativeTestJSON-257003345-project Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'n-d-860863-1'} Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:50:55.857541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:50:55.859023 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 10 18:50:55.860754 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:55.860754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3bf72171-64eb-4bef-b2fd-3b3613a91a38 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:55.860754 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3bf72171-64eb-4bef-b2fd-3b3613a91a38 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-860863-1" status: 403 len: 109 microversion: 2.1 time: 0.008395 Oct 10 18:50:55.860754 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 188/432] 10.222.0.43 () {58 vars in 1167 bytes} [Mon Oct 10 18:50:55 2022] GET /compute/v2.1/os-hosts/n-d-860863-1 => generated 109 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:55.864377 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e3f85caa-9b4c-44bb-a4e7-22e90c8296ab tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:55.924317 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-627d0c72-175c-4b89-9939-baa1802e5d2c tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.428627 Oct 10 18:50:55.925455 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 245/433] 10.222.0.43 () {60 vars in 1195 bytes} [Mon Oct 10 18:50:55 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:55.934368 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f54010cc-fcf6-46a0-9569-8f67ac8a0e7e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:55.934963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f54010cc-fcf6-46a0-9569-8f67ac8a0e7e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:55.941238 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f54010cc-fcf6-46a0-9569-8f67ac8a0e7e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:55.941705 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f54010cc-fcf6-46a0-9569-8f67ac8a0e7e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:55.942129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f54010cc-fcf6-46a0-9569-8f67ac8a0e7e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:55.942812 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f54010cc-fcf6-46a0-9569-8f67ac8a0e7e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:55.943254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f54010cc-fcf6-46a0-9569-8f67ac8a0e7e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:55.943667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f54010cc-fcf6-46a0-9569-8f67ac8a0e7e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:55.949595 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e3f85caa-9b4c-44bb-a4e7-22e90c8296ab tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1990466839" status: 202 len: 0 microversion: 2.1 time: 0.091744 Oct 10 18:50:55.950202 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 189/434] 10.222.0.43 () {58 vars in 1161 bytes} [Mon Oct 10 18:50:55 2022] DELETE /compute/v2.1/flavors/1990466839 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:55.954931 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-aa3443c7-b56e-4d7d-b0f1-b0f01760b729 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:55.972685 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f54010cc-fcf6-46a0-9569-8f67ac8a0e7e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:50:56.034641 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-aa3443c7-b56e-4d7d-b0f1-b0f01760b729 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/178342327" status: 202 len: 0 microversion: 2.1 time: 0.083375 Oct 10 18:50:56.035418 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 190/435] 10.222.0.43 () {58 vars in 1158 bytes} [Mon Oct 10 18:50:55 2022] DELETE /compute/v2.1/flavors/178342327 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:56.040495 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-588d1552-6f6b-4f10-9b64-80efaf4f3224 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Calling method '.version_select at 0x7f318e674430>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:56.046760 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-588d1552-6f6b-4f10-9b64-80efaf4f3224 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-588d1552-6f6b-4f10-9b64-80efaf4f3224 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Request method failure captured: Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmOoy0ouqpq8yssRNz2-_pNmKiWiTryw5YxHlBaOshBXcjsXpVkIyQGsy9fbiHLfyPN_4WfsK8WTby1wwpD5_feaAjDuqD7ahrGUZlHWDCYUkoQRWtlIf9-DFxvyRrK4pfnf7aD9CHcD97ZG348gjUmHL7i1h5FI-Kl6x7GTQzGeUI Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:56.048483 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:56.050046 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_695ed78a31364f1582558fbab558a7e7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}] Oct 10 18:50:56.050046 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:56.050046 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:56.050046 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:56.050046 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:56.050046 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:56.050046 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:56.050046 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: d5685aa630294e55a2c24c6de9e072b0 Oct 10 18:50:56.050046 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:56.050046 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:50:56.050046 n-d-860863-1 devstack@n-api.service[127289]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:56.050046 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'nonexistent_hostname'} Oct 10 18:50:56.050046 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:56.051024 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:56.052589 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.053698 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-588d1552-6f6b-4f10-9b64-80efaf4f3224 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:56.053698 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-588d1552-6f6b-4f10-9b64-80efaf4f3224 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.013070 Oct 10 18:50:56.053698 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 191/436] 10.222.0.43 () {58 vars in 1191 bytes} [Mon Oct 10 18:50:56 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:56.055300 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b4d46c12-af77-47cf-b07a-3ae96d1797bd tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Calling method '.version_select at 0x7f318e4cddc0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:56.104688 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b4d46c12-af77-47cf-b07a-3ae96d1797bd tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/5f634545-a0e7-4f6e-8d86-504506726e1b" status: 200 len: 662 microversion: 2.1 time: 0.053215 Oct 10 18:50:56.105314 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 192/437] 10.222.0.43 () {58 vars in 1269 bytes} [Mon Oct 10 18:50:56 2022] GET /compute/v2.1/os-security-groups/5f634545-a0e7-4f6e-8d86-504506726e1b => generated 662 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:56.109785 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-85d45408-530d-418d-ae93-50822a6cae6c tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:56.130944 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-85d45408-530d-418d-ae93-50822a6cae6c tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.024524 Oct 10 18:50:56.131500 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 193/438] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:56 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:56.135654 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2327bf7a-0bc6-41e3-ac49-78d02b5a34bc tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:56.156647 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2327bf7a-0bc6-41e3-ac49-78d02b5a34bc tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.024148 Oct 10 18:50:56.157198 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 194/439] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:56 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:56.161536 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-886caafa-5072-4daf-b8a7-2c2ff5475aea tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Calling method '.version_select at 0x7f318e4a9c10>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:56.163301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-886caafa-5072-4daf-b8a7-2c2ff5475aea tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'f96e88c8580242ab8d5bce9ce6c1f79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd341ddc2fb445db8112727ca8142206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-886caafa-5072-4daf-b8a7-2c2ff5475aea tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Request method failure captured: Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-hosts/n-d-860863-1/shutdown HTTP/1.1 Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmNskSx8cCY7y5y9Uj-AIsv3isSiTkaNjSy83Xd7r6A81z86bGAbloYaPUBbTeOlvWDx3sqG84SGKQZJMNhCiIBiskClhu82S2AfERJmCRfrOUV9lQc9b7Sc1bAxsS7Kl5m2pTlhWGLq2Q8_PmEAy9AYgYAAkN0vc-ssY7KtIuQd08 Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: dd341ddc2fb445db8112727ca8142206 Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:50:56.164849 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:50:56.166358 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dd341ddc2fb445db8112727ca8142206", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dd341ddc2fb445db8112727ca8142206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dd341ddc2fb445db8112727ca8142206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dd341ddc2fb445db8112727ca8142206"}]}] Oct 10 18:50:56.166358 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:56.166358 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: dd341ddc2fb445db8112727ca8142206 Oct 10 18:50:56.166358 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:56.166358 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HostsAdminNegativeTestJSON-257003345-project Oct 10 18:50:56.166358 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:56.166358 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:56.166358 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: f96e88c8580242ab8d5bce9ce6c1f79a Oct 10 18:50:56.166358 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HostsAdminNegativeTestJSON-257003345-project Oct 10 18:50:56.166358 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:50:56.166358 n-d-860863-1 devstack@n-api.service[127289]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 10 18:50:56.166358 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'n-d-860863-1'} Oct 10 18:50:56.166358 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:56.167271 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 10 18:50:56.168634 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.169679 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-886caafa-5072-4daf-b8a7-2c2ff5475aea tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:56.169679 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-886caafa-5072-4daf-b8a7-2c2ff5475aea tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-860863-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.008062 Oct 10 18:50:56.170668 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 195/440] 10.222.0.43 () {58 vars in 1194 bytes} [Mon Oct 10 18:50:56 2022] GET /compute/v2.1/os-hosts/n-d-860863-1/shutdown => generated 113 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:56.174777 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cf14b0c4-6f2b-4326-9207-34997dd35759 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Calling method '.version_select at 0x7f318e4cdf70>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:56.280494 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f54010cc-fcf6-46a0-9569-8f67ac8a0e7e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "DELETE /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 204 len: 0 microversion: 2.1 time: 0.353427 Oct 10 18:50:56.281124 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 246/441] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:50:55 2022] DELETE /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:50:56.286484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a4a605d5-f911-4f83-95bd-5f4533a69cfb tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-150799679", "id": 1175090203, "os-flavor-access:is_public": "False"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:56.360930 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a4a605d5-f911-4f83-95bd-5f4533a69cfb tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.078570 Oct 10 18:50:56.361518 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 247/442] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:56 2022] POST /compute/v2.1/flavors => generated 429 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:56.365902 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d7db3373-8cff-46c2-a55f-fe72132f434b tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Calling method '.version_select at 0x7f318e87eaf0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:56.379582 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-d7db3373-8cff-46c2-a55f-fe72132f434b tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d7db3373-8cff-46c2-a55f-fe72132f434b tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Request method failure captured: Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmOoy0ouqpq8yssRNz2-_pNmKiWiTryw5YxHlBaOshBXcjsXpVkIyQGsy9fbiHLfyPN_4WfsK8WTby1wwpD5_feaAjDuqD7ahrGUZlHWDCYUkoQRWtlIf9-DFxvyRrK4pfnf7aD9CHcD97ZG348gjUmHL7i1h5FI-Kl6x7GTQzGeUI Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:50:56.381451 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:50:56.383089 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_695ed78a31364f1582558fbab558a7e7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}] Oct 10 18:50:56.383089 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:56.383089 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:56.383089 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:56.383089 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:56.383089 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:56.383089 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:56.383089 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: d5685aa630294e55a2c24c6de9e072b0 Oct 10 18:50:56.383089 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:56.383089 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:50:56.383089 n-d-860863-1 devstack@n-api.service[127288]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:56.383089 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'nonexistent_hostname'} Oct 10 18:50:56.383089 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:56.384009 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 10 18:50:56.388945 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:56.390125 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:56.390125 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.390125 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:56.390125 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.390125 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:56.390125 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:56.390125 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:56.390125 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:56.390125 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:56.390125 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:56.390125 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.390125 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d7db3373-8cff-46c2-a55f-fe72132f434b tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:56.390125 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d7db3373-8cff-46c2-a55f-fe72132f434b tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.020401 Oct 10 18:50:56.390125 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 248/443] 10.222.0.43 () {58 vars in 1218 bytes} [Mon Oct 10 18:50:56 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:56.393434 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-31903fbd-7ffa-478f-95e5-2eee1c46e3f7 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1494240437", "id": 1151267235, "os-flavor-access:is_public": "False"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:56.407336 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cf14b0c4-6f2b-4326-9207-34997dd35759 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/d30efed7-8e07-427b-9ea9-fe76c867e6b7" status: 202 len: 0 microversion: 2.1 time: 0.235782 Oct 10 18:50:56.411811 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 196/444] 10.222.0.43 () {58 vars in 1287 bytes} [Mon Oct 10 18:50:56 2022] DELETE /compute/v2.1/os-security-group-rules/d30efed7-8e07-427b-9ea9-fe76c867e6b7 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:56.422650 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cafc9a03-75e9-404e-aee0-9c910cecf1f9 tempest-FlavorsAdminTestJSON-1049395815 tempest-FlavorsAdminTestJSON-1049395815-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "1175090203"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:56.428477 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-cafc9a03-75e9-404e-aee0-9c910cecf1f9 tempest-FlavorsAdminTestJSON-1049395815 tempest-FlavorsAdminTestJSON-1049395815-project] HTTP exception thrown: Flavor 1175090203 could not be found. Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cafc9a03-75e9-404e-aee0-9c910cecf1f9 tempest-FlavorsAdminTestJSON-1049395815 tempest-FlavorsAdminTestJSON-1049395815-project] Request method failure captured: Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 107 Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmAQ7Vf8UOL_28293Y8-ThVUm_upU0_6OAPbM0yeCdEoBVuE8ZTUt8SUVf-YKXXjd6Cis3LiXTg2LGxbu2lQoxin_zVTeOmez3HLGXZNXTNlGKIM7UoL50ivifgR-c_qYRlMs6CkY7MYQDw3P3dLDE7JX3nr2JaK6muS2uUMNyvzfY Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: a77357b6737b4f32b4f9ad678c3b8210 Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-FlavorsAdminTestJSON-1049395815 Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:50:56.430603 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:50:56.432138 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a77357b6737b4f32b4f9ad678c3b8210", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a77357b6737b4f32b4f9ad678c3b8210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a77357b6737b4f32b4f9ad678c3b8210"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a77357b6737b4f32b4f9ad678c3b8210"}]}] Oct 10 18:50:56.432138 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-FlavorsAdminTestJSON-1049395815 Oct 10 18:50:56.432138 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: a77357b6737b4f32b4f9ad678c3b8210 Oct 10 18:50:56.432138 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1049395815 Oct 10 18:50:56.432138 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-FlavorsAdminTestJSON-1049395815-project Oct 10 18:50:56.432138 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:56.432138 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:56.432138 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: f1664f28cf584db6932c6356a83684ed Oct 10 18:50:56.432138 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-FlavorsAdminTestJSON-1049395815-project Oct 10 18:50:56.432138 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:50:56.432138 n-d-860863-1 devstack@n-api.service[127289]: {"server": {"name": "test", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "1175090203"}} Oct 10 18:50:56.432138 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:50:56.432138 n-d-860863-1 devstack@n-api.service[127289]: exception: Flavor 1175090203 could not be found. Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'b0a280ee-26ee-4c9a-8155-4326e368ccc9', 'flavorRef': '1175090203'}}} Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1175090203 could not be found. Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.433765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1175090203 could not be found. Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:56.435298 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:56.437030 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:56.437030 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:56.437030 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:56.437030 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1175090203 could not be found. Oct 10 18:50:56.437030 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.437030 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cafc9a03-75e9-404e-aee0-9c910cecf1f9 tempest-FlavorsAdminTestJSON-1049395815 tempest-FlavorsAdminTestJSON-1049395815-project] Returning 400 to user: Flavor 1175090203 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:56.437030 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cafc9a03-75e9-404e-aee0-9c910cecf1f9 tempest-FlavorsAdminTestJSON-1049395815 tempest-FlavorsAdminTestJSON-1049395815-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.020184 Oct 10 18:50:56.437030 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 197/445] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:56 2022] POST /compute/v2.1/servers => generated 81 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 18:50:56.437622 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cf5f2139-8661-41a2-b50f-391d4289a5cf tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Calling method '.version_select at 0x7f318e4a9e50>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:56.441503 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cf5f2139-8661-41a2-b50f-391d4289a5cf tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'f96e88c8580242ab8d5bce9ce6c1f79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd341ddc2fb445db8112727ca8142206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cf5f2139-8661-41a2-b50f-391d4289a5cf tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Request method failure captured: Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-hosts/n-d-860863-1/startup HTTP/1.1 Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmNskSx8cCY7y5y9Uj-AIsv3isSiTkaNjSy83Xd7r6A81z86bGAbloYaPUBbTeOlvWDx3sqG84SGKQZJMNhCiIBiskClhu82S2AfERJmCRfrOUV9lQc9b7Sc1bAxsS7Kl5m2pTlhWGLq2Q8_PmEAy9AYgYAAkN0vc-ssY7KtIuQd08 Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: dd341ddc2fb445db8112727ca8142206 Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:50:56.443043 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:50:56.444604 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dd341ddc2fb445db8112727ca8142206", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dd341ddc2fb445db8112727ca8142206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dd341ddc2fb445db8112727ca8142206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dd341ddc2fb445db8112727ca8142206"}]}] Oct 10 18:50:56.444604 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:56.444604 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: dd341ddc2fb445db8112727ca8142206 Oct 10 18:50:56.444604 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:56.444604 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HostsAdminNegativeTestJSON-257003345-project Oct 10 18:50:56.444604 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:56.444604 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:56.444604 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: f96e88c8580242ab8d5bce9ce6c1f79a Oct 10 18:50:56.444604 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HostsAdminNegativeTestJSON-257003345-project Oct 10 18:50:56.444604 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:50:56.444604 n-d-860863-1 devstack@n-api.service[127289]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 10 18:50:56.444604 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'n-d-860863-1'} Oct 10 18:50:56.444604 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:56.445485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 10 18:50:56.446933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:56.448102 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cf5f2139-8661-41a2-b50f-391d4289a5cf tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:56.448102 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cf5f2139-8661-41a2-b50f-391d4289a5cf tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-d-860863-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.010369 Oct 10 18:50:56.448102 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 198/446] 10.222.0.43 () {58 vars in 1191 bytes} [Mon Oct 10 18:50:56 2022] GET /compute/v2.1/os-hosts/n-d-860863-1/startup => generated 110 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:56.449713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-819272038", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "1909171365", "adminPass": "***", "networks": [{"uuid": "1953c544-78cb-4795-830d-2d7afa10c9d5"}], "security_groups": [{"name": "tempest-securitygroup--53381828"}], "key_name": "tempest-keypair-1701984569", "user_data": "}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:56.476060 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-31903fbd-7ffa-478f-95e5-2eee1c46e3f7 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.090151 Oct 10 18:50:56.480670 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 249/447] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:56 2022] POST /compute/v2.1/flavors => generated 439 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:56.482385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2ff95e4e-4fd9-4b37-9122-70b7b55cb3e5 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Calling method '.version_select at 0x7f318e743940>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:56.646038 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] validate_networks() for [('1953c544-78cb-4795-830d-2d7afa10c9d5', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:50:56.731088 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2ff95e4e-4fd9-4b37-9122-70b7b55cb3e5 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/5f634545-a0e7-4f6e-8d86-504506726e1b" status: 202 len: 0 microversion: 2.1 time: 0.253250 Oct 10 18:50:56.731953 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 250/448] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:50:56 2022] DELETE /compute/v2.1/os-security-groups/5f634545-a0e7-4f6e-8d86-504506726e1b => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:56.737173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3e6f2364-c33c-42eb-9f52-522442854d0b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:56.738139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3e6f2364-c33c-42eb-9f52-522442854d0b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:56.744234 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e6f2364-c33c-42eb-9f52-522442854d0b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:56.744757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e6f2364-c33c-42eb-9f52-522442854d0b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:56.745189 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e6f2364-c33c-42eb-9f52-522442854d0b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:56.745892 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e6f2364-c33c-42eb-9f52-522442854d0b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:56.746397 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e6f2364-c33c-42eb-9f52-522442854d0b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:56.746866 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e6f2364-c33c-42eb-9f52-522442854d0b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:56.889601 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3e6f2364-c33c-42eb-9f52-522442854d0b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:56.897581 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3e6f2364-c33c-42eb-9f52-522442854d0b tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1542 microversion: 2.1 time: 0.164357 Oct 10 18:50:56.901405 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 251/449] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:56 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1542 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:56.903551 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8742df67-fe7b-4b03-a206-3654ae1cf277 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:56.993167 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8742df67-fe7b-4b03-a206-3654ae1cf277 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1175090203" status: 202 len: 0 microversion: 2.1 time: 0.093654 Oct 10 18:50:56.998762 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 252/450] 10.222.0.43 () {58 vars in 1161 bytes} [Mon Oct 10 18:50:56 2022] DELETE /compute/v2.1/flavors/1175090203 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:57.005465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-610b545d-3c8f-4a71-bc26-e8c313628954 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Calling method '.version_select at 0x7f318e733c10>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:57.014885 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-610b545d-3c8f-4a71-bc26-e8c313628954 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-610b545d-3c8f-4a71-bc26-e8c313628954 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Request method failure captured: Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmOoy0ouqpq8yssRNz2-_pNmKiWiTryw5YxHlBaOshBXcjsXpVkIyQGsy9fbiHLfyPN_4WfsK8WTby1wwpD5_feaAjDuqD7ahrGUZlHWDCYUkoQRWtlIf9-DFxvyRrK4pfnf7aD9CHcD97ZG348gjUmHL7i1h5FI-Kl6x7GTQzGeUI Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:50:57.016593 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:50:57.017952 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_695ed78a31364f1582558fbab558a7e7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}] Oct 10 18:50:57.017952 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:57.017952 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:57.017952 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:57.017952 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:57.017952 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:57.017952 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:57.017952 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: d5685aa630294e55a2c24c6de9e072b0 Oct 10 18:50:57.017952 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:57.017952 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:50:57.017952 n-d-860863-1 devstack@n-api.service[127288]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:57.017952 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'nonexistent_hostname'} Oct 10 18:50:57.017952 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:57.018759 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 10 18:50:57.030614 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:57.032017 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:57.032017 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.032017 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:57.032017 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.032017 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.032017 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:57.032017 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:57.032017 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:57.032017 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:57.032017 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:57.032017 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.032017 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-610b545d-3c8f-4a71-bc26-e8c313628954 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:57.032017 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-610b545d-3c8f-4a71-bc26-e8c313628954 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.018282 Oct 10 18:50:57.032017 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 253/451] 10.222.0.43 () {58 vars in 1215 bytes} [Mon Oct 10 18:50:56 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:57.033088 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-afdd1712-cdb5-41ca-8105-9f2bcf47d718 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1761d7202244471b878a6f67265462e0"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:57.092027 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-afdd1712-cdb5-41ca-8105-9f2bcf47d718 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] HTTP exception thrown: Flavor access not found for 32 / 1761d7202244471b878a6f67265462e0 combination. Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-afdd1712-cdb5-41ca-8105-9f2bcf47d718 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Request method failure captured: Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/flavors/1151267235/action HTTP/1.1 Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 70 Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmDbG6szSt2eSH_HjFJJBuJnzoN-jpHMxOguqBEYvUxe6Wauko0CoKFVCud3AAO2_ztiHLgVX0G7b9hJ-nfG5N8mMdK7QwEQqoSkKR601B06Gu0R1Atxb4vD8h74NzK4rpJGiKr7ymwMKH--0QpE5YGv_usblRSLkDGO5wfsn-MEoE Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 7cb0fa5676524795b1e25892a1846c11 Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1086239416 Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:50:57.094114 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:50:57.100847 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7cb0fa5676524795b1e25892a1846c11", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7cb0fa5676524795b1e25892a1846c11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7cb0fa5676524795b1e25892a1846c11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7cb0fa5676524795b1e25892a1846c11"}]}] Oct 10 18:50:57.100847 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1086239416 Oct 10 18:50:57.100847 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 7cb0fa5676524795b1e25892a1846c11 Oct 10 18:50:57.100847 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1086239416 Oct 10 18:50:57.100847 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin Oct 10 18:50:57.100847 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:57.100847 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:57.100847 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: cc5e5a2cd9cc4d74bb20565d8461881d Oct 10 18:50:57.100847 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin Oct 10 18:50:57.100847 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:50:57.100847 n-d-860863-1 devstack@n-api.service[127288]: {"removeTenantAccess": {"tenant": "1761d7202244471b878a6f67265462e0"}} Oct 10 18:50:57.100847 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: exception: Flavor access not found for 32 / 1761d7202244471b878a6f67265462e0 combination. Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '1151267235', 'body': {'removeTenantAccess': {'tenant': '1761d7202244471b878a6f67265462e0'}}} Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 10 18:50:57.101718 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 32 / 1761d7202244471b878a6f67265462e0 combination. Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 32 / 1761d7202244471b878a6f67265462e0 combination. Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.103664 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.105083 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:57.105083 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:57.105083 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:57.105083 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:57.105083 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 32 / 1761d7202244471b878a6f67265462e0 combination. Oct 10 18:50:57.105083 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.105083 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-afdd1712-cdb5-41ca-8105-9f2bcf47d718 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Returning 404 to user: Flavor access not found for 32 / 1761d7202244471b878a6f67265462e0 combination. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:57.105083 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-afdd1712-cdb5-41ca-8105-9f2bcf47d718 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1151267235/action" status: 404 len: 124 microversion: 2.1 time: 0.075655 Oct 10 18:50:57.105083 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 254/452] 10.222.0.43 () {60 vars in 1200 bytes} [Mon Oct 10 18:50:57 2022] POST /compute/v2.1/flavors/1151267235/action => generated 124 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:57.105763 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3dd6459f-1b70-4c65-a53c-d9fd57729ae7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:57.105763 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3dd6459f-1b70-4c65-a53c-d9fd57729ae7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:57.108761 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3dd6459f-1b70-4c65-a53c-d9fd57729ae7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:57.109291 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3dd6459f-1b70-4c65-a53c-d9fd57729ae7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:57.109727 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3dd6459f-1b70-4c65-a53c-d9fd57729ae7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:57.110423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3dd6459f-1b70-4c65-a53c-d9fd57729ae7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:57.110990 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3dd6459f-1b70-4c65-a53c-d9fd57729ae7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:57.111421 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3dd6459f-1b70-4c65-a53c-d9fd57729ae7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:57.249201 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3dd6459f-1b70-4c65-a53c-d9fd57729ae7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:57.257410 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3dd6459f-1b70-4c65-a53c-d9fd57729ae7 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca" status: 200 len: 1324 microversion: 2.1 time: 0.160076 Oct 10 18:50:57.257994 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 255/453] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:57 2022] GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca => generated 1324 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:57.269617 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e176904b-a75f-43f4-ae6f-2c512e03929a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:57.270423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e176904b-a75f-43f4-ae6f-2c512e03929a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:57.277892 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e176904b-a75f-43f4-ae6f-2c512e03929a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:57.278377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e176904b-a75f-43f4-ae6f-2c512e03929a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:57.278811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e176904b-a75f-43f4-ae6f-2c512e03929a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:57.279617 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e176904b-a75f-43f4-ae6f-2c512e03929a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:57.280052 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e176904b-a75f-43f4-ae6f-2c512e03929a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:57.280476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e176904b-a75f-43f4-ae6f-2c512e03929a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:57.401015 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-e176904b-a75f-43f4-ae6f-2c512e03929a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:50:57.460986 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e176904b-a75f-43f4-ae6f-2c512e03929a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.195098 Oct 10 18:50:57.461565 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 256/454] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:57 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:57.466270 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-762cac47-532d-4df7-9ed0-370c8aed87f2 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Calling method '.version_select at 0x7f318e9c23a0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:57.493145 n-d-860863-1 devstack@n-api.service[127288]: DEBUG neutronclient.v2_0.client [None req-762cac47-532d-4df7-9ed0-370c8aed87f2 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 83e02b2d-a4e6-4754-9d81-c3c88a2f7f74 does not exist", "detail": ""}} {{(pid=127288) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:50:57.493775 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.security_group_api [None req-762cac47-532d-4df7-9ed0-370c8aed87f2 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Neutron security group 83e02b2d-a4e6-4754-9d81-c3c88a2f7f74 not found {{(pid=127288) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:50:57.494294 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-762cac47-532d-4df7-9ed0-370c8aed87f2 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] HTTP exception thrown: Security group 83e02b2d-a4e6-4754-9d81-c3c88a2f7f74 does not exist Oct 10 18:50:57.494294 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-655a2f88-77ea-49a9-8f6c-06dbb606d805'] Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-762cac47-532d-4df7-9ed0-370c8aed87f2 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Request method failure captured: Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/os-security-groups/83e02b2d-a4e6-4754-9d81-c3c88a2f7f74 HTTP/1.1 Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmC-8FNBAQMQqr0iqsSDq9sL0YLYeKa3V0X-zZHDkPwNi_JmdA3yYs4fNKwEnByrksjcJg-m-kqTmWd5ywdTMF1urUrNjWLK-pYZ1_7d8_w5nXNo0H5gVASWeAg1z2r8X0_CqbXpIPo3IYKeVQ8pMWuYt18qoXCreyw1JlDI0N6RQg Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b74467ee1b3e4ec98748d86f84e0c7e4 Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-603742128 Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:57.498394 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:57.501927 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b74467ee1b3e4ec98748d86f84e0c7e4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b74467ee1b3e4ec98748d86f84e0c7e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b74467ee1b3e4ec98748d86f84e0c7e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b74467ee1b3e4ec98748d86f84e0c7e4"}]}] Oct 10 18:50:57.501927 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupRulesTestJSON-603742128 Oct 10 18:50:57.501927 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b74467ee1b3e4ec98748d86f84e0c7e4 Oct 10 18:50:57.501927 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-603742128 Oct 10 18:50:57.501927 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupRulesTestJSON-603742128-project Oct 10 18:50:57.501927 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:57.501927 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:57.501927 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: e46a82daecb043428aff3af2472d20af Oct 10 18:50:57.501927 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupRulesTestJSON-603742128-project Oct 10 18:50:57.501927 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:50:57.501927 n-d-860863-1 devstack@n-api.service[127288]: exception: Security group 83e02b2d-a4e6-4754-9d81-c3c88a2f7f74 does not exist Oct 10 18:50:57.501927 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-655a2f88-77ea-49a9-8f6c-06dbb606d805'] Oct 10 18:50:57.501927 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '83e02b2d-a4e6-4754-9d81-c3c88a2f7f74'} Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:50:57.502750 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 83e02b2d-a4e6-4754-9d81-c3c88a2f7f74 does not exist Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-655a2f88-77ea-49a9-8f6c-06dbb606d805'] Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:50:57.504301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 83e02b2d-a4e6-4754-9d81-c3c88a2f7f74 does not exist Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-655a2f88-77ea-49a9-8f6c-06dbb606d805'] Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 83e02b2d-a4e6-4754-9d81-c3c88a2f7f74 does not exist Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-655a2f88-77ea-49a9-8f6c-06dbb606d805'] Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.505427 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.506744 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:57.506744 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:57.506744 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:57.506744 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:57.506744 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 83e02b2d-a4e6-4754-9d81-c3c88a2f7f74 does not exist Oct 10 18:50:57.506744 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-655a2f88-77ea-49a9-8f6c-06dbb606d805'] Oct 10 18:50:57.506744 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.506744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-762cac47-532d-4df7-9ed0-370c8aed87f2 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Returning 404 to user: Security group 83e02b2d-a4e6-4754-9d81-c3c88a2f7f74 does not exist Oct 10 18:50:57.506744 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-655a2f88-77ea-49a9-8f6c-06dbb606d805'] {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:57.506744 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-762cac47-532d-4df7-9ed0-370c8aed87f2 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/83e02b2d-a4e6-4754-9d81-c3c88a2f7f74" status: 404 len: 194 microversion: 2.1 time: 0.037286 Oct 10 18:50:57.506744 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 257/455] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:50:57 2022] DELETE /compute/v2.1/os-security-groups/83e02b2d-a4e6-4754-9d81-c3c88a2f7f74 => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:57.507594 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0271d481-48a6-4aac-817b-e00a1776f36a tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:57.529444 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0271d481-48a6-4aac-817b-e00a1776f36a tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.027873 Oct 10 18:50:57.530282 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 258/456] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:57 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:57.534459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1cb44f2f-5f05-4c38-b095-2076ab1b8714 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Action: 'update', calling method: .version_select at 0x7f318e7331f0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1cb44f2f-5f05-4c38-b095-2076ab1b8714 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Request method failure captured: Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: request: PUT /compute/v2.1/os-hosts/n-d-860863-1 HTTP/1.1 Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 51 Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmOoy0ouqpq8yssRNz2-_pNmKiWiTryw5YxHlBaOshBXcjsXpVkIyQGsy9fbiHLfyPN_4WfsK8WTby1wwpD5_feaAjDuqD7ahrGUZlHWDCYUkoQRWtlIf9-DFxvyRrK4pfnf7aD9CHcD97ZG348gjUmHL7i1h5FI-Kl6x7GTQzGeUI Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:50:57.538381 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:50:57.539737 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_695ed78a31364f1582558fbab558a7e7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}] Oct 10 18:50:57.539737 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:57.539737 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:57.539737 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:57.539737 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:57.539737 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:57.539737 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:57.539737 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: d5685aa630294e55a2c24c6de9e072b0 Oct 10 18:50:57.539737 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:57.539737 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:50:57.539737 n-d-860863-1 devstack@n-api.service[127288]: {"status": "enable", "maintenance_mode": "invalid"} Oct 10 18:50:57.539737 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:50:57.539737 n-d-860863-1 devstack@n-api.service[127288]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'n-d-860863-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise error Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'disable', Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'Enable', Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'Disable', Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi On instance: Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'invalid' Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.540507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.543942 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:57.545385 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:57.545385 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 18:50:57.545385 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 18:50:57.545385 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 18:50:57.545385 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.545385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1cb44f2f-5f05-4c38-b095-2076ab1b8714 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:57.545385 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1cb44f2f-5f05-4c38-b095-2076ab1b8714 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-860863-1" status: 400 len: 199 microversion: 2.1 time: 0.008769 Oct 10 18:50:57.545385 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 259/457] 10.222.0.43 () {60 vars in 1187 bytes} [Mon Oct 10 18:50:57 2022] PUT /compute/v2.1/os-hosts/n-d-860863-1 => generated 199 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:50:57.551887 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d58d8f70-582c-4b10-aa14-928ff8a71814 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:57.616908 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:50:57.617430 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:50:57.617999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:50:57.618506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:50:57.619109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:50:57.628520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:57.629026 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:57.629464 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:57.630259 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:57.630709 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:57.631131 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:57.633739 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d58d8f70-582c-4b10-aa14-928ff8a71814 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1151267235" status: 202 len: 0 microversion: 2.1 time: 0.088014 Oct 10 18:50:57.634472 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 260/458] 10.222.0.43 () {58 vars in 1161 bytes} [Mon Oct 10 18:50:57 2022] DELETE /compute/v2.1/flavors/1151267235 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:57.640568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d8ae3943-0da9-46f3-b50f-0c20526f52c5 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Calling method '.version_select at 0x7f318e7e8430>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:57.646972 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:DELETE=10,nova_api:UPDATE=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:57.653760 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Getting quotas for project ea2029d88758407a9415b15747079079. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:50:57.658035 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Getting quotas for user ad2be8da9a544318b112ba8e8d3f498a and project ea2029d88758407a9415b15747079079. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:50:57.674397 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:50:57.677641 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:50:57.828175 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d2a46b82-a1e3-4935-9fec-69b6bf45510c tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.382142 Oct 10 18:50:57.829436 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 199/459] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:56 2022] POST /compute/v2.1/servers => generated 400 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:50:57.833961 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:57.841732 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dfe19034-b13d-47c0-b25f-63fc55be3dd5 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Action: 'update', calling method: .version_select at 0x7f318e674280>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dfe19034-b13d-47c0-b25f-63fc55be3dd5 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Request method failure captured: Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: request: PUT /compute/v2.1/os-hosts/n-d-860863-1 HTTP/1.1 Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 51 Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmOoy0ouqpq8yssRNz2-_pNmKiWiTryw5YxHlBaOshBXcjsXpVkIyQGsy9fbiHLfyPN_4WfsK8WTby1wwpD5_feaAjDuqD7ahrGUZlHWDCYUkoQRWtlIf9-DFxvyRrK4pfnf7aD9CHcD97ZG348gjUmHL7i1h5FI-Kl6x7GTQzGeUI Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:57.846018 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:57.852300 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_695ed78a31364f1582558fbab558a7e7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}] Oct 10 18:50:57.852300 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:57.852300 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:57.852300 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:57.852300 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:57.852300 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:57.852300 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:57.852300 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: d5685aa630294e55a2c24c6de9e072b0 Oct 10 18:50:57.852300 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:57.852300 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:50:57.852300 n-d-860863-1 devstack@n-api.service[127289]: {"status": "invalid", "maintenance_mode": "enable"} Oct 10 18:50:57.852300 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:50:57.852300 n-d-860863-1 devstack@n-api.service[127289]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'n-d-860863-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise error Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi 'disable', Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi 'Enable', Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi 'Disable', Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi On instance: Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi 'invalid' Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.853116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:57.855116 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:57.858469 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:57.858469 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 18:50:57.858469 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 18:50:57.858469 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 10 18:50:57.858469 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:57.858469 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dfe19034-b13d-47c0-b25f-63fc55be3dd5 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:57.858469 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dfe19034-b13d-47c0-b25f-63fc55be3dd5 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-860863-1" status: 400 len: 189 microversion: 2.1 time: 0.016981 Oct 10 18:50:57.858469 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 200/460] 10.222.0.43 () {60 vars in 1187 bytes} [Mon Oct 10 18:50:57 2022] PUT /compute/v2.1/os-hosts/n-d-860863-1 => generated 189 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:50:57.863740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ce78cce6-7e6b-45ef-a00a-217817eb3873 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2118550478", "id": 589510773, "os-flavor-access:is_public": "False"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:57.865562 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=6 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:50:58.014987 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ce78cce6-7e6b-45ef-a00a-217817eb3873 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.156505 Oct 10 18:50:58.014987 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 201/461] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:57 2022] POST /compute/v2.1/flavors => generated 412 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:58.017149 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b71dba6a-e9c4-4998-bca8-7b3cdca0c3d5 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:58.059914 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b71dba6a-e9c4-4998-bca8-7b3cdca0c3d5 tempest-FlavorsAccessNegativeTestJSON-1086239416 tempest-FlavorsAccessNegativeTestJSON-1086239416-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.052535 Oct 10 18:50:58.060511 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 202/462] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:58 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:58.076122 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-6b56dbbc-3a44-4392-9b6a-26eb1c38c959 req-d36f1e8e-62f4-4275-bf0f-48c55d27fba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a71922-7bbf-4415-b3f5-2c2716b7c7c1", "name": "network-vif-deleted", "tag": "c279876a-95a9-436e-bc98-b4a82d21aa0b"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:58.095522 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6b56dbbc-3a44-4392-9b6a-26eb1c38c959 req-d36f1e8e-62f4-4275-bf0f-48c55d27fba0 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:58.096279 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6b56dbbc-3a44-4392-9b6a-26eb1c38c959 req-d36f1e8e-62f4-4275-bf0f-48c55d27fba0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:58.096910 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6b56dbbc-3a44-4392-9b6a-26eb1c38c959 req-d36f1e8e-62f4-4275-bf0f-48c55d27fba0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:58.109935 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-6b56dbbc-3a44-4392-9b6a-26eb1c38c959 req-d36f1e8e-62f4-4275-bf0f-48c55d27fba0 service nova] Creating event network-vif-deleted:c279876a-95a9-436e-bc98-b4a82d21aa0b for instance f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 on n-h1-860863-1 Oct 10 18:50:58.114772 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-6b56dbbc-3a44-4392-9b6a-26eb1c38c959 req-d36f1e8e-62f4-4275-bf0f-48c55d27fba0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053093 Oct 10 18:50:58.115697 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 203/463] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:58.123590 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-20a7a63d-bc6a-4574-b9d6-79fedfd6a536 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:58.124726 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-20a7a63d-bc6a-4574-b9d6-79fedfd6a536 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:58.129500 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d8ae3943-0da9-46f3-b50f-0c20526f52c5 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/f82a5e0b-472b-44f2-b881-c8d9b54826b5" status: 202 len: 0 microversion: 2.1 time: 0.493636 Oct 10 18:50:58.132920 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 261/464] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:50:57 2022] DELETE /compute/v2.1/os-security-groups/f82a5e0b-472b-44f2-b881-c8d9b54826b5 => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:58.138659 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6f477632-676d-4fce-9e42-7115d2a7f889 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Action: 'update', calling method: .version_select at 0x7f318e733dc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:58.142371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6f477632-676d-4fce-9e42-7115d2a7f889 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'f96e88c8580242ab8d5bce9ce6c1f79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd341ddc2fb445db8112727ca8142206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6f477632-676d-4fce-9e42-7115d2a7f889 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Request method failure captured: Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: request: PUT /compute/v2.1/os-hosts/n-d-860863-1 HTTP/1.1 Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 50 Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmNskSx8cCY7y5y9Uj-AIsv3isSiTkaNjSy83Xd7r6A81z86bGAbloYaPUBbTeOlvWDx3sqG84SGKQZJMNhCiIBiskClhu82S2AfERJmCRfrOUV9lQc9b7Sc1bAxsS7Kl5m2pTlhWGLq2Q8_PmEAy9AYgYAAkN0vc-ssY7KtIuQd08 Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: dd341ddc2fb445db8112727ca8142206 Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:58.144325 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:58.145845 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dd341ddc2fb445db8112727ca8142206", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dd341ddc2fb445db8112727ca8142206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dd341ddc2fb445db8112727ca8142206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dd341ddc2fb445db8112727ca8142206"}]}] Oct 10 18:50:58.145845 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:58.145845 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: dd341ddc2fb445db8112727ca8142206 Oct 10 18:50:58.145845 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-257003345 Oct 10 18:50:58.145845 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-HostsAdminNegativeTestJSON-257003345-project Oct 10 18:50:58.145845 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:58.145845 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:58.145845 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: f96e88c8580242ab8d5bce9ce6c1f79a Oct 10 18:50:58.145845 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-HostsAdminNegativeTestJSON-257003345-project Oct 10 18:50:58.145845 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:50:58.145845 n-d-860863-1 devstack@n-api.service[127288]: {"status": "enable", "maintenance_mode": "enable"} Oct 10 18:50:58.145845 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:50:58.145845 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 10 18:50:58.145845 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'n-d-860863-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:58.146834 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 10 18:50:58.148222 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.150858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6f477632-676d-4fce-9e42-7115d2a7f889 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:58.152673 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6f477632-676d-4fce-9e42-7115d2a7f889 tempest-HostsAdminNegativeTestJSON-257003345 tempest-HostsAdminNegativeTestJSON-257003345-project] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-860863-1" status: 403 len: 111 microversion: 2.1 time: 0.017702 Oct 10 18:50:58.154511 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 262/465] 10.222.0.43 () {60 vars in 1187 bytes} [Mon Oct 10 18:50:58 2022] PUT /compute/v2.1/os-hosts/n-d-860863-1 => generated 111 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:58.159645 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f4d27cb0-4a51-4bce-ae01-7b8b9a9f81c2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:58.160444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f4d27cb0-4a51-4bce-ae01-7b8b9a9f81c2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:58.172931 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4d27cb0-4a51-4bce-ae01-7b8b9a9f81c2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:58.173328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4d27cb0-4a51-4bce-ae01-7b8b9a9f81c2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:58.176390 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4d27cb0-4a51-4bce-ae01-7b8b9a9f81c2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:58.181038 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4d27cb0-4a51-4bce-ae01-7b8b9a9f81c2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:58.181593 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4d27cb0-4a51-4bce-ae01-7b8b9a9f81c2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:58.182073 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4d27cb0-4a51-4bce-ae01-7b8b9a9f81c2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:58.223270 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4d27cb0-4a51-4bce-ae01-7b8b9a9f81c2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:58.223807 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4d27cb0-4a51-4bce-ae01-7b8b9a9f81c2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:58.224314 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4d27cb0-4a51-4bce-ae01-7b8b9a9f81c2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:58.226312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-f4d27cb0-4a51-4bce-ae01-7b8b9a9f81c2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lazy-loading 'fault' on Instance uuid f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:50:58.237117 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-20a7a63d-bc6a-4574-b9d6-79fedfd6a536 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:58.246096 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-20a7a63d-bc6a-4574-b9d6-79fedfd6a536 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1264 microversion: 2.1 time: 0.128971 Oct 10 18:50:58.247204 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 204/466] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:58 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1264 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:58.251898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bd5a139b-f083-4762-8511-041ef8c789c0 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-321385421", "id": 1433117408, "os-flavor-access:is_public": "True"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:58.306315 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f4d27cb0-4a51-4bce-ae01-7b8b9a9f81c2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831696709a6b473fbd54b99883d38c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd610c145b1284aa293c1f456bf476602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:58.320088 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f4d27cb0-4a51-4bce-ae01-7b8b9a9f81c2 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 200 len: 1322 microversion: 2.1 time: 0.163890 Oct 10 18:50:58.329689 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 263/467] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:58 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:58.337173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b1678dbb-e6ff-42d5-b5cd-367deb4bde72 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Calling method '.version_select at 0x7f318e733d30>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:58.379830 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bd5a139b-f083-4762-8511-041ef8c789c0 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.131339 Oct 10 18:50:58.381601 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 205/468] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:50:58 2022] POST /compute/v2.1/flavors => generated 413 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:58.387938 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-77986499-aa77-4210-a006-bf15cb2cb374 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Action: 'update', calling method: .version_select at 0x7f318e62fdc0>, body: {"status": null, "maintenance_mode": null} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-77986499-aa77-4210-a006-bf15cb2cb374 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Request method failure captured: Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: request: PUT /compute/v2.1/os-hosts/n-d-860863-1 HTTP/1.1 Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 42 Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmOoy0ouqpq8yssRNz2-_pNmKiWiTryw5YxHlBaOshBXcjsXpVkIyQGsy9fbiHLfyPN_4WfsK8WTby1wwpD5_feaAjDuqD7ahrGUZlHWDCYUkoQRWtlIf9-DFxvyRrK4pfnf7aD9CHcD97ZG348gjUmHL7i1h5FI-Kl6x7GTQzGeUI Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:58.391737 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:58.393096 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_695ed78a31364f1582558fbab558a7e7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}] Oct 10 18:50:58.393096 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:58.393096 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:58.393096 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:58.393096 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:58.393096 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:58.393096 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:58.393096 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: d5685aa630294e55a2c24c6de9e072b0 Oct 10 18:50:58.393096 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:58.393096 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:50:58.393096 n-d-860863-1 devstack@n-api.service[127289]: {"status": null, "maintenance_mode": null} Oct 10 18:50:58.393096 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:50:58.393096 n-d-860863-1 devstack@n-api.service[127289]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 10 18:50:58.393096 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'n-d-860863-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise error Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi 'disable', Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi 'Enable', Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi 'Disable', Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi On instance: Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi None Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:58.393944 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:58.398434 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:58.399561 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 18:50:58.399561 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 18:50:58.399561 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 10 18:50:58.399561 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.399561 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-77986499-aa77-4210-a006-bf15cb2cb374 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:58.399561 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-77986499-aa77-4210-a006-bf15cb2cb374 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/n-d-860863-1" status: 400 len: 127 microversion: 2.1 time: 0.010316 Oct 10 18:50:58.399561 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 206/469] 10.222.0.43 () {60 vars in 1187 bytes} [Mon Oct 10 18:50:58 2022] PUT /compute/v2.1/os-hosts/n-d-860863-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:50:58.399561 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6cd216a6-9a5e-4657-a1db-c7c7a32ed9dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:58.402146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6cd216a6-9a5e-4657-a1db-c7c7a32ed9dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:58.409009 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6cd216a6-9a5e-4657-a1db-c7c7a32ed9dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:58.409484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6cd216a6-9a5e-4657-a1db-c7c7a32ed9dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:58.410122 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6cd216a6-9a5e-4657-a1db-c7c7a32ed9dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:58.411415 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6cd216a6-9a5e-4657-a1db-c7c7a32ed9dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:58.412021 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6cd216a6-9a5e-4657-a1db-c7c7a32ed9dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:58.413103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6cd216a6-9a5e-4657-a1db-c7c7a32ed9dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:58.563214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6cd216a6-9a5e-4657-a1db-c7c7a32ed9dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:58.571964 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6cd216a6-9a5e-4657-a1db-c7c7a32ed9dd tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca" status: 200 len: 1324 microversion: 2.1 time: 0.176822 Oct 10 18:50:58.573164 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 207/470] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:58 2022] GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca => generated 1324 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:58.578604 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dda7e6be-5c77-47ea-b25f-b6339b6d1f97 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:58.597808 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dda7e6be-5c77-47ea-b25f-b6339b6d1f97 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.022751 Oct 10 18:50:58.599418 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 208/471] 10.222.0.43 () {58 vars in 1169 bytes} [Mon Oct 10 18:50:58 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:58.604704 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6cfd680f-839c-43f5-98ca-630d6bc9d904 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Action: 'update', calling method: .version_select at 0x7f318e674310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:50:58.608901 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.hosts [None req-6cfd680f-839c-43f5-98ca-630d6bc9d904 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Enabling host nonexistent_hostname. Oct 10 18:50:58.616944 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-6cfd680f-839c-43f5-98ca-630d6bc9d904 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6cfd680f-839c-43f5-98ca-630d6bc9d904 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Request method failure captured: Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 50 Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmOoy0ouqpq8yssRNz2-_pNmKiWiTryw5YxHlBaOshBXcjsXpVkIyQGsy9fbiHLfyPN_4WfsK8WTby1wwpD5_feaAjDuqD7ahrGUZlHWDCYUkoQRWtlIf9-DFxvyRrK4pfnf7aD9CHcD97ZG348gjUmHL7i1h5FI-Kl6x7GTQzGeUI Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:50:58.620958 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:50:58.622295 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_695ed78a31364f1582558fbab558a7e7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/695ed78a31364f1582558fbab558a7e7"}]}] Oct 10 18:50:58.622295 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:58.622295 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 695ed78a31364f1582558fbab558a7e7 Oct 10 18:50:58.622295 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-776994333 Oct 10 18:50:58.622295 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:58.622295 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:50:58.622295 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:50:58.622295 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: d5685aa630294e55a2c24c6de9e072b0 Oct 10 18:50:58.622295 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HostsAdminNegativeTestJSON-776994333-project-admin Oct 10 18:50:58.622295 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:50:58.622295 n-d-860863-1 devstack@n-api.service[127289]: {"status": "enable", "maintenance_mode": "enable"} Oct 10 18:50:58.622295 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:50:58.622295 n-d-860863-1 devstack@n-api.service[127289]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:58.622295 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 10 18:50:58.623460 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:50:58.624735 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:50:58.628375 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6cfd680f-839c-43f5-98ca-630d6bc9d904 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:58.629846 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6cfd680f-839c-43f5-98ca-630d6bc9d904 tempest-HostsAdminNegativeTestJSON-776994333 tempest-HostsAdminNegativeTestJSON-776994333-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.021827 Oct 10 18:50:58.632653 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 209/472] 10.222.0.43 () {60 vars in 1211 bytes} [Mon Oct 10 18:50:58 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:50:58.638345 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ed6f408e-b96d-4c04-af1d-7700781d5812 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:58.639952 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ed6f408e-b96d-4c04-af1d-7700781d5812 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:58.646041 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ed6f408e-b96d-4c04-af1d-7700781d5812 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:58.646748 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ed6f408e-b96d-4c04-af1d-7700781d5812 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:58.647547 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ed6f408e-b96d-4c04-af1d-7700781d5812 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:58.648321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ed6f408e-b96d-4c04-af1d-7700781d5812 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:58.649006 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ed6f408e-b96d-4c04-af1d-7700781d5812 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:58.649547 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ed6f408e-b96d-4c04-af1d-7700781d5812 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:58.746173 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-ed6f408e-b96d-4c04-af1d-7700781d5812 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:50:58.765115 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ed6f408e-b96d-4c04-af1d-7700781d5812 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.131100 Oct 10 18:50:58.766844 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 210/473] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:50:58 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:50:58.771755 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b0c33de3-0931-4648-ba67-565bf3c34552 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:58.782498 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b0c33de3-0931-4648-ba67-565bf3c34552 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.014100 Oct 10 18:50:58.783103 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 211/474] 10.222.0.43 () {58 vars in 1177 bytes} [Mon Oct 10 18:50:58 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:50:58.796884 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5fc48342-7364-4267-8386-f31cae66935b tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:58.807949 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5fc48342-7364-4267-8386-f31cae66935b tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.014657 Oct 10 18:50:58.808999 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 212/475] 10.222.0.43 () {58 vars in 1171 bytes} [Mon Oct 10 18:50:58 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:50:58.822945 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5bfba268-07a8-4e39-8f67-b86ac29b5905 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:58.836900 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5bfba268-07a8-4e39-8f67-b86ac29b5905 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.019257 Oct 10 18:50:58.837774 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 213/476] 10.222.0.43 () {58 vars in 1169 bytes} [Mon Oct 10 18:50:58 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:50:58.860263 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ac6998f9-9d05-4142-aaf7-910e1174fcaf tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:58.894957 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ac6998f9-9d05-4142-aaf7-910e1174fcaf tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6222 microversion: 2.1 time: 0.042606 Oct 10 18:50:58.895815 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 214/477] 10.222.0.43 () {58 vars in 1169 bytes} [Mon Oct 10 18:50:58 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6222 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:58.915661 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3ae67814-554b-4241-b26a-0b127bdc05b9 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:58.937992 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3ae67814-554b-4241-b26a-0b127bdc05b9 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6222 microversion: 2.1 time: 0.025864 Oct 10 18:50:58.938531 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 215/478] 10.222.0.43 () {58 vars in 1175 bytes} [Mon Oct 10 18:50:58 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6222 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:50:58.958001 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cc4ee61d-223d-4544-9e31-e59fd70bf2c8 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:58.982261 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cc4ee61d-223d-4544-9e31-e59fd70bf2c8 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6222 microversion: 2.1 time: 0.027704 Oct 10 18:50:58.982852 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 216/479] 10.222.0.43 () {58 vars in 1173 bytes} [Mon Oct 10 18:50:58 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6222 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:50:58.997720 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b1678dbb-e6ff-42d5-b5cd-367deb4bde72 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/a06b561e-d413-42f7-8771-137eae20bdb2" status: 202 len: 0 microversion: 2.1 time: 0.666513 Oct 10 18:50:58.998230 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 264/480] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:50:58 2022] DELETE /compute/v2.1/os-security-groups/a06b561e-d413-42f7-8771-137eae20bdb2 => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:59.002297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0b262c19-97ff-4e64-a1a8-dc91a8e032d7 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:59.006042 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6b3f896e-7944-43ea-a298-f0110ee1e459 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Calling method '.version_select at 0x7f318e743e50>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:59.046257 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0b262c19-97ff-4e64-a1a8-dc91a8e032d7 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6222 microversion: 2.1 time: 0.040903 Oct 10 18:50:59.046257 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 217/481] 10.222.0.43 () {58 vars in 1169 bytes} [Mon Oct 10 18:50:58 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6222 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:50:59.109439 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4056f381-0e01-4446-a691-dc01c1372c93 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:59.251153 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4056f381-0e01-4446-a691-dc01c1372c93 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1433117408" status: 202 len: 0 microversion: 2.1 time: 0.154677 Oct 10 18:50:59.251153 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 218/482] 10.222.0.43 () {58 vars in 1161 bytes} [Mon Oct 10 18:50:59 2022] DELETE /compute/v2.1/flavors/1433117408 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:59.251153 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4e9f7f22-9364-4f0b-9323-be73df0e20e9 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:59.292521 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4e9f7f22-9364-4f0b-9323-be73df0e20e9 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.045471 Oct 10 18:50:59.293482 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 219/483] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:59 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:59.298446 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b9ef6181-4a34-483e-a375-cc42c10f48ea tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:59.299412 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b9ef6181-4a34-483e-a375-cc42c10f48ea tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:59.305521 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9ef6181-4a34-483e-a375-cc42c10f48ea tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:59.306199 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9ef6181-4a34-483e-a375-cc42c10f48ea tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:59.307150 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9ef6181-4a34-483e-a375-cc42c10f48ea tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:59.308609 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9ef6181-4a34-483e-a375-cc42c10f48ea tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:59.309242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9ef6181-4a34-483e-a375-cc42c10f48ea tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:59.309822 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9ef6181-4a34-483e-a375-cc42c10f48ea tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:59.389983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b9ef6181-4a34-483e-a375-cc42c10f48ea tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:50:59.401685 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b9ef6181-4a34-483e-a375-cc42c10f48ea tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1268 microversion: 2.1 time: 0.106879 Oct 10 18:50:59.402824 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 220/484] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:59 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1268 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:59.407403 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c9ad935c-ae7f-40fc-904a-4c964d689b83 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:59.501758 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6b3f896e-7944-43ea-a298-f0110ee1e459 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/440d27ae-bb77-4d8c-aab8-717c86cedfab" status: 202 len: 0 microversion: 2.1 time: 0.497241 Oct 10 18:50:59.506259 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 265/485] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:50:59 2022] DELETE /compute/v2.1/os-security-groups/440d27ae-bb77-4d8c-aab8-717c86cedfab => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:59.512435 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-18ed70ca-90dc-455f-9eab-d931cad2044d tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:59.513496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-18ed70ca-90dc-455f-9eab-d931cad2044d tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] [instance: f5a71922-7bbf-4415-b3f5-2c2716b7c7c1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:59.523725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-18ed70ca-90dc-455f-9eab-d931cad2044d tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:59.523725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-18ed70ca-90dc-455f-9eab-d931cad2044d tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:59.523725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-18ed70ca-90dc-455f-9eab-d931cad2044d tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:59.524444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-18ed70ca-90dc-455f-9eab-d931cad2044d tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:59.525449 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-18ed70ca-90dc-455f-9eab-d931cad2044d tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:59.526913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-18ed70ca-90dc-455f-9eab-d931cad2044d tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:59.546409 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-18ed70ca-90dc-455f-9eab-d931cad2044d tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] HTTP exception thrown: Instance f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 could not be found. Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-18ed70ca-90dc-455f-9eab-d931cad2044d tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Request method failure captured: Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 HTTP/1.1 Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGlnAzOw3cwjSWoGabvksBE7PAMlvc1ztA75na0o-QeMrwu-fr7dk5eZInf6ScvS7dbW2x5CphxsqDbGxYRxKUayN4VcdDss6qSK0mb8EaN6pPnv5tLxGv6YKZ6dXIwKAOxiecc9u_vXL88i6HnB5ILNHIPADpc9IrOB2Z2HrTr68r4 Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: d610c145b1284aa293c1f456bf476602 Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:50:59.548710 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:50:59.553922 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d610c145b1284aa293c1f456bf476602", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d610c145b1284aa293c1f456bf476602"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d610c145b1284aa293c1f456bf476602"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d610c145b1284aa293c1f456bf476602"}]}] Oct 10 18:50:59.553922 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:59.553922 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: d610c145b1284aa293c1f456bf476602 Oct 10 18:50:59.553922 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 Oct 10 18:50:59.553922 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project Oct 10 18:50:59.553922 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:50:59.553922 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:50:59.553922 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 831696709a6b473fbd54b99883d38c8d Oct 10 18:50:59.553922 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project Oct 10 18:50:59.553922 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:50:59.553922 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 could not be found. Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'f5a71922-7bbf-4415-b3f5-2c2716b7c7c1'} Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 could not be found. Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:50:59.555207 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 could not be found. Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 could not be found. Oct 10 18:50:59.559988 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:50:59.562841 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-18ed70ca-90dc-455f-9eab-d931cad2044d tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] Returning 404 to user: Instance f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:50:59.564740 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-18ed70ca-90dc-455f-9eab-d931cad2044d tempest-FloatingIPsAssociationNegativeTestJSON-1603960827 tempest-FloatingIPsAssociationNegativeTestJSON-1603960827-project] 10.222.0.43 "GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1" status: 404 len: 111 microversion: 2.1 time: 0.044735 Oct 10 18:50:59.565194 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 266/486] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:59 2022] GET /compute/v2.1/servers/f5a71922-7bbf-4415-b3f5-2c2716b7c7c1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:50:59.568671 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c9ad935c-ae7f-40fc-904a-4c964d689b83 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/589510773" status: 202 len: 0 microversion: 2.1 time: 0.140145 Oct 10 18:50:59.575646 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-93b770e8-c7d5-4f04-a220-8e41173de586 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Calling method '.version_select at 0x7f318e7334c0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:59.578541 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 221/487] 10.222.0.43 () {58 vars in 1158 bytes} [Mon Oct 10 18:50:59 2022] DELETE /compute/v2.1/flavors/589510773 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:50:59.590735 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-08926c99-aecc-4926-8133-88f95c107628 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:59.618145 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-08926c99-aecc-4926-8133-88f95c107628 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.034408 Oct 10 18:50:59.618830 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 222/488] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:50:59 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:50:59.643304 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-300e4648-b42f-4e30-a4cb-5ed12c2c3b33 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:50:59.645246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-300e4648-b42f-4e30-a4cb-5ed12c2c3b33 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:50:59.652524 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-300e4648-b42f-4e30-a4cb-5ed12c2c3b33 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:59.653222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-300e4648-b42f-4e30-a4cb-5ed12c2c3b33 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:59.653896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-300e4648-b42f-4e30-a4cb-5ed12c2c3b33 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:50:59.655518 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-300e4648-b42f-4e30-a4cb-5ed12c2c3b33 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:50:59.656277 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-300e4648-b42f-4e30-a4cb-5ed12c2c3b33 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:50:59.656967 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-300e4648-b42f-4e30-a4cb-5ed12c2c3b33 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:00.171870 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-93b770e8-c7d5-4f04-a220-8e41173de586 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/6a73c828-c516-47b5-bb03-a418461809e8" status: 202 len: 0 microversion: 2.1 time: 0.603103 Oct 10 18:51:00.171870 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 267/489] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:50:59 2022] DELETE /compute/v2.1/os-security-groups/6a73c828-c516-47b5-bb03-a418461809e8 => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:51:00.176342 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3a44c6f1-ae88-49d6-a98b-75d8fc7b998a tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1933632797", "id": 1086062040, "os-flavor-access:is_public": "False"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:00.315656 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3a44c6f1-ae88-49d6-a98b-75d8fc7b998a tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.143954 Oct 10 18:51:00.316671 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 268/490] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:51:00 2022] POST /compute/v2.1/flavors => generated 415 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:00.333057 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-51a23e51-3380-4221-855e-480dd215aa55 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:00.335173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-51a23e51-3380-4221-855e-480dd215aa55 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:00.344198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-300e4648-b42f-4e30-a4cb-5ed12c2c3b33 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:00.344384 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-51a23e51-3380-4221-855e-480dd215aa55 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:00.346477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-51a23e51-3380-4221-855e-480dd215aa55 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:00.348982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-51a23e51-3380-4221-855e-480dd215aa55 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:00.350024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-51a23e51-3380-4221-855e-480dd215aa55 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:00.351425 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-51a23e51-3380-4221-855e-480dd215aa55 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:00.352025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-51a23e51-3380-4221-855e-480dd215aa55 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:00.354816 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-300e4648-b42f-4e30-a4cb-5ed12c2c3b33 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca" status: 200 len: 1324 microversion: 2.1 time: 0.719947 Oct 10 18:51:00.363457 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 223/491] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:50:59 2022] GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca => generated 1324 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:00.389005 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-2d1ebd89-54dc-46c3-818a-fbf473266379 req-743b08c4-57b9-4d5d-9c1a-672d88d92cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237bf8ad-542e-4814-a679-25fe8058682d", "name": "network-vif-deleted", "tag": "d4082492-8977-4421-932c-18f50547846c"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:00.430709 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-2d1ebd89-54dc-46c3-818a-fbf473266379 req-743b08c4-57b9-4d5d-9c1a-672d88d92cf2 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:00.431267 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-2d1ebd89-54dc-46c3-818a-fbf473266379 req-743b08c4-57b9-4d5d-9c1a-672d88d92cf2 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:00.431709 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-2d1ebd89-54dc-46c3-818a-fbf473266379 req-743b08c4-57b9-4d5d-9c1a-672d88d92cf2 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:00.479122 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-2d1ebd89-54dc-46c3-818a-fbf473266379 req-743b08c4-57b9-4d5d-9c1a-672d88d92cf2 service nova] Creating event network-vif-deleted:d4082492-8977-4421-932c-18f50547846c for instance 237bf8ad-542e-4814-a679-25fe8058682d on n-h2-860863-1 Oct 10 18:51:00.503450 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-2d1ebd89-54dc-46c3-818a-fbf473266379 req-743b08c4-57b9-4d5d-9c1a-672d88d92cf2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129822 Oct 10 18:51:00.507549 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 224/492] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:00.517843 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-e5553919-595e-490a-a1d6-ccbc4a45d183 req-fd29255c-b83f-4bfa-88d6-4112ec641ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba31eefc-640b-41f5-8c00-a6d021cef3ca", "name": "network-vif-plugged", "status": "completed", "tag": "b8ce8642-3363-42a2-afad-1a4e62608841"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:00.533283 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-51a23e51-3380-4221-855e-480dd215aa55 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:00.541530 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e5553919-595e-490a-a1d6-ccbc4a45d183 req-fd29255c-b83f-4bfa-88d6-4112ec641ddb service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:00.542037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e5553919-595e-490a-a1d6-ccbc4a45d183 req-fd29255c-b83f-4bfa-88d6-4112ec641ddb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:00.544738 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e5553919-595e-490a-a1d6-ccbc4a45d183 req-fd29255c-b83f-4bfa-88d6-4112ec641ddb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:00.562340 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-e5553919-595e-490a-a1d6-ccbc4a45d183 req-fd29255c-b83f-4bfa-88d6-4112ec641ddb service nova] Creating event network-vif-plugged:b8ce8642-3363-42a2-afad-1a4e62608841 for instance ba31eefc-640b-41f5-8c00-a6d021cef3ca on n-h1-860863-1 Oct 10 18:51:00.571031 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-e5553919-595e-490a-a1d6-ccbc4a45d183 req-fd29255c-b83f-4bfa-88d6-4112ec641ddb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059345 Oct 10 18:51:00.574750 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 225/493] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:00.581297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3e33c5ed-21f2-44cf-93c1-cae83608ed91 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] Calling method '.version_select at 0x7f318e674f70>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:00.611298 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-51a23e51-3380-4221-855e-480dd215aa55 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.292385 Oct 10 18:51:00.612978 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 269/494] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:00 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:00.632743 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5b9d463b-ccca-45d8-b60a-01d4a9818adb tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:00.662129 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5b9d463b-ccca-45d8-b60a-01d4a9818adb tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.047754 Oct 10 18:51:00.663052 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 270/495] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:00 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:00.668392 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d46df850-2019-426a-8e45-917f0fa4f3b2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:00.669074 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d46df850-2019-426a-8e45-917f0fa4f3b2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:00.675536 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d46df850-2019-426a-8e45-917f0fa4f3b2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:00.676209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d46df850-2019-426a-8e45-917f0fa4f3b2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:00.676818 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d46df850-2019-426a-8e45-917f0fa4f3b2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:00.677716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d46df850-2019-426a-8e45-917f0fa4f3b2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:00.678166 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d46df850-2019-426a-8e45-917f0fa4f3b2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:00.678587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d46df850-2019-426a-8e45-917f0fa4f3b2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:00.785441 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d46df850-2019-426a-8e45-917f0fa4f3b2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:00.797114 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d46df850-2019-426a-8e45-917f0fa4f3b2 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1324 microversion: 2.1 time: 0.132934 Oct 10 18:51:00.798041 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 271/496] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:00 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1324 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:00.802779 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-acad5173-e423-40ac-b8df-ec0297226348 tempest-FlavorsAdminTestJSON-1049395815 tempest-FlavorsAdminTestJSON-1049395815-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:00.881205 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-acad5173-e423-40ac-b8df-ec0297226348 tempest-FlavorsAdminTestJSON-1049395815 tempest-FlavorsAdminTestJSON-1049395815-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.081933 Oct 10 18:51:00.885585 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 272/497] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:00 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:00.904485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e536b79b-feab-4e1f-ad2b-fb1f5144b46e tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:00.987424 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e536b79b-feab-4e1f-ad2b-fb1f5144b46e tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1086062040" status: 202 len: 0 microversion: 2.1 time: 0.086284 Oct 10 18:51:00.994800 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 273/498] 10.222.0.43 () {58 vars in 1161 bytes} [Mon Oct 10 18:51:00 2022] DELETE /compute/v2.1/flavors/1086062040 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:51:01.002598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-066ddf99-a333-40f0-9f9e-2a4ea61c6cf3 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:01.050627 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-066ddf99-a333-40f0-9f9e-2a4ea61c6cf3 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.056065 Oct 10 18:51:01.052045 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 274/499] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:00 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:01.077769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-577ddd83-9a6e-45fc-9be7-946318e55b52 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2128596214", "id": 1277223430, "os-flavor-access:is_public": "True"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:01.223626 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-577ddd83-9a6e-45fc-9be7-946318e55b52 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.150698 Oct 10 18:51:01.225138 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 275/500] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:51:01 2022] POST /compute/v2.1/flavors => generated 414 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:01.237044 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1b68d7da-90a3-4185-b8a8-f5bf961ecfa5 tempest-FlavorsAdminTestJSON-1049395815 tempest-FlavorsAdminTestJSON-1049395815-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:01.273524 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1b68d7da-90a3-4185-b8a8-f5bf961ecfa5 tempest-FlavorsAdminTestJSON-1049395815 tempest-FlavorsAdminTestJSON-1049395815-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.040132 Oct 10 18:51:01.284890 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 276/501] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:01 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:51:01.294560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ed391fc0-4274-48e5-bbfb-a0ded69b5507 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:01.297800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=13,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:01.433167 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ed391fc0-4274-48e5-bbfb-a0ded69b5507 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1277223430" status: 202 len: 0 microversion: 2.1 time: 0.143111 Oct 10 18:51:01.434299 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 277/502] 10.222.0.43 () {58 vars in 1161 bytes} [Mon Oct 10 18:51:01 2022] DELETE /compute/v2.1/flavors/1277223430 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 18:51:01.445336 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-de98b113-67d1-4008-a316-dce1ad2fb34e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:01.445336 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-de98b113-67d1-4008-a316-dce1ad2fb34e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:01.456272 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de98b113-67d1-4008-a316-dce1ad2fb34e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:01.456799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de98b113-67d1-4008-a316-dce1ad2fb34e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:01.457225 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de98b113-67d1-4008-a316-dce1ad2fb34e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:01.464490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de98b113-67d1-4008-a316-dce1ad2fb34e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:01.465173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de98b113-67d1-4008-a316-dce1ad2fb34e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:01.466212 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de98b113-67d1-4008-a316-dce1ad2fb34e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:01.703520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-de98b113-67d1-4008-a316-dce1ad2fb34e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:01.711232 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-de98b113-67d1-4008-a316-dce1ad2fb34e tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca" status: 200 len: 1324 microversion: 2.1 time: 0.275754 Oct 10 18:51:01.713758 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 278/503] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:01 2022] GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca => generated 1324 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:01.732724 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f3667b3a-c2f0-4949-a43a-9155f6c1aa75 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:01.752171 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3e33c5ed-21f2-44cf-93c1-cae83608ed91 tempest-SecurityGroupRulesTestJSON-603742128 tempest-SecurityGroupRulesTestJSON-603742128-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/6d518de2-57eb-4841-bdff-48efd0ab90bb" status: 202 len: 0 microversion: 2.1 time: 1.175514 Oct 10 18:51:01.754825 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f3667b3a-c2f0-4949-a43a-9155f6c1aa75 tempest-FlavorsAdminTestJSON-2128659593 tempest-FlavorsAdminTestJSON-2128659593-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.039778 Oct 10 18:51:01.768562 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 279/504] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:01 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:01.768877 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 226/505] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:51:00 2022] DELETE /compute/v2.1/os-security-groups/6d518de2-57eb-4841-bdff-48efd0ab90bb => generated 0 bytes in 1182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:51:01.768964 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-baeeb030-81fb-4a20-ab2c-200774001f97 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:01.768964 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-baeeb030-81fb-4a20-ab2c-200774001f97 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:01.768964 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-baeeb030-81fb-4a20-ab2c-200774001f97 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:01.768964 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-baeeb030-81fb-4a20-ab2c-200774001f97 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:01.769257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-baeeb030-81fb-4a20-ab2c-200774001f97 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:01.769257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-baeeb030-81fb-4a20-ab2c-200774001f97 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:01.769257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-baeeb030-81fb-4a20-ab2c-200774001f97 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:01.769460 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-baeeb030-81fb-4a20-ab2c-200774001f97 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:01.824981 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a89684a6-104c-4f11-8ce9-bd0b86560cb3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:01.825720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a89684a6-104c-4f11-8ce9-bd0b86560cb3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:01.834475 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a89684a6-104c-4f11-8ce9-bd0b86560cb3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:01.836183 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a89684a6-104c-4f11-8ce9-bd0b86560cb3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:01.836905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a89684a6-104c-4f11-8ce9-bd0b86560cb3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:01.837924 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a89684a6-104c-4f11-8ce9-bd0b86560cb3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:01.838602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a89684a6-104c-4f11-8ce9-bd0b86560cb3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:01.839327 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a89684a6-104c-4f11-8ce9-bd0b86560cb3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:02.044596 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a89684a6-104c-4f11-8ce9-bd0b86560cb3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:02.060528 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a89684a6-104c-4f11-8ce9-bd0b86560cb3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1322 microversion: 2.1 time: 0.238832 Oct 10 18:51:02.075962 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 227/506] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:01 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:51:02.164985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-baeeb030-81fb-4a20-ab2c-200774001f97 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:02.249144 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-baeeb030-81fb-4a20-ab2c-200774001f97 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.492251 Oct 10 18:51:02.251449 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 280/507] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:01 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:02.745413 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-251ce8c2-9bbe-451b-b9cf-b7de5cb96d41 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:02.747721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-251ce8c2-9bbe-451b-b9cf-b7de5cb96d41 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:02.756859 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-251ce8c2-9bbe-451b-b9cf-b7de5cb96d41 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:02.757484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-251ce8c2-9bbe-451b-b9cf-b7de5cb96d41 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:02.758146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-251ce8c2-9bbe-451b-b9cf-b7de5cb96d41 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:02.759148 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-251ce8c2-9bbe-451b-b9cf-b7de5cb96d41 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:02.759820 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-251ce8c2-9bbe-451b-b9cf-b7de5cb96d41 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:02.760428 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-251ce8c2-9bbe-451b-b9cf-b7de5cb96d41 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:02.999890 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-251ce8c2-9bbe-451b-b9cf-b7de5cb96d41 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:03.023498 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-251ce8c2-9bbe-451b-b9cf-b7de5cb96d41 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca" status: 200 len: 1521 microversion: 2.1 time: 0.286940 Oct 10 18:51:03.043378 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 228/508] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:02 2022] GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:03.053588 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c65bdcda-b9af-474b-b59c-2d07b0e568a1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.161"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:03.056132 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c65bdcda-b9af-474b-b59c-2d07b0e568a1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:03.062823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c65bdcda-b9af-474b-b59c-2d07b0e568a1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:03.063346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c65bdcda-b9af-474b-b59c-2d07b0e568a1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:03.063752 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c65bdcda-b9af-474b-b59c-2d07b0e568a1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:03.064682 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c65bdcda-b9af-474b-b59c-2d07b0e568a1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:03.065299 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c65bdcda-b9af-474b-b59c-2d07b0e568a1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:03.065981 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c65bdcda-b9af-474b-b59c-2d07b0e568a1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:03.089525 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-36074686-7971-4a48-bc4e-c18d203e344f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:03.090174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-36074686-7971-4a48-bc4e-c18d203e344f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:03.101826 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36074686-7971-4a48-bc4e-c18d203e344f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:03.102346 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36074686-7971-4a48-bc4e-c18d203e344f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:03.102781 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36074686-7971-4a48-bc4e-c18d203e344f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:03.103507 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36074686-7971-4a48-bc4e-c18d203e344f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:03.103959 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36074686-7971-4a48-bc4e-c18d203e344f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:03.104427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36074686-7971-4a48-bc4e-c18d203e344f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:03.144216 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c65bdcda-b9af-474b-b59c-2d07b0e568a1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "refresh_cache-d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" {{(pid=127288) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 18:51:03.144656 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c65bdcda-b9af-474b-b59c-2d07b0e568a1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquired lock "refresh_cache-d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" {{(pid=127288) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 18:51:03.239408 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-36074686-7971-4a48-bc4e-c18d203e344f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:03.252186 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-36074686-7971-4a48-bc4e-c18d203e344f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1322 microversion: 2.1 time: 0.169217 Oct 10 18:51:03.253470 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 229/509] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:03 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:51:03.281343 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cdce223f-542b-4db8-955f-0419e68d9b51 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:03.282334 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cdce223f-542b-4db8-955f-0419e68d9b51 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:03.289037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cdce223f-542b-4db8-955f-0419e68d9b51 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:03.291385 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cdce223f-542b-4db8-955f-0419e68d9b51 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:03.291385 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cdce223f-542b-4db8-955f-0419e68d9b51 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:03.291385 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cdce223f-542b-4db8-955f-0419e68d9b51 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:03.292189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cdce223f-542b-4db8-955f-0419e68d9b51 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:03.292862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cdce223f-542b-4db8-955f-0419e68d9b51 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:03.406928 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-cdce223f-542b-4db8-955f-0419e68d9b51 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:03.433583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:03.451512 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cdce223f-542b-4db8-955f-0419e68d9b51 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.175499 Oct 10 18:51:03.457349 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 230/510] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:03 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:04.278703 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a2a96c50-0dc5-45ec-9833-87be89424f8e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:04.279684 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a2a96c50-0dc5-45ec-9833-87be89424f8e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:04.299205 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2a96c50-0dc5-45ec-9833-87be89424f8e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:04.301392 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2a96c50-0dc5-45ec-9833-87be89424f8e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:04.302914 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2a96c50-0dc5-45ec-9833-87be89424f8e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:04.303851 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2a96c50-0dc5-45ec-9833-87be89424f8e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:04.305597 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2a96c50-0dc5-45ec-9833-87be89424f8e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:04.309099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2a96c50-0dc5-45ec-9833-87be89424f8e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:04.624306 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a2a96c50-0dc5-45ec-9833-87be89424f8e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:04.641045 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a2a96c50-0dc5-45ec-9833-87be89424f8e tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1388 microversion: 2.1 time: 0.369063 Oct 10 18:51:04.646514 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 231/511] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:04 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1388 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:51:04.656506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a3c0db13-aec6-4613-bafb-dee83b4efd69 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:04.658561 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a3c0db13-aec6-4613-bafb-dee83b4efd69 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:04.670436 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c0db13-aec6-4613-bafb-dee83b4efd69 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:04.670982 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c0db13-aec6-4613-bafb-dee83b4efd69 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:04.671547 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c0db13-aec6-4613-bafb-dee83b4efd69 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:04.672232 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c0db13-aec6-4613-bafb-dee83b4efd69 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:04.672823 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c0db13-aec6-4613-bafb-dee83b4efd69 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:04.673243 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c0db13-aec6-4613-bafb-dee83b4efd69 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:04.888877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-a3c0db13-aec6-4613-bafb-dee83b4efd69 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:04.943702 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a3c0db13-aec6-4613-bafb-dee83b4efd69 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.295754 Oct 10 18:51:04.944299 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 232/512] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:04 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:05.006133 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-4455e37e-5f74-4556-b343-56e04269276a req-7ed36f76-b34a-4b53-83a7-6ed117879c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010c33e9-e125-40ee-bc0a-2a9c98c5c36c", "tag": "431fe82a-d096-423c-9fb6-a785452351e7"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:05.037413 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4455e37e-5f74-4556-b343-56e04269276a req-7ed36f76-b34a-4b53-83a7-6ed117879c9d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:05.037897 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4455e37e-5f74-4556-b343-56e04269276a req-7ed36f76-b34a-4b53-83a7-6ed117879c9d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:05.039206 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4455e37e-5f74-4556-b343-56e04269276a req-7ed36f76-b34a-4b53-83a7-6ed117879c9d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:05.063208 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-4455e37e-5f74-4556-b343-56e04269276a req-7ed36f76-b34a-4b53-83a7-6ed117879c9d service nova] Creating event network-changed:431fe82a-d096-423c-9fb6-a785452351e7 for instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c on n-h1-860863-1 Oct 10 18:51:05.073671 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-4455e37e-5f74-4556-b343-56e04269276a req-7ed36f76-b34a-4b53-83a7-6ed117879c9d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070462 Oct 10 18:51:05.078574 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 233/513] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:05.671549 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-571193bd-7bde-4cbc-a65d-1932d258a7a7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:05.672639 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-571193bd-7bde-4cbc-a65d-1932d258a7a7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:05.696066 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-571193bd-7bde-4cbc-a65d-1932d258a7a7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:05.697129 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-571193bd-7bde-4cbc-a65d-1932d258a7a7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:05.699375 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-571193bd-7bde-4cbc-a65d-1932d258a7a7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:05.700595 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-571193bd-7bde-4cbc-a65d-1932d258a7a7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:05.701927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-571193bd-7bde-4cbc-a65d-1932d258a7a7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:05.704128 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-571193bd-7bde-4cbc-a65d-1932d258a7a7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:06.357572 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-571193bd-7bde-4cbc-a65d-1932d258a7a7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:06.379535 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-571193bd-7bde-4cbc-a65d-1932d258a7a7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1388 microversion: 2.1 time: 0.712978 Oct 10 18:51:06.380752 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 234/514] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:05 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1388 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:51:06.385595 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0e232e4d-4c37-4372-9b8b-7f0265ba7b3b tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:06.386299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0e232e4d-4c37-4372-9b8b-7f0265ba7b3b tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:06.395377 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e232e4d-4c37-4372-9b8b-7f0265ba7b3b tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:06.397244 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e232e4d-4c37-4372-9b8b-7f0265ba7b3b tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:06.397955 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e232e4d-4c37-4372-9b8b-7f0265ba7b3b tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:06.398913 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e232e4d-4c37-4372-9b8b-7f0265ba7b3b tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:06.400116 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e232e4d-4c37-4372-9b8b-7f0265ba7b3b tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:06.400734 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e232e4d-4c37-4372-9b8b-7f0265ba7b3b tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:06.539995 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-0e232e4d-4c37-4372-9b8b-7f0265ba7b3b tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:06.553898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:06.559198 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0e232e4d-4c37-4372-9b8b-7f0265ba7b3b tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.177222 Oct 10 18:51:06.561332 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 235/515] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:06 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:06.824997 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f5a40e48-68b1-4ea3-a625-0a715b347671 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Calling method '.version_select at 0x7f318e5f7c10>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:06.830121 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f5a40e48-68b1-4ea3-a625-0a715b347671 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '5c2b8fb0b8df4de69038e37e42069df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa0133b434e428c9d65d358752559c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f5a40e48-68b1-4ea3-a625-0a715b347671 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Request method failure captured: Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmZRzHr-5hkOXRY_kkMKBHru6XPv0U9E9NmcEhRNRiDMqZqu_TyTv_yq69z-S4BYYvGOOF1N73mV-cZgRGyzmfq3SgLd4hcdJmjAjwgne8YJXqI0scuuQwlzNmGBjqfqfRuuYiQyaDFH9vJG8QiZg-a3PADbPhkWl1VnfR8UAA00LA Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: cfa0133b434e428c9d65d358752559c4 Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:51:06.832745 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:51:06.834228 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cfa0133b434e428c9d65d358752559c4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cfa0133b434e428c9d65d358752559c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cfa0133b434e428c9d65d358752559c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cfa0133b434e428c9d65d358752559c4"}]}] Oct 10 18:51:06.834228 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:06.834228 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: cfa0133b434e428c9d65d358752559c4 Oct 10 18:51:06.834228 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:06.834228 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HypervisorAdminNegativeTestJSON-565235002-project Oct 10 18:51:06.834228 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:51:06.834228 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:51:06.834228 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 5c2b8fb0b8df4de69038e37e42069df8 Oct 10 18:51:06.834228 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-565235002-project Oct 10 18:51:06.834228 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:51:06.834228 n-d-860863-1 devstack@n-api.service[127289]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 10 18:51:06.834228 n-d-860863-1 devstack@n-api.service[127289]: action_args: {} Oct 10 18:51:06.834228 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:51:06.835054 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 10 18:51:06.836224 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:06.837406 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f5a40e48-68b1-4ea3-a625-0a715b347671 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:06.839375 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f5a40e48-68b1-4ea3-a625-0a715b347671 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.275730 Oct 10 18:51:06.839734 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 236/516] 10.222.0.43 () {58 vars in 1167 bytes} [Mon Oct 10 18:51:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 277 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:06.854801 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1288db3b-24b3-42ad-a6cc-f19a8ef02617 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Calling method '.version_select at 0x7f318e62fdc0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:06.857474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1288db3b-24b3-42ad-a6cc-f19a8ef02617 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '5c2b8fb0b8df4de69038e37e42069df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa0133b434e428c9d65d358752559c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1288db3b-24b3-42ad-a6cc-f19a8ef02617 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Request method failure captured: Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmZRzHr-5hkOXRY_kkMKBHru6XPv0U9E9NmcEhRNRiDMqZqu_TyTv_yq69z-S4BYYvGOOF1N73mV-cZgRGyzmfq3SgLd4hcdJmjAjwgne8YJXqI0scuuQwlzNmGBjqfqfRuuYiQyaDFH9vJG8QiZg-a3PADbPhkWl1VnfR8UAA00LA Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: cfa0133b434e428c9d65d358752559c4 Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:51:06.859070 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:51:06.860433 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cfa0133b434e428c9d65d358752559c4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cfa0133b434e428c9d65d358752559c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cfa0133b434e428c9d65d358752559c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cfa0133b434e428c9d65d358752559c4"}]}] Oct 10 18:51:06.860433 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:06.860433 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: cfa0133b434e428c9d65d358752559c4 Oct 10 18:51:06.860433 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:06.860433 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HypervisorAdminNegativeTestJSON-565235002-project Oct 10 18:51:06.860433 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:51:06.860433 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:51:06.860433 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 5c2b8fb0b8df4de69038e37e42069df8 Oct 10 18:51:06.860433 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-565235002-project Oct 10 18:51:06.860433 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:51:06.860433 n-d-860863-1 devstack@n-api.service[127289]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 10 18:51:06.860433 n-d-860863-1 devstack@n-api.service[127289]: action_args: {} Oct 10 18:51:06.860433 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:51:06.861686 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 10 18:51:06.863166 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:06.864309 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1288db3b-24b3-42ad-a6cc-f19a8ef02617 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:06.867216 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1288db3b-24b3-42ad-a6cc-f19a8ef02617 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.021825 Oct 10 18:51:06.868278 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 237/517] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:06 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:06.891088 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fff9a0ad-dbd4-4103-b208-9d833372c308 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Calling method '.version_select at 0x7f318e5931f0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:06.891088 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fff9a0ad-dbd4-4103-b208-9d833372c308 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '5c2b8fb0b8df4de69038e37e42069df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa0133b434e428c9d65d358752559c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fff9a0ad-dbd4-4103-b208-9d833372c308 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Request method failure captured: Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmZRzHr-5hkOXRY_kkMKBHru6XPv0U9E9NmcEhRNRiDMqZqu_TyTv_yq69z-S4BYYvGOOF1N73mV-cZgRGyzmfq3SgLd4hcdJmjAjwgne8YJXqI0scuuQwlzNmGBjqfqfRuuYiQyaDFH9vJG8QiZg-a3PADbPhkWl1VnfR8UAA00LA Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: cfa0133b434e428c9d65d358752559c4 Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:51:06.892766 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:51:06.894313 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cfa0133b434e428c9d65d358752559c4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cfa0133b434e428c9d65d358752559c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cfa0133b434e428c9d65d358752559c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cfa0133b434e428c9d65d358752559c4"}]}] Oct 10 18:51:06.894313 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:06.894313 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: cfa0133b434e428c9d65d358752559c4 Oct 10 18:51:06.894313 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:06.894313 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HypervisorAdminNegativeTestJSON-565235002-project Oct 10 18:51:06.894313 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:51:06.894313 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:51:06.894313 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 5c2b8fb0b8df4de69038e37e42069df8 Oct 10 18:51:06.894313 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-565235002-project Oct 10 18:51:06.894313 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:51:06.894313 n-d-860863-1 devstack@n-api.service[127289]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 10 18:51:06.894313 n-d-860863-1 devstack@n-api.service[127289]: action_args: {} Oct 10 18:51:06.894313 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:51:06.895366 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 10 18:51:06.896962 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:06.899190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fff9a0ad-dbd4-4103-b208-9d833372c308 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:06.899190 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fff9a0ad-dbd4-4103-b208-9d833372c308 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.020551 Oct 10 18:51:06.899190 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 238/518] 10.222.0.43 () {58 vars in 1179 bytes} [Mon Oct 10 18:51:06 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:07.590156 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8f98a010-32f3-4170-bf48-376029fbb043 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Calling method '.version_select at 0x7f318e62fdc0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:07.592490 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f98a010-32f3-4170-bf48-376029fbb043 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:07.593190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f98a010-32f3-4170-bf48-376029fbb043 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:07.593572 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f98a010-32f3-4170-bf48-376029fbb043 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:07.605372 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-c65bdcda-b9af-474b-b59c-2d07b0e568a1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Building network info cache for instance {{(pid=127288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 18:51:07.643560 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f98a010-32f3-4170-bf48-376029fbb043 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:07.644065 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f98a010-32f3-4170-bf48-376029fbb043 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:07.644509 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f98a010-32f3-4170-bf48-376029fbb043 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:07.665227 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=4 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:07.688833 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f98a010-32f3-4170-bf48-376029fbb043 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:07.693886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f98a010-32f3-4170-bf48-376029fbb043 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:07.694732 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f98a010-32f3-4170-bf48-376029fbb043 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:07.704115 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8f98a010-32f3-4170-bf48-376029fbb043 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.794362 Oct 10 18:51:07.705327 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 239/519] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:07.711643 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d0923719-a88d-4341-9319-7ebe621203d7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:07.713259 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d0923719-a88d-4341-9319-7ebe621203d7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:07.721786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0923719-a88d-4341-9319-7ebe621203d7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:07.728015 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0923719-a88d-4341-9319-7ebe621203d7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:07.729977 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0923719-a88d-4341-9319-7ebe621203d7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:07.734216 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0923719-a88d-4341-9319-7ebe621203d7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:07.734216 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0923719-a88d-4341-9319-7ebe621203d7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:07.734216 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0923719-a88d-4341-9319-7ebe621203d7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:08.094528 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d0923719-a88d-4341-9319-7ebe621203d7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:08.108341 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d0923719-a88d-4341-9319-7ebe621203d7 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1388 microversion: 2.1 time: 0.401008 Oct 10 18:51:08.109648 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 240/520] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:07 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1388 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:08.114723 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cd360b75-ea3a-4eb7-84fa-cd4b3fc82118 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:08.115534 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cd360b75-ea3a-4eb7-84fa-cd4b3fc82118 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:08.123480 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd360b75-ea3a-4eb7-84fa-cd4b3fc82118 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:08.124175 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd360b75-ea3a-4eb7-84fa-cd4b3fc82118 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:08.124789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd360b75-ea3a-4eb7-84fa-cd4b3fc82118 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:08.126239 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd360b75-ea3a-4eb7-84fa-cd4b3fc82118 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:08.127043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd360b75-ea3a-4eb7-84fa-cd4b3fc82118 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:08.127999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd360b75-ea3a-4eb7-84fa-cd4b3fc82118 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:08.211346 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-cd360b75-ea3a-4eb7-84fa-cd4b3fc82118 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:08.237563 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cd360b75-ea3a-4eb7-84fa-cd4b3fc82118 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.126475 Oct 10 18:51:08.238157 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 241/521] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:08 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:08.241077 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=10 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:08.595335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fed097a8-e08e-4aa0-ac30-b8ca53002808 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1524133632", "ram": 512, "vcpus": 1, "disk": 10, "id": 1648063486, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:08.681987 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fed097a8-e08e-4aa0-ac30-b8ca53002808 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.442528 Oct 10 18:51:08.683131 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 242/522] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:51:08 2022] POST /compute/v2.1/flavors => generated 416 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:08.691333 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-4780784b-137f-4162-a02a-f75a2c9edea4 req-901532ab-f147-4714-a376-df6cf2a18f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0af7e1f-fea0-4343-9d8d-4ca0f78c1948", "tag": "c9a0326e-ae77-42a1-8db7-434146a99516"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:08.710377 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4780784b-137f-4162-a02a-f75a2c9edea4 req-901532ab-f147-4714-a376-df6cf2a18f2f service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:08.710865 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4780784b-137f-4162-a02a-f75a2c9edea4 req-901532ab-f147-4714-a376-df6cf2a18f2f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:08.711296 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4780784b-137f-4162-a02a-f75a2c9edea4 req-901532ab-f147-4714-a376-df6cf2a18f2f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:08.728198 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-4780784b-137f-4162-a02a-f75a2c9edea4 req-901532ab-f147-4714-a376-df6cf2a18f2f service nova] Creating event network-changed:c9a0326e-ae77-42a1-8db7-434146a99516 for instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 on n-h2-860863-1 Oct 10 18:51:08.741383 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-4780784b-137f-4162-a02a-f75a2c9edea4 req-901532ab-f147-4714-a376-df6cf2a18f2f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050085 Oct 10 18:51:08.757977 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 243/523] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:08.765439 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-832fe23d-d076-466c-9cf9-a4b57718777c tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Calling method '.version_select at 0x7f318e4cd820>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:08.768289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-832fe23d-d076-466c-9cf9-a4b57718777c tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '5c2b8fb0b8df4de69038e37e42069df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa0133b434e428c9d65d358752559c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-832fe23d-d076-466c-9cf9-a4b57718777c tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Request method failure captured: Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmZRzHr-5hkOXRY_kkMKBHru6XPv0U9E9NmcEhRNRiDMqZqu_TyTv_yq69z-S4BYYvGOOF1N73mV-cZgRGyzmfq3SgLd4hcdJmjAjwgne8YJXqI0scuuQwlzNmGBjqfqfRuuYiQyaDFH9vJG8QiZg-a3PADbPhkWl1VnfR8UAA00LA Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: cfa0133b434e428c9d65d358752559c4 Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:51:08.770329 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:51:08.771891 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cfa0133b434e428c9d65d358752559c4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cfa0133b434e428c9d65d358752559c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cfa0133b434e428c9d65d358752559c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cfa0133b434e428c9d65d358752559c4"}]}] Oct 10 18:51:08.771891 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:08.771891 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: cfa0133b434e428c9d65d358752559c4 Oct 10 18:51:08.771891 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:08.771891 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-HypervisorAdminNegativeTestJSON-565235002-project Oct 10 18:51:08.771891 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:51:08.771891 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:51:08.771891 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 5c2b8fb0b8df4de69038e37e42069df8 Oct 10 18:51:08.771891 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-565235002-project Oct 10 18:51:08.771891 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:51:08.771891 n-d-860863-1 devstack@n-api.service[127289]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 10 18:51:08.771891 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '1'} Oct 10 18:51:08.771891 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:51:08.772798 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 10 18:51:08.780476 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:08.781824 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-832fe23d-d076-466c-9cf9-a4b57718777c tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:08.781824 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-832fe23d-d076-466c-9cf9-a4b57718777c tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.014255 Oct 10 18:51:08.781824 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 244/524] 10.222.0.43 () {58 vars in 1173 bytes} [Mon Oct 10 18:51:08 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:08.961734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-c65bdcda-b9af-474b-b59c-2d07b0e568a1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Updating instance_info_cache with network_info: [{"id": "c9a0326e-ae77-42a1-8db7-434146a99516", "address": "fa:16:3e:7c:40:3e", "network": {"id": "c5f3fcff-69f9-404c-aeaa-2f1924041f8b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2042277977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "38266e43742d4a9598d44340cac9bf92", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc9a0326e-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 18:51:09.070397 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-46a2524a-f0b5-4ab1-a232-0ae34d3ce3f4 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:09.071775 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c65bdcda-b9af-474b-b59c-2d07b0e568a1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Releasing lock "refresh_cache-d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" {{(pid=127288) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 18:51:09.076387 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c65bdcda-b9af-474b-b59c-2d07b0e568a1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "POST /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948/action" status: 202 len: 0 microversion: 2.1 time: 6.023900 Oct 10 18:51:09.076387 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 281/525] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:51:03 2022] POST /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948/action => generated 0 bytes in 6025 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 10 18:51:09.083221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5d068ea8-3d13-4a2f-8ab4-ba6d98cfc918 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Calling method '.version_select at 0x7f318e713a60>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:09.085032 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-5d068ea8-3d13-4a2f-8ab4-ba6d98cfc918 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] HTTP exception thrown: Hypervisor with ID 'e3d5644b-f649-4241-96e8-26d84f8d1ce4' could not be found. Oct 10 18:51:09.088149 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-46a2524a-f0b5-4ab1-a232-0ae34d3ce3f4 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] HTTP exception thrown: Flavor 1648063486 has no extra specs with key hw:cpu_thread_policy. Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-46a2524a-f0b5-4ab1-a232-0ae34d3ce3f4 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Request method failure captured: Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/flavors/1648063486/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmZu2ythNQY4Qxx-Xsy3hf-N1_ufpQLj03y4abUweZ6Nfg83WHEMX6XK4_3yLKP56JddmZK1TbfZ8sIwAgEnIZ3C72a027iXVxnVNNZD8lh0RfH0UMDwWjMTHmOdT3vHEv9yUnRxf3HZJdajAPIelUrQIo4UNwCHvyCyw-FSdauSg8 Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 61f31c99630f4828bbfd619787020457 Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:51:09.089840 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:51:09.091441 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_61f31c99630f4828bbfd619787020457", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/61f31c99630f4828bbfd619787020457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61f31c99630f4828bbfd619787020457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61f31c99630f4828bbfd619787020457"}]}] Oct 10 18:51:09.091441 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 Oct 10 18:51:09.091441 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 61f31c99630f4828bbfd619787020457 Oct 10 18:51:09.091441 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 Oct 10 18:51:09.091441 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project Oct 10 18:51:09.091441 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:51:09.091441 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:51:09.091441 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 72ce9c6fdf8d4880aa7727bd3d2730a4 Oct 10 18:51:09.091441 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project Oct 10 18:51:09.091441 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:51:09.091441 n-d-860863-1 devstack@n-api.service[127289]: exception: Flavor 1648063486 has no extra specs with key hw:cpu_thread_policy. Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'flavor_id': '1648063486', 'id': 'hw:cpu_thread_policy'} Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1648063486 has no extra specs with key hw:cpu_thread_policy. Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:09.092171 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.093746 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:09.093746 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:09.093746 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:09.093746 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:09.093746 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:09.093746 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1648063486 has no extra specs with key hw:cpu_thread_policy. Oct 10 18:51:09.093746 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.093746 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-46a2524a-f0b5-4ab1-a232-0ae34d3ce3f4 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Returning 404 to user: Flavor 1648063486 has no extra specs with key hw:cpu_thread_policy. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:09.093746 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-46a2524a-f0b5-4ab1-a232-0ae34d3ce3f4 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] 10.222.0.43 "GET /compute/v2.1/flavors/1648063486/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.313749 Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5d068ea8-3d13-4a2f-8ab4-ba6d98cfc918 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Request method failure captured: Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-hypervisors/e3d5644b-f649-4241-96e8-26d84f8d1ce4/uptime HTTP/1.1 Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmaP9Nr6FoV0ZP9GcrTGQRb0c_naGn5PtIVSmwStX6k730VcoWJJ_B3KbyXhEeSxJJEdW9KPuLJili2ZsULUGHl-I9VkBgbm-ye_-1AxK3aCOiwPDM5HugCTEMgXEfAAaUsIvCIAxqYxpodl1indBS0C7YNoJ745zDBXzHUAZvUVJ0 Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 09982528e1b5471eb90767587b680ead Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2128977410 Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:51:09.102010 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:51:09.103369 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_09982528e1b5471eb90767587b680ead", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/09982528e1b5471eb90767587b680ead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/09982528e1b5471eb90767587b680ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/09982528e1b5471eb90767587b680ead"}]}] Oct 10 18:51:09.103369 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2128977410 Oct 10 18:51:09.103369 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 09982528e1b5471eb90767587b680ead Oct 10 18:51:09.103369 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2128977410 Oct 10 18:51:09.103369 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin Oct 10 18:51:09.103369 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:09.103369 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:09.103369 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: b0890d1902d94e1eace8c7f27844a47d Oct 10 18:51:09.103369 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin Oct 10 18:51:09.103369 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:09.103369 n-d-860863-1 devstack@n-api.service[127288]: exception: Hypervisor with ID 'e3d5644b-f649-4241-96e8-26d84f8d1ce4' could not be found. Oct 10 18:51:09.103369 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'e3d5644b-f649-4241-96e8-26d84f8d1ce4'} Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e3d5644b-f649-4241-96e8-26d84f8d1ce4' Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 10 18:51:09.104849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e3d5644b-f649-4241-96e8-26d84f8d1ce4' could not be found. Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:09.110168 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.111441 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:09.111441 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:09.111441 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:09.111441 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:09.111441 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:09.111441 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e3d5644b-f649-4241-96e8-26d84f8d1ce4' could not be found. Oct 10 18:51:09.111441 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.111864 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 245/526] 10.222.0.43 () {58 vars in 1266 bytes} [Mon Oct 10 18:51:08 2022] GET /compute/v2.1/flavors/1648063486/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 327 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:09.112284 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5d068ea8-3d13-4a2f-8ab4-ba6d98cfc918 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Returning 404 to user: Hypervisor with ID 'e3d5644b-f649-4241-96e8-26d84f8d1ce4' could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:09.112284 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5d068ea8-3d13-4a2f-8ab4-ba6d98cfc918 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/e3d5644b-f649-4241-96e8-26d84f8d1ce4/uptime" status: 404 len: 123 microversion: 2.1 time: 0.033578 Oct 10 18:51:09.112284 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 282/527] 10.222.0.43 () {58 vars in 1278 bytes} [Mon Oct 10 18:51:09 2022] GET /compute/v2.1/os-hypervisors/e3d5644b-f649-4241-96e8-26d84f8d1ce4/uptime => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:09.129835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9c1af797-9904-4da3-9c26-0e797aedf16a tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:09.132403 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.161"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:09.144501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9c1af797-9904-4da3-9c26-0e797aedf16a tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '72ce9c6fdf8d4880aa7727bd3d2730a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f31c99630f4828bbfd619787020457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:09.145880 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9c1af797-9904-4da3-9c26-0e797aedf16a tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Request method failure captured: Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/flavors/1648063486/os-extra_specs HTTP/1.1 Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 66 Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmZu2ythNQY4Qxx-Xsy3hf-N1_ufpQLj03y4abUweZ6Nfg83WHEMX6XK4_3yLKP56JddmZK1TbfZ8sIwAgEnIZ3C72a027iXVxnVNNZD8lh0RfH0UMDwWjMTHmOdT3vHEv9yUnRxf3HZJdajAPIelUrQIo4UNwCHvyCyw-FSdauSg8 Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 61f31c99630f4828bbfd619787020457 Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:09.150450 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:09.152075 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_61f31c99630f4828bbfd619787020457", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/61f31c99630f4828bbfd619787020457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61f31c99630f4828bbfd619787020457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61f31c99630f4828bbfd619787020457"}]}] Oct 10 18:51:09.152075 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 Oct 10 18:51:09.152075 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 61f31c99630f4828bbfd619787020457 Oct 10 18:51:09.152075 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 Oct 10 18:51:09.152075 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project Oct 10 18:51:09.152075 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:09.152075 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:09.152075 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 72ce9c6fdf8d4880aa7727bd3d2730a4 Oct 10 18:51:09.152075 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project Oct 10 18:51:09.152075 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:51:09.152075 n-d-860863-1 devstack@n-api.service[127288]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 10 18:51:09.152075 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'flavor_id': '1648063486', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:51:09.152969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 10 18:51:09.154599 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:09.158050 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9c1af797-9904-4da3-9c26-0e797aedf16a tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:09.163469 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9c1af797-9904-4da3-9c26-0e797aedf16a tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] 10.222.0.43 "POST /compute/v2.1/flavors/1648063486/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.043693 Oct 10 18:51:09.169310 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 283/528] 10.222.0.43 () {60 vars in 1224 bytes} [Mon Oct 10 18:51:09 2022] POST /compute/v2.1/flavors/1648063486/os-extra_specs => generated 124 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:09.175154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:09.175900 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:09.176553 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:09.177437 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:09.178202 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:09.178796 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:09.194814 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-825b4fe5-a6a6-49b0-b65e-045ec1dcb4a7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Calling method '.version_select at 0x7f318e9c2ca0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:09.206048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-825b4fe5-a6a6-49b0-b65e-045ec1dcb4a7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:09.206840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-825b4fe5-a6a6-49b0-b65e-045ec1dcb4a7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:09.207444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-825b4fe5-a6a6-49b0-b65e-045ec1dcb4a7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:09.239638 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-825b4fe5-a6a6-49b0-b65e-045ec1dcb4a7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:09.240421 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-825b4fe5-a6a6-49b0-b65e-045ec1dcb4a7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:09.244364 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "refresh_cache-ba31eefc-640b-41f5-8c00-a6d021cef3ca" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 18:51:09.245677 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquired lock "refresh_cache-ba31eefc-640b-41f5-8c00-a6d021cef3ca" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 18:51:09.247781 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-825b4fe5-a6a6-49b0-b65e-045ec1dcb4a7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:09.271949 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-825b4fe5-a6a6-49b0-b65e-045ec1dcb4a7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:09.272435 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-825b4fe5-a6a6-49b0-b65e-045ec1dcb4a7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:09.272897 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-825b4fe5-a6a6-49b0-b65e-045ec1dcb4a7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:09.280995 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-825b4fe5-a6a6-49b0-b65e-045ec1dcb4a7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.115108 Oct 10 18:51:09.281832 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 284/529] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:09.292435 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-671912c2-fa96-49f2-8140-dba1d8a38cfc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:09.293077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-671912c2-fa96-49f2-8140-dba1d8a38cfc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:09.311945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-671912c2-fa96-49f2-8140-dba1d8a38cfc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:09.312727 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-671912c2-fa96-49f2-8140-dba1d8a38cfc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:09.313432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-671912c2-fa96-49f2-8140-dba1d8a38cfc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:09.314272 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-671912c2-fa96-49f2-8140-dba1d8a38cfc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:09.315014 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-671912c2-fa96-49f2-8140-dba1d8a38cfc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:09.322157 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-671912c2-fa96-49f2-8140-dba1d8a38cfc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:09.686920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-671912c2-fa96-49f2-8140-dba1d8a38cfc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:09.706491 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-671912c2-fa96-49f2-8140-dba1d8a38cfc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1388 microversion: 2.1 time: 0.414195 Oct 10 18:51:09.708500 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 285/530] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:09 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1388 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:09.723574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3310c0e9-eeb0-43a5-b3af-e1e9b636090d tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:09.882114 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3310c0e9-eeb0-43a5-b3af-e1e9b636090d tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1648063486/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.171689 Oct 10 18:51:09.889610 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 286/531] 10.222.0.43 () {60 vars in 1224 bytes} [Mon Oct 10 18:51:09 2022] POST /compute/v2.1/flavors/1648063486/os-extra_specs => generated 66 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:51:09.901872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0bc915b6-9c97-43d8-868c-b8be5133e659 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:09.904235 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0bc915b6-9c97-43d8-868c-b8be5133e659 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:09.920240 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0bc915b6-9c97-43d8-868c-b8be5133e659 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:09.922917 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0bc915b6-9c97-43d8-868c-b8be5133e659 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:09.927612 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0bc915b6-9c97-43d8-868c-b8be5133e659 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:09.929370 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0bc915b6-9c97-43d8-868c-b8be5133e659 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:09.931229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0bc915b6-9c97-43d8-868c-b8be5133e659 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:09.932128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0bc915b6-9c97-43d8-868c-b8be5133e659 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:09.968942 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:10.083875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-0bc915b6-9c97-43d8-868c-b8be5133e659 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:10.140733 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0bc915b6-9c97-43d8-868c-b8be5133e659 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.233264 Oct 10 18:51:10.140733 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 287/532] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:09 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:10.140733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e8ec984a-dfa3-4913-a4ae-fce72aba9850 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Calling method '.version_select at 0x7f318e743d30>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:10.140733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e8ec984a-dfa3-4913-a4ae-fce72aba9850 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '5c2b8fb0b8df4de69038e37e42069df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa0133b434e428c9d65d358752559c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e8ec984a-dfa3-4913-a4ae-fce72aba9850 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Request method failure captured: Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmZRzHr-5hkOXRY_kkMKBHru6XPv0U9E9NmcEhRNRiDMqZqu_TyTv_yq69z-S4BYYvGOOF1N73mV-cZgRGyzmfq3SgLd4hcdJmjAjwgne8YJXqI0scuuQwlzNmGBjqfqfRuuYiQyaDFH9vJG8QiZg-a3PADbPhkWl1VnfR8UAA00LA Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: cfa0133b434e428c9d65d358752559c4 Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:10.141598 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:10.143521 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cfa0133b434e428c9d65d358752559c4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cfa0133b434e428c9d65d358752559c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cfa0133b434e428c9d65d358752559c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cfa0133b434e428c9d65d358752559c4"}]}] Oct 10 18:51:10.143521 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:10.143521 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: cfa0133b434e428c9d65d358752559c4 Oct 10 18:51:10.143521 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-565235002 Oct 10 18:51:10.143521 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-HypervisorAdminNegativeTestJSON-565235002-project Oct 10 18:51:10.143521 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:10.143521 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:10.143521 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 5c2b8fb0b8df4de69038e37e42069df8 Oct 10 18:51:10.143521 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-565235002-project Oct 10 18:51:10.143521 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:10.143521 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 10 18:51:10.143521 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '1'} Oct 10 18:51:10.143521 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:51:10.144986 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 10 18:51:10.146391 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.147784 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e8ec984a-dfa3-4913-a4ae-fce72aba9850 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:10.147784 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e8ec984a-dfa3-4913-a4ae-fce72aba9850 tempest-HypervisorAdminNegativeTestJSON-565235002 tempest-HypervisorAdminNegativeTestJSON-565235002-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.020771 Oct 10 18:51:10.149605 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 288/533] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:51:10 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:10.159773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-64d0b780-1951-4f73-b2a2-89424759840a tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:10.162954 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-64d0b780-1951-4f73-b2a2-89424759840a tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '72ce9c6fdf8d4880aa7727bd3d2730a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f31c99630f4828bbfd619787020457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-64d0b780-1951-4f73-b2a2-89424759840a tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Request method failure captured: Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/flavors/1648063486/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmZu2ythNQY4Qxx-Xsy3hf-N1_ufpQLj03y4abUweZ6Nfg83WHEMX6XK4_3yLKP56JddmZK1TbfZ8sIwAgEnIZ3C72a027iXVxnVNNZD8lh0RfH0UMDwWjMTHmOdT3vHEv9yUnRxf3HZJdajAPIelUrQIo4UNwCHvyCyw-FSdauSg8 Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 61f31c99630f4828bbfd619787020457 Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:10.173023 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:10.174520 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_61f31c99630f4828bbfd619787020457", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/61f31c99630f4828bbfd619787020457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61f31c99630f4828bbfd619787020457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61f31c99630f4828bbfd619787020457"}]}] Oct 10 18:51:10.174520 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 Oct 10 18:51:10.174520 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 61f31c99630f4828bbfd619787020457 Oct 10 18:51:10.174520 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 Oct 10 18:51:10.174520 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project Oct 10 18:51:10.174520 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:10.174520 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:10.174520 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 72ce9c6fdf8d4880aa7727bd3d2730a4 Oct 10 18:51:10.174520 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project Oct 10 18:51:10.174520 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:51:10.174520 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'flavor_id': '1648063486', 'id': 'hw:numa_nodes'} Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:51:10.175267 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.176918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-64d0b780-1951-4f73-b2a2-89424759840a tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:10.178041 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-64d0b780-1951-4f73-b2a2-89424759840a tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] 10.222.0.43 "DELETE /compute/v2.1/flavors/1648063486/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.023557 Oct 10 18:51:10.178041 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 289/534] 10.222.0.43 () {58 vars in 1248 bytes} [Mon Oct 10 18:51:10 2022] DELETE /compute/v2.1/flavors/1648063486/os-extra_specs/hw:numa_nodes => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:10.180606 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-beab1a81-6dfa-4c4d-9e08-e3cf903f7cb7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Calling method '.version_select at 0x7f318e733a60>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:10.182170 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-beab1a81-6dfa-4c4d-9e08-e3cf903f7cb7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] HTTP exception thrown: Hypervisor with ID 'e79d6108-2b44-468a-8096-fa406b483125' could not be found. Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-beab1a81-6dfa-4c4d-9e08-e3cf903f7cb7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Request method failure captured: Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-hypervisors/e79d6108-2b44-468a-8096-fa406b483125 HTTP/1.1 Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmaP9Nr6FoV0ZP9GcrTGQRb0c_naGn5PtIVSmwStX6k730VcoWJJ_B3KbyXhEeSxJJEdW9KPuLJili2ZsULUGHl-I9VkBgbm-ye_-1AxK3aCOiwPDM5HugCTEMgXEfAAaUsIvCIAxqYxpodl1indBS0C7YNoJ745zDBXzHUAZvUVJ0 Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 09982528e1b5471eb90767587b680ead Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2128977410 Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:51:10.183874 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:51:10.185567 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_09982528e1b5471eb90767587b680ead", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/09982528e1b5471eb90767587b680ead"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/09982528e1b5471eb90767587b680ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/09982528e1b5471eb90767587b680ead"}]}] Oct 10 18:51:10.185567 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2128977410 Oct 10 18:51:10.185567 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 09982528e1b5471eb90767587b680ead Oct 10 18:51:10.185567 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2128977410 Oct 10 18:51:10.185567 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin Oct 10 18:51:10.185567 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:10.185567 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:10.185567 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: b0890d1902d94e1eace8c7f27844a47d Oct 10 18:51:10.185567 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin Oct 10 18:51:10.185567 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:10.185567 n-d-860863-1 devstack@n-api.service[127288]: exception: Hypervisor with ID 'e79d6108-2b44-468a-8096-fa406b483125' could not be found. Oct 10 18:51:10.185567 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'e79d6108-2b44-468a-8096-fa406b483125'} Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e79d6108-2b44-468a-8096-fa406b483125' Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 10 18:51:10.186358 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 18:51:10.187707 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e79d6108-2b44-468a-8096-fa406b483125' could not be found. Oct 10 18:51:10.189649 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.189649 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:10.189649 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.189649 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:10.189649 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:10.189649 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:10.189649 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:10.189649 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:10.189649 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e79d6108-2b44-468a-8096-fa406b483125' could not be found. Oct 10 18:51:10.189649 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:10.189649 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-beab1a81-6dfa-4c4d-9e08-e3cf903f7cb7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] Returning 404 to user: Hypervisor with ID 'e79d6108-2b44-468a-8096-fa406b483125' could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:10.189649 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-beab1a81-6dfa-4c4d-9e08-e3cf903f7cb7 tempest-HypervisorAdminNegativeTestJSON-2128977410 tempest-HypervisorAdminNegativeTestJSON-2128977410-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/e79d6108-2b44-468a-8096-fa406b483125" status: 404 len: 123 microversion: 2.1 time: 0.008585 Oct 10 18:51:10.189649 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 290/535] 10.222.0.43 () {58 vars in 1257 bytes} [Mon Oct 10 18:51:10 2022] GET /compute/v2.1/os-hypervisors/e79d6108-2b44-468a-8096-fa406b483125 => generated 123 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:10.510896 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2609d6e8-4253-4038-9958-7d5e71762139 tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-858614335", "id": 557505596, "os-flavor-access:is_public": "False"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:10.640568 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2609d6e8-4253-4038-9958-7d5e71762139 tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.453598 Oct 10 18:51:10.641243 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 291/536] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:51:10 2022] POST /compute/v2.1/flavors => generated 427 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:10.646157 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c3d125e9-2e19-4100-b8e6-f498ae446663 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:10.675229 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c3d125e9-2e19-4100-b8e6-f498ae446663 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1648063486/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031910 Oct 10 18:51:10.675888 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 292/537] 10.222.0.43 () {60 vars in 1224 bytes} [Mon Oct 10 18:51:10 2022] POST /compute/v2.1/flavors/1648063486/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:51:10.682288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a3466594-4a6f-44ca-8813-23aa388a4657 tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e18a017f863044d1b139e933b01910c4"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:11.625875 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a3466594-4a6f-44ca-8813-23aa388a4657 tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/557505596/action" status: 200 len: 96 microversion: 2.1 time: 0.948670 Oct 10 18:51:11.633145 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 293/538] 10.222.0.43 () {60 vars in 1197 bytes} [Mon Oct 10 18:51:10 2022] POST /compute/v2.1/flavors/557505596/action => generated 96 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:51:11.640492 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-278420e2-30e5-40d4-af2d-cbbf2df34f81 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:11.643512 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-278420e2-30e5-40d4-af2d-cbbf2df34f81 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '72ce9c6fdf8d4880aa7727bd3d2730a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61f31c99630f4828bbfd619787020457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-278420e2-30e5-40d4-af2d-cbbf2df34f81 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Request method failure captured: Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: request: PUT /compute/v2.1/flavors/1648063486/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 22 Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmZu2ythNQY4Qxx-Xsy3hf-N1_ufpQLj03y4abUweZ6Nfg83WHEMX6XK4_3yLKP56JddmZK1TbfZ8sIwAgEnIZ3C72a027iXVxnVNNZD8lh0RfH0UMDwWjMTHmOdT3vHEv9yUnRxf3HZJdajAPIelUrQIo4UNwCHvyCyw-FSdauSg8 Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 61f31c99630f4828bbfd619787020457 Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:11.646755 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:11.648163 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_61f31c99630f4828bbfd619787020457", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/61f31c99630f4828bbfd619787020457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61f31c99630f4828bbfd619787020457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61f31c99630f4828bbfd619787020457"}]}] Oct 10 18:51:11.648163 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 Oct 10 18:51:11.648163 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 61f31c99630f4828bbfd619787020457 Oct 10 18:51:11.648163 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 Oct 10 18:51:11.648163 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project Oct 10 18:51:11.648163 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:11.648163 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:11.648163 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 72ce9c6fdf8d4880aa7727bd3d2730a4 Oct 10 18:51:11.648163 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project Oct 10 18:51:11.648163 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:51:11.648163 n-d-860863-1 devstack@n-api.service[127288]: {"hw:numa_nodes": "1"} Oct 10 18:51:11.648163 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:51:11.648163 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'flavor_id': '1648063486', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:51:11.649247 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 10 18:51:11.650862 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:11.655265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-278420e2-30e5-40d4-af2d-cbbf2df34f81 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:11.656517 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-278420e2-30e5-40d4-af2d-cbbf2df34f81 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028 tempest-FlavorsExtraSpecsNegativeTestJSON-769517028-project] 10.222.0.43 "PUT /compute/v2.1/flavors/1648063486/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.021914 Oct 10 18:51:11.662829 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 294/539] 10.222.0.43 () {60 vars in 1265 bytes} [Mon Oct 10 18:51:11 2022] PUT /compute/v2.1/flavors/1648063486/os-extra_specs/hw:numa_nodes => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:11.676465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-12ca3471-64dd-41f8-a0ce-eeff4513bb69 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:11.677330 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-12ca3471-64dd-41f8-a0ce-eeff4513bb69 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:11.685219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12ca3471-64dd-41f8-a0ce-eeff4513bb69 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:11.685978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12ca3471-64dd-41f8-a0ce-eeff4513bb69 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:11.686580 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12ca3471-64dd-41f8-a0ce-eeff4513bb69 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:11.687612 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12ca3471-64dd-41f8-a0ce-eeff4513bb69 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:11.688328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12ca3471-64dd-41f8-a0ce-eeff4513bb69 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:11.689535 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12ca3471-64dd-41f8-a0ce-eeff4513bb69 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:11.896888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-12ca3471-64dd-41f8-a0ce-eeff4513bb69 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:11.915598 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-12ca3471-64dd-41f8-a0ce-eeff4513bb69 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1388 microversion: 2.1 time: 0.250786 Oct 10 18:51:11.916357 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 295/540] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:11 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1388 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:11.923960 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3992ecc6-80fa-453e-9158-f1f1856233e2 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:11.925148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3992ecc6-80fa-453e-9158-f1f1856233e2 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:11.938482 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3992ecc6-80fa-453e-9158-f1f1856233e2 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:11.939945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3992ecc6-80fa-453e-9158-f1f1856233e2 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:11.940756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3992ecc6-80fa-453e-9158-f1f1856233e2 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:11.941686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3992ecc6-80fa-453e-9158-f1f1856233e2 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:11.942442 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3992ecc6-80fa-453e-9158-f1f1856233e2 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:11.943412 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3992ecc6-80fa-453e-9158-f1f1856233e2 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:12.052591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-3992ecc6-80fa-453e-9158-f1f1856233e2 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:12.095207 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3992ecc6-80fa-453e-9158-f1f1856233e2 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.176267 Oct 10 18:51:12.096215 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 296/541] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:11 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:12.434428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-78eca88d-d3f0-449c-88f2-e6fd3b77ad94 tempest-FlavorsAccessTestJSON-1801565967 tempest-FlavorsAccessTestJSON-1801565967-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:12.464500 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-78eca88d-d3f0-449c-88f2-e6fd3b77ad94 tempest-FlavorsAccessTestJSON-1801565967 tempest-FlavorsAccessTestJSON-1801565967-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6642 microversion: 2.1 time: 0.367053 Oct 10 18:51:12.465775 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 297/542] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:12 2022] GET /compute/v2.1/flavors/detail => generated 6642 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:12.471054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bcd8641d-6514-4c4b-bc6a-a1a0c9783efb tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:12.478499 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-bcd8641d-6514-4c4b-bc6a-a1a0c9783efb tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] HTTP exception thrown: Flavor 1648063486 has no extra specs with key hw:cpu_thread_policy. Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bcd8641d-6514-4c4b-bc6a-a1a0c9783efb tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] Request method failure captured: Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/flavors/1648063486/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmbx4bVtsgAYpaTbMAQZzIkME25VCxAOKQuw6HcnQvQMsSU8-nODqmPQa2K9D-Awb3YAHYanKyqQteQHc-lkEU8vkMfQThi5xgbZAs19wIjiPMeShMRTL8LnsfYkHhe_usQ82tRNU6LUJ9ceeCe9bzTt5P_dVd2qDPNm53our-v-N0 Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 53ffe293004e467293bbc49285fa0d1d Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:51:12.485198 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:51:12.486457 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_53ffe293004e467293bbc49285fa0d1d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/53ffe293004e467293bbc49285fa0d1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/53ffe293004e467293bbc49285fa0d1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/53ffe293004e467293bbc49285fa0d1d"}]}] Oct 10 18:51:12.486457 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 Oct 10 18:51:12.486457 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 53ffe293004e467293bbc49285fa0d1d Oct 10 18:51:12.486457 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 Oct 10 18:51:12.486457 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin Oct 10 18:51:12.486457 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:12.486457 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:12.486457 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 44af92cd619d41749e0749fa873a0e80 Oct 10 18:51:12.486457 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin Oct 10 18:51:12.486457 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:51:12.486457 n-d-860863-1 devstack@n-api.service[127288]: exception: Flavor 1648063486 has no extra specs with key hw:cpu_thread_policy. Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'flavor_id': '1648063486', 'id': 'hw:cpu_thread_policy'} Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1648063486 has no extra specs with key hw:cpu_thread_policy. Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:12.487680 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:12.489135 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:12.489135 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:12.489135 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:12.489135 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:12.489135 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:12.489135 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1648063486 has no extra specs with key hw:cpu_thread_policy. Oct 10 18:51:12.489135 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:12.489135 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bcd8641d-6514-4c4b-bc6a-a1a0c9783efb tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] Returning 404 to user: Flavor 1648063486 has no extra specs with key hw:cpu_thread_policy. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:12.489135 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bcd8641d-6514-4c4b-bc6a-a1a0c9783efb tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1648063486/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.015343 Oct 10 18:51:12.489135 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 298/543] 10.222.0.43 () {58 vars in 1269 bytes} [Mon Oct 10 18:51:12 2022] DELETE /compute/v2.1/flavors/1648063486/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:12.494481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-c7aa786d-cecb-42e1-9ec9-05d1f7f5a802 req-d1a06ba8-e2b1-4c9a-85dc-25d74c393939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010c33e9-e125-40ee-bc0a-2a9c98c5c36c", "name": "network-vif-plugged", "status": "completed", "tag": "431fe82a-d096-423c-9fb6-a785452351e7"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:12.509626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c7aa786d-cecb-42e1-9ec9-05d1f7f5a802 req-d1a06ba8-e2b1-4c9a-85dc-25d74c393939 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:12.511039 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c7aa786d-cecb-42e1-9ec9-05d1f7f5a802 req-d1a06ba8-e2b1-4c9a-85dc-25d74c393939 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:12.511702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c7aa786d-cecb-42e1-9ec9-05d1f7f5a802 req-d1a06ba8-e2b1-4c9a-85dc-25d74c393939 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:12.526386 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-c7aa786d-cecb-42e1-9ec9-05d1f7f5a802 req-d1a06ba8-e2b1-4c9a-85dc-25d74c393939 service nova] Creating event network-vif-plugged:431fe82a-d096-423c-9fb6-a785452351e7 for instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c on n-h1-860863-1 Oct 10 18:51:12.532384 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-c7aa786d-cecb-42e1-9ec9-05d1f7f5a802 req-d1a06ba8-e2b1-4c9a-85dc-25d74c393939 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047687 Oct 10 18:51:12.534561 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 299/544] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:12.556375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-52db1aa5-a880-425f-99ce-a0b106e5b099 tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e18a017f863044d1b139e933b01910c4"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:13.012395 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.network.neutron [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] re-assign floating IP 172.25.5.161 from instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 Oct 10 18:51:13.063570 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Building network info cache for instance {{(pid=127289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 18:51:13.393473 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-52db1aa5-a880-425f-99ce-a0b106e5b099 tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/557505596/action" status: 200 len: 21 microversion: 2.1 time: 0.857040 Oct 10 18:51:13.399293 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 300/545] 10.222.0.43 () {60 vars in 1197 bytes} [Mon Oct 10 18:51:12 2022] POST /compute/v2.1/flavors/557505596/action => generated 21 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:51:13.404884 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d501de1f-5616-4d00-a834-ab5e2cbf7cc5 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:13.408394 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-d501de1f-5616-4d00-a834-ab5e2cbf7cc5 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d501de1f-5616-4d00-a834-ab5e2cbf7cc5 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] Request method failure captured: Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: request: PUT /compute/v2.1/flavors/1648063486/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 27 Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmbx4bVtsgAYpaTbMAQZzIkME25VCxAOKQuw6HcnQvQMsSU8-nODqmPQa2K9D-Awb3YAHYanKyqQteQHc-lkEU8vkMfQThi5xgbZAs19wIjiPMeShMRTL8LnsfYkHhe_usQ82tRNU6LUJ9ceeCe9bzTt5P_dVd2qDPNm53our-v-N0 Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 53ffe293004e467293bbc49285fa0d1d Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:51:13.410239 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:51:13.411839 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_53ffe293004e467293bbc49285fa0d1d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/53ffe293004e467293bbc49285fa0d1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/53ffe293004e467293bbc49285fa0d1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/53ffe293004e467293bbc49285fa0d1d"}]}] Oct 10 18:51:13.411839 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 Oct 10 18:51:13.411839 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 53ffe293004e467293bbc49285fa0d1d Oct 10 18:51:13.411839 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 Oct 10 18:51:13.411839 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin Oct 10 18:51:13.411839 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:13.411839 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:13.411839 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 44af92cd619d41749e0749fa873a0e80 Oct 10 18:51:13.411839 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin Oct 10 18:51:13.411839 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:51:13.411839 n-d-860863-1 devstack@n-api.service[127288]: {"hw:cpu_policy": "shared"} Oct 10 18:51:13.411839 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:51:13.411839 n-d-860863-1 devstack@n-api.service[127288]: exception: Request body and URI mismatch Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'flavor_id': '1648063486', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:13.412849 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:13.414993 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:13.414993 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:13.414993 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 10 18:51:13.414993 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:13.416138 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d501de1f-5616-4d00-a834-ab5e2cbf7cc5 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:13.417791 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d501de1f-5616-4d00-a834-ab5e2cbf7cc5 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/1648063486/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.017317 Oct 10 18:51:13.420273 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 301/546] 10.222.0.43 () {60 vars in 1265 bytes} [Mon Oct 10 18:51:13 2022] PUT /compute/v2.1/flavors/1648063486/os-extra_specs/hw:numa_nodes => generated 73 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 18:51:13.436025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-c465441c-ca0d-4279-8ff6-180c4a73509f req-704537a5-b465-4689-90f8-4874aa8dfb5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0af7e1f-fea0-4343-9d8d-4ca0f78c1948", "tag": "c9a0326e-ae77-42a1-8db7-434146a99516"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:13.447970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c465441c-ca0d-4279-8ff6-180c4a73509f req-704537a5-b465-4689-90f8-4874aa8dfb5a service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:13.448707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c465441c-ca0d-4279-8ff6-180c4a73509f req-704537a5-b465-4689-90f8-4874aa8dfb5a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:13.449543 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c465441c-ca0d-4279-8ff6-180c4a73509f req-704537a5-b465-4689-90f8-4874aa8dfb5a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:13.468842 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-c465441c-ca0d-4279-8ff6-180c4a73509f req-704537a5-b465-4689-90f8-4874aa8dfb5a service nova] Creating event network-changed:c9a0326e-ae77-42a1-8db7-434146a99516 for instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 on n-h2-860863-1 Oct 10 18:51:13.475341 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-c465441c-ca0d-4279-8ff6-180c4a73509f req-704537a5-b465-4689-90f8-4874aa8dfb5a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053465 Oct 10 18:51:13.476498 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 302/547] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:13.484926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2e82bf4c-9ee4-4af5-bb39-962dacd9235b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:13.485961 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2e82bf4c-9ee4-4af5-bb39-962dacd9235b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:13.495134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2e82bf4c-9ee4-4af5-bb39-962dacd9235b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:13.495939 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2e82bf4c-9ee4-4af5-bb39-962dacd9235b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:13.497013 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2e82bf4c-9ee4-4af5-bb39-962dacd9235b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:13.500874 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2e82bf4c-9ee4-4af5-bb39-962dacd9235b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:13.502943 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2e82bf4c-9ee4-4af5-bb39-962dacd9235b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:13.503611 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2e82bf4c-9ee4-4af5-bb39-962dacd9235b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:13.785381 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2e82bf4c-9ee4-4af5-bb39-962dacd9235b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:13.794758 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2e82bf4c-9ee4-4af5-bb39-962dacd9235b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1388 microversion: 2.1 time: 0.316489 Oct 10 18:51:13.798931 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 303/548] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:13 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1388 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:13.808744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-448e92d3-43fc-428a-8461-eb8b0eca7c89 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:13.809913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-448e92d3-43fc-428a-8461-eb8b0eca7c89 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:13.823825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-448e92d3-43fc-428a-8461-eb8b0eca7c89 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:13.829344 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-448e92d3-43fc-428a-8461-eb8b0eca7c89 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:13.829963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-448e92d3-43fc-428a-8461-eb8b0eca7c89 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:13.830906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-448e92d3-43fc-428a-8461-eb8b0eca7c89 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:13.831509 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-448e92d3-43fc-428a-8461-eb8b0eca7c89 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:13.832084 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-448e92d3-43fc-428a-8461-eb8b0eca7c89 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:13.923130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Updating instance_info_cache with network_info: [{"id": "c9a0326e-ae77-42a1-8db7-434146a99516", "address": "fa:16:3e:7c:40:3e", "network": {"id": "c5f3fcff-69f9-404c-aeaa-2f1924041f8b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2042277977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "38266e43742d4a9598d44340cac9bf92", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc9a0326e-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 18:51:14.014021 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Building network info cache for instance {{(pid=127289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 18:51:14.191302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-448e92d3-43fc-428a-8461-eb8b0eca7c89 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:14.228403 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-448e92d3-43fc-428a-8461-eb8b0eca7c89 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.427793 Oct 10 18:51:14.229041 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 304/549] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:13 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:14.235549 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-10a8e2b4-fe3b-4e96-8d5c-bb4ae703e970 tempest-FlavorsAccessTestJSON-1801565967 tempest-FlavorsAccessTestJSON-1801565967-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:14.261097 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-10a8e2b4-fe3b-4e96-8d5c-bb4ae703e970 tempest-FlavorsAccessTestJSON-1801565967 tempest-FlavorsAccessTestJSON-1801565967-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6225 microversion: 2.1 time: 0.030251 Oct 10 18:51:14.262069 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 305/550] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:14 2022] GET /compute/v2.1/flavors/detail => generated 6225 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:14.266671 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7aa86a01-f9f7-4f78-990a-3bb4147b0382 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7aa86a01-f9f7-4f78-990a-3bb4147b0382 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] Request method failure captured: Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: request: PUT /compute/v2.1/flavors/1648063486/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 49 Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmbx4bVtsgAYpaTbMAQZzIkME25VCxAOKQuw6HcnQvQMsSU8-nODqmPQa2K9D-Awb3YAHYanKyqQteQHc-lkEU8vkMfQThi5xgbZAs19wIjiPMeShMRTL8LnsfYkHhe_usQ82tRNU6LUJ9ceeCe9bzTt5P_dVd2qDPNm53our-v-N0 Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 53ffe293004e467293bbc49285fa0d1d Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:51:14.272589 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:51:14.274028 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_53ffe293004e467293bbc49285fa0d1d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/53ffe293004e467293bbc49285fa0d1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/53ffe293004e467293bbc49285fa0d1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/53ffe293004e467293bbc49285fa0d1d"}]}] Oct 10 18:51:14.274028 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 Oct 10 18:51:14.274028 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 53ffe293004e467293bbc49285fa0d1d Oct 10 18:51:14.274028 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 Oct 10 18:51:14.274028 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin Oct 10 18:51:14.274028 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:14.274028 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:14.274028 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 44af92cd619d41749e0749fa873a0e80 Oct 10 18:51:14.274028 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin Oct 10 18:51:14.274028 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:51:14.274028 n-d-860863-1 devstack@n-api.service[127288]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 10 18:51:14.274028 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'flavor_id': '1648063486', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise error Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi On instance: Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 10 18:51:14.275045 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.276425 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:14.279732 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:14.279732 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:14.279732 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 18:51:14.279732 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 18:51:14.279732 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 10 18:51:14.279732 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.279732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7aa86a01-f9f7-4f78-990a-3bb4147b0382 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:14.279732 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7aa86a01-f9f7-4f78-990a-3bb4147b0382 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/1648063486/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.011116 Oct 10 18:51:14.279732 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 306/551] 10.222.0.43 () {60 vars in 1265 bytes} [Mon Oct 10 18:51:14 2022] PUT /compute/v2.1/flavors/1648063486/os-extra_specs/hw:numa_nodes => generated 117 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:51:14.554997 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ef7cbb70-a2d1-4f0f-9453-5faf310d4021 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Calling method '.version_select at 0x7f318e9c2550>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:14.606919 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-ef7cbb70-a2d1-4f0f-9453-5faf310d4021 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] HTTP exception thrown: Image not found. Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ef7cbb70-a2d1-4f0f-9453-5faf310d4021 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Request method failure captured: Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/images/314ab046-ce84-41ca-ac9f-677320e15152/metadata/os_distro HTTP/1.1 Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmhxJef0mrRleHtmYwPZn5xhnoYs8Xwn6pzxGwqkhfJ9iXwM76KHjJd53uXbn0_IsZmZjea7qulrXx4rpVAdB0J2FXQ2bqltBc1QsvvOosUlZb9pAHY8BAdK8uT8_VFRjeHSrx2zkOPBf2my4jLZwFWBgoMZC0bIGSRCZGWQfIqmeY Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 6a9469128a8f47c4832a9e2cd12c26ac Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:14.620891 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:14.622594 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6a9469128a8f47c4832a9e2cd12c26ac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6a9469128a8f47c4832a9e2cd12c26ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6a9469128a8f47c4832a9e2cd12c26ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6a9469128a8f47c4832a9e2cd12c26ac"}]}] Oct 10 18:51:14.622594 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:14.622594 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 6a9469128a8f47c4832a9e2cd12c26ac Oct 10 18:51:14.622594 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:14.622594 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesMetadataNegativeTestJSON-1967345086-project Oct 10 18:51:14.622594 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:14.622594 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:14.622594 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: fc9ee88dc5c94fb6951ab4333e1d6481 Oct 10 18:51:14.622594 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086-project Oct 10 18:51:14.622594 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:14.622594 n-d-860863-1 devstack@n-api.service[127288]: exception: Image not found. Oct 10 18:51:14.622594 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'image_id': '314ab046-ce84-41ca-ac9f-677320e15152', 'id': 'os_distro'} Oct 10 18:51:14.622594 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:51:14.623619 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 314ab046-ce84-41ca-ac9f-677320e15152 Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:51:14.625338 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 314ab046-ce84-41ca-ac9f-677320e15152 could not be found. Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:14.626871 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 18:51:14.628794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.631953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ef7cbb70-a2d1-4f0f-9453-5faf310d4021 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Returning 404 to user: Image not found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:14.633028 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ef7cbb70-a2d1-4f0f-9453-5faf310d4021 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] 10.222.0.43 "DELETE /compute/v2.1/images/314ab046-ce84-41ca-ac9f-677320e15152/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.352434 Oct 10 18:51:14.634561 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 307/552] 10.222.0.43 () {58 vars in 1293 bytes} [Mon Oct 10 18:51:14 2022] DELETE /compute/v2.1/images/314ab046-ce84-41ca-ac9f-677320e15152/metadata/os_distro => generated 62 bytes in 354 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:51:14.643483 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3a137070-0c8b-4f42-b760-8fcd6831b32f tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:14.766178 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3a137070-0c8b-4f42-b760-8fcd6831b32f tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1648063486" status: 202 len: 0 microversion: 2.1 time: 0.130064 Oct 10 18:51:14.767105 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 308/553] 10.222.0.43 () {58 vars in 1161 bytes} [Mon Oct 10 18:51:14 2022] DELETE /compute/v2.1/flavors/1648063486 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:51:14.773657 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-84a316f7-36ed-4b1f-baa2-dd178eb15dee tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:14.795508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=10,nova_api:SAVEPOINT=4,nova_api:INSERT=4,nova_api:RELEASE=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:14.862400 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-84a316f7-36ed-4b1f-baa2-dd178eb15dee tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/557505596" status: 202 len: 0 microversion: 2.1 time: 0.093983 Oct 10 18:51:14.867169 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 309/554] 10.222.0.43 () {58 vars in 1158 bytes} [Mon Oct 10 18:51:14 2022] DELETE /compute/v2.1/flavors/557505596 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:51:14.873641 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5b2d4a99-71a7-4f89-9ca4-176ee2872181 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Calling method '.version_select at 0x7f318e5c6310>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:14.902079 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Updating instance_info_cache with network_info: [{"id": "b8ce8642-3363-42a2-afad-1a4e62608841", "address": "fa:16:3e:05:fa:56", "network": {"id": "c5f3fcff-69f9-404c-aeaa-2f1924041f8b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2042277977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "38266e43742d4a9598d44340cac9bf92", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb8ce8642-33", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 18:51:14.920038 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-5b2d4a99-71a7-4f89-9ca4-176ee2872181 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] HTTP exception thrown: Image not found. Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5b2d4a99-71a7-4f89-9ca4-176ee2872181 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Request method failure captured: Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/images/5d33a97d-d20c-40dd-9068-0ee78815b0d1/metadata/os_version HTTP/1.1 Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmhxJef0mrRleHtmYwPZn5xhnoYs8Xwn6pzxGwqkhfJ9iXwM76KHjJd53uXbn0_IsZmZjea7qulrXx4rpVAdB0J2FXQ2bqltBc1QsvvOosUlZb9pAHY8BAdK8uT8_VFRjeHSrx2zkOPBf2my4jLZwFWBgoMZC0bIGSRCZGWQfIqmeY Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 6a9469128a8f47c4832a9e2cd12c26ac Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:14.922208 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:14.923735 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6a9469128a8f47c4832a9e2cd12c26ac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6a9469128a8f47c4832a9e2cd12c26ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6a9469128a8f47c4832a9e2cd12c26ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6a9469128a8f47c4832a9e2cd12c26ac"}]}] Oct 10 18:51:14.923735 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:14.923735 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 6a9469128a8f47c4832a9e2cd12c26ac Oct 10 18:51:14.923735 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:14.923735 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesMetadataNegativeTestJSON-1967345086-project Oct 10 18:51:14.923735 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:14.923735 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:14.923735 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: fc9ee88dc5c94fb6951ab4333e1d6481 Oct 10 18:51:14.923735 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086-project Oct 10 18:51:14.923735 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:14.923735 n-d-860863-1 devstack@n-api.service[127288]: exception: Image not found. Oct 10 18:51:14.923735 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'image_id': '5d33a97d-d20c-40dd-9068-0ee78815b0d1', 'id': 'os_version'} Oct 10 18:51:14.923735 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:51:14.924677 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5d33a97d-d20c-40dd-9068-0ee78815b0d1 Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:51:14.930518 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5d33a97d-d20c-40dd-9068-0ee78815b0d1 could not be found. Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:14.931912 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:14.933262 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5b2d4a99-71a7-4f89-9ca4-176ee2872181 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Returning 404 to user: Image not found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:14.934649 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5b2d4a99-71a7-4f89-9ca4-176ee2872181 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] 10.222.0.43 "GET /compute/v2.1/images/5d33a97d-d20c-40dd-9068-0ee78815b0d1/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.055358 Oct 10 18:51:14.934649 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 310/555] 10.222.0.43 () {58 vars in 1293 bytes} [Mon Oct 10 18:51:14 2022] GET /compute/v2.1/images/5d33a97d-d20c-40dd-9068-0ee78815b0d1/metadata/os_version => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:51:14.934649 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1f0c6f98-5d1b-4fb9-961a-db44f4aca6d0 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:14.951987 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1f0c6f98-5d1b-4fb9-961a-db44f4aca6d0 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302 tempest-FlavorsExtraSpecsNegativeTestJSON-1057805302-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.026337 Oct 10 18:51:14.952594 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 311/556] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:14 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:14.961044 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-580d4dc0-e753-4643-be18-cb72dcf31f01 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:14.961959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-580d4dc0-e753-4643-be18-cb72dcf31f01 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:14.969619 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-580d4dc0-e753-4643-be18-cb72dcf31f01 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:14.970599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-580d4dc0-e753-4643-be18-cb72dcf31f01 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:14.971306 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-580d4dc0-e753-4643-be18-cb72dcf31f01 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:14.972650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-580d4dc0-e753-4643-be18-cb72dcf31f01 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:14.973270 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-580d4dc0-e753-4643-be18-cb72dcf31f01 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:14.973697 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-580d4dc0-e753-4643-be18-cb72dcf31f01 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:15.002591 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Releasing lock "refresh_cache-ba31eefc-640b-41f5-8c00-a6d021cef3ca" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 18:51:15.003477 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-184374c0-7e98-4494-bf28-e75c8c75f26a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "POST /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca/action" status: 202 len: 0 microversion: 2.1 time: 5.898170 Oct 10 18:51:15.004089 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 246/557] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:51:09 2022] POST /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca/action => generated 0 bytes in 5900 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 18:51:15.013479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1cae1e0d-bef6-48e6-bfd6-fa22da55583c tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:15.038682 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1cae1e0d-bef6-48e6-bfd6-fa22da55583c tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.029845 Oct 10 18:51:15.039608 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 247/558] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:15 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:15.046126 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f82895e3-7443-4b35-b0ff-414f7cfe1974 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Calling method '.version_select at 0x7f318e61a790>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:15.077060 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-f82895e3-7443-4b35-b0ff-414f7cfe1974 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] HTTP exception thrown: Image not found. Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f82895e3-7443-4b35-b0ff-414f7cfe1974 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Request method failure captured: Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/images/1a3144f4-5bc4-4428-9521-f7f54aa7fd7c/metadata HTTP/1.1 Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGmhxJef0mrRleHtmYwPZn5xhnoYs8Xwn6pzxGwqkhfJ9iXwM76KHjJd53uXbn0_IsZmZjea7qulrXx4rpVAdB0J2FXQ2bqltBc1QsvvOosUlZb9pAHY8BAdK8uT8_VFRjeHSrx2zkOPBf2my4jLZwFWBgoMZC0bIGSRCZGWQfIqmeY Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 6a9469128a8f47c4832a9e2cd12c26ac Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:51:15.082558 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:51:15.083902 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6a9469128a8f47c4832a9e2cd12c26ac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6a9469128a8f47c4832a9e2cd12c26ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6a9469128a8f47c4832a9e2cd12c26ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6a9469128a8f47c4832a9e2cd12c26ac"}]}] Oct 10 18:51:15.083902 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:15.083902 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 6a9469128a8f47c4832a9e2cd12c26ac Oct 10 18:51:15.083902 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:15.083902 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ImagesMetadataNegativeTestJSON-1967345086-project Oct 10 18:51:15.083902 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:51:15.083902 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:51:15.083902 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: fc9ee88dc5c94fb6951ab4333e1d6481 Oct 10 18:51:15.083902 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086-project Oct 10 18:51:15.083902 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:51:15.083902 n-d-860863-1 devstack@n-api.service[127289]: exception: Image not found. Oct 10 18:51:15.083902 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'image_id': '1a3144f4-5bc4-4428-9521-f7f54aa7fd7c'} Oct 10 18:51:15.083902 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:51:15.084808 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1a3144f4-5bc4-4428-9521-f7f54aa7fd7c Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:51:15.085940 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1a3144f4-5bc4-4428-9521-f7f54aa7fd7c could not be found. Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:15.088384 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 18:51:15.092564 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.097000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f82895e3-7443-4b35-b0ff-414f7cfe1974 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Returning 404 to user: Image not found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:15.097871 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f82895e3-7443-4b35-b0ff-414f7cfe1974 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] 10.222.0.43 "GET /compute/v2.1/images/1a3144f4-5bc4-4428-9521-f7f54aa7fd7c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.057230 Oct 10 18:51:15.104101 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 248/559] 10.222.0.43 () {58 vars in 1260 bytes} [Mon Oct 10 18:51:15 2022] GET /compute/v2.1/images/1a3144f4-5bc4-4428-9521-f7f54aa7fd7c/metadata => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:51:15.110527 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-35d3d2db-7f3a-4ff9-b4f0-b7dc57dac275 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.161"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:15.242322 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-580d4dc0-e753-4643-be18-cb72dcf31f01 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:15.258842 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-580d4dc0-e753-4643-be18-cb72dcf31f01 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1587 microversion: 2.1 time: 0.303535 Oct 10 18:51:15.272713 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 312/560] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:14 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1587 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:15.286640 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-35d3d2db-7f3a-4ff9-b4f0-b7dc57dac275 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:15.290528 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-eb28fb62-1e50-4d17-b7b2-f7e096e72d38 tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-659253859", "id": 238734496, "os-flavor-access:is_public": "False"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:15.295878 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-35d3d2db-7f3a-4ff9-b4f0-b7dc57dac275 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:15.296668 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-35d3d2db-7f3a-4ff9-b4f0-b7dc57dac275 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:15.297332 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-35d3d2db-7f3a-4ff9-b4f0-b7dc57dac275 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:15.298200 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-35d3d2db-7f3a-4ff9-b4f0-b7dc57dac275 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:15.298955 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-35d3d2db-7f3a-4ff9-b4f0-b7dc57dac275 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:15.299593 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-35d3d2db-7f3a-4ff9-b4f0-b7dc57dac275 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:15.443393 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-eb28fb62-1e50-4d17-b7b2-f7e096e72d38 tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.169168 Oct 10 18:51:15.444190 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 313/561] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:51:15 2022] POST /compute/v2.1/flavors => generated 427 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:15.458796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2b4a7c4e-04f1-4c1c-8991-5626eb6f42db tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Action: 'update_all', calling method: .version_select at 0x7f318e5c68b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:15.489747 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-2b4a7c4e-04f1-4c1c-8991-5626eb6f42db tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] HTTP exception thrown: Image not found. Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2b4a7c4e-04f1-4c1c-8991-5626eb6f42db tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Request method failure captured: Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: request: PUT /compute/v2.1/images/a4c6c742-b5fa-4d42-99d7-5b3812cf9e6a/metadata HTTP/1.1 Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 57 Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmhxJef0mrRleHtmYwPZn5xhnoYs8Xwn6pzxGwqkhfJ9iXwM76KHjJd53uXbn0_IsZmZjea7qulrXx4rpVAdB0J2FXQ2bqltBc1QsvvOosUlZb9pAHY8BAdK8uT8_VFRjeHSrx2zkOPBf2my4jLZwFWBgoMZC0bIGSRCZGWQfIqmeY Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 6a9469128a8f47c4832a9e2cd12c26ac Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:15.492171 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:15.498118 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6a9469128a8f47c4832a9e2cd12c26ac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6a9469128a8f47c4832a9e2cd12c26ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6a9469128a8f47c4832a9e2cd12c26ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6a9469128a8f47c4832a9e2cd12c26ac"}]}] Oct 10 18:51:15.498118 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:15.498118 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 6a9469128a8f47c4832a9e2cd12c26ac Oct 10 18:51:15.498118 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:15.498118 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesMetadataNegativeTestJSON-1967345086-project Oct 10 18:51:15.498118 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:15.498118 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:15.498118 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: fc9ee88dc5c94fb6951ab4333e1d6481 Oct 10 18:51:15.498118 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086-project Oct 10 18:51:15.498118 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:51:15.498118 n-d-860863-1 devstack@n-api.service[127288]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 10 18:51:15.498118 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:15.498118 n-d-860863-1 devstack@n-api.service[127288]: exception: Image not found. Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'image_id': 'a4c6c742-b5fa-4d42-99d7-5b3812cf9e6a', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:51:15.499092 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a4c6c742-b5fa-4d42-99d7-5b3812cf9e6a Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:51:15.500422 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a4c6c742-b5fa-4d42-99d7-5b3812cf9e6a could not be found. Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:15.502286 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 18:51:15.503616 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.505337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2b4a7c4e-04f1-4c1c-8991-5626eb6f42db tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Returning 404 to user: Image not found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:15.505337 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2b4a7c4e-04f1-4c1c-8991-5626eb6f42db tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] 10.222.0.43 "PUT /compute/v2.1/images/a4c6c742-b5fa-4d42-99d7-5b3812cf9e6a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048842 Oct 10 18:51:15.505337 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 314/562] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:51:15 2022] PUT /compute/v2.1/images/a4c6c742-b5fa-4d42-99d7-5b3812cf9e6a/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:51:15.515922 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d0340fad-e3c7-4c8a-9b1d-b63ec7fcc09a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:15.517455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d0340fad-e3c7-4c8a-9b1d-b63ec7fcc09a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:15.528080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0340fad-e3c7-4c8a-9b1d-b63ec7fcc09a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:15.528734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0340fad-e3c7-4c8a-9b1d-b63ec7fcc09a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:15.529336 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0340fad-e3c7-4c8a-9b1d-b63ec7fcc09a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:15.530322 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0340fad-e3c7-4c8a-9b1d-b63ec7fcc09a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:15.531723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0340fad-e3c7-4c8a-9b1d-b63ec7fcc09a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:15.532668 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0340fad-e3c7-4c8a-9b1d-b63ec7fcc09a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:15.623811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-d0340fad-e3c7-4c8a-9b1d-b63ec7fcc09a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:15.639340 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-35d3d2db-7f3a-4ff9-b4f0-b7dc57dac275 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] HTTP exception thrown: Floating IP 172.25.5.161 is not associated with instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948. Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-35d3d2db-7f3a-4ff9-b4f0-b7dc57dac275 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Request method failure captured: Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948/action HTTP/1.1 Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 49 Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGlxNI1Tw5WgiRccZTiPVdjOZX1h_DUuR3h-4MeKt7Jxa0ya6rT4nQDPIqngeeVBXzAo3xkOK-1UQcE_E7HkNUcnxWryHcPT20Nid4bweyOC3EnQe-QNcwR4UvwBZswt2utrtqEahB6KH6xCWzCwG2lRCOVl-B8VyAsAOpMiMC_beIg Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 38266e43742d4a9598d44340cac9bf92 Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-312378003 Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:51:15.640905 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:51:15.642477 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_38266e43742d4a9598d44340cac9bf92", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/38266e43742d4a9598d44340cac9bf92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38266e43742d4a9598d44340cac9bf92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38266e43742d4a9598d44340cac9bf92"}]}] Oct 10 18:51:15.642477 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-312378003 Oct 10 18:51:15.642477 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 38266e43742d4a9598d44340cac9bf92 Oct 10 18:51:15.642477 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-312378003 Oct 10 18:51:15.642477 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-FloatingIPsAssociationTestJSON-312378003-project Oct 10 18:51:15.642477 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:51:15.642477 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:51:15.642477 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: fc8eaa5f3d6b44cfaff60781c3381e80 Oct 10 18:51:15.642477 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-312378003-project Oct 10 18:51:15.642477 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:51:15.642477 n-d-860863-1 devstack@n-api.service[127289]: {"removeFloatingIp": {"address": "172.25.5.161"}} Oct 10 18:51:15.642477 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:51:15.642477 n-d-860863-1 devstack@n-api.service[127289]: exception: Floating IP 172.25.5.161 is not associated with instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948. Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'd0af7e1f-fea0-4343-9d8d-4ca0f78c1948', 'body': {'removeFloatingIp': {'address': '172.25.5.161'}}} Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.5.161 is not associated with instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948. Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.643402 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.644872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:15.644872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:15.644872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:15.644872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:15.644872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.5.161 is not associated with instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948. Oct 10 18:51:15.644872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.644872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-35d3d2db-7f3a-4ff9-b4f0-b7dc57dac275 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Returning 409 to user: Floating IP 172.25.5.161 is not associated with instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:15.644872 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-35d3d2db-7f3a-4ff9-b4f0-b7dc57dac275 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "POST /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948/action" status: 409 len: 146 microversion: 2.1 time: 0.541814 Oct 10 18:51:15.645752 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 249/563] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:51:15 2022] POST /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948/action => generated 146 bytes in 544 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:51:15.651078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1c448a47-d64f-4a02-82ed-352ae06c3815 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:15.651574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1c448a47-d64f-4a02-82ed-352ae06c3815 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:15.665632 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d0340fad-e3c7-4c8a-9b1d-b63ec7fcc09a tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.168836 Oct 10 18:51:15.666324 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 315/564] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:15 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:15.666958 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c448a47-d64f-4a02-82ed-352ae06c3815 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:15.667808 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c448a47-d64f-4a02-82ed-352ae06c3815 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:15.668742 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c448a47-d64f-4a02-82ed-352ae06c3815 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:15.669598 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c448a47-d64f-4a02-82ed-352ae06c3815 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:15.670571 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c448a47-d64f-4a02-82ed-352ae06c3815 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:15.671130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c448a47-d64f-4a02-82ed-352ae06c3815 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:15.672838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-be016689-3336-4cc4-995d-d1f3b365c52f tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:15.693526 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-be016689-3336-4cc4-995d-d1f3b365c52f tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/238734496/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.025313 Oct 10 18:51:15.700522 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 316/565] 10.222.0.43 () {58 vars in 1206 bytes} [Mon Oct 10 18:51:15 2022] GET /compute/v2.1/flavors/238734496/os-flavor-access => generated 21 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:51:15.706597 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9c3a83d0-64c1-4f38-9878-d7ebd7df3072 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Action: 'update', calling method: .version_select at 0x7f318e7e8670>, body: {"meta": {"os_distro": "alt"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:15.732379 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-9c3a83d0-64c1-4f38-9878-d7ebd7df3072 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] HTTP exception thrown: Image not found. Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9c3a83d0-64c1-4f38-9878-d7ebd7df3072 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Request method failure captured: Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: request: PUT /compute/v2.1/images/ac84831f-f09a-4404-b7c6-99517cf63b27/metadata/os_distro HTTP/1.1 Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 30 Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmhxJef0mrRleHtmYwPZn5xhnoYs8Xwn6pzxGwqkhfJ9iXwM76KHjJd53uXbn0_IsZmZjea7qulrXx4rpVAdB0J2FXQ2bqltBc1QsvvOosUlZb9pAHY8BAdK8uT8_VFRjeHSrx2zkOPBf2my4jLZwFWBgoMZC0bIGSRCZGWQfIqmeY Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 6a9469128a8f47c4832a9e2cd12c26ac Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:15.734761 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:15.736380 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6a9469128a8f47c4832a9e2cd12c26ac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6a9469128a8f47c4832a9e2cd12c26ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6a9469128a8f47c4832a9e2cd12c26ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6a9469128a8f47c4832a9e2cd12c26ac"}]}] Oct 10 18:51:15.736380 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:15.736380 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 6a9469128a8f47c4832a9e2cd12c26ac Oct 10 18:51:15.736380 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:15.736380 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesMetadataNegativeTestJSON-1967345086-project Oct 10 18:51:15.736380 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:15.736380 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:15.736380 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: fc9ee88dc5c94fb6951ab4333e1d6481 Oct 10 18:51:15.736380 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086-project Oct 10 18:51:15.736380 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:51:15.736380 n-d-860863-1 devstack@n-api.service[127288]: {"meta": {"os_distro": "alt"}} Oct 10 18:51:15.736380 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:15.736380 n-d-860863-1 devstack@n-api.service[127288]: exception: Image not found. Oct 10 18:51:15.736380 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'image_id': 'ac84831f-f09a-4404-b7c6-99517cf63b27', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:51:15.737541 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ac84831f-f09a-4404-b7c6-99517cf63b27 Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:51:15.738844 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac84831f-f09a-4404-b7c6-99517cf63b27 could not be found. Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:15.740318 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 18:51:15.748248 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.750352 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9c3a83d0-64c1-4f38-9878-d7ebd7df3072 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Returning 404 to user: Image not found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:15.750352 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9c3a83d0-64c1-4f38-9878-d7ebd7df3072 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] 10.222.0.43 "PUT /compute/v2.1/images/ac84831f-f09a-4404-b7c6-99517cf63b27/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.040624 Oct 10 18:51:15.750352 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 317/566] 10.222.0.43 () {60 vars in 1310 bytes} [Mon Oct 10 18:51:15 2022] PUT /compute/v2.1/images/ac84831f-f09a-4404-b7c6-99517cf63b27/metadata/os_distro => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:51:15.756046 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-5f3dc074-3989-4b99-afd5-9e0bd4f84624 req-b6a60ecc-78ad-4b3b-8418-c06de415968f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba31eefc-640b-41f5-8c00-a6d021cef3ca", "tag": "b8ce8642-3363-42a2-afad-1a4e62608841"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:15.770927 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5f3dc074-3989-4b99-afd5-9e0bd4f84624 req-b6a60ecc-78ad-4b3b-8418-c06de415968f service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:15.771457 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5f3dc074-3989-4b99-afd5-9e0bd4f84624 req-b6a60ecc-78ad-4b3b-8418-c06de415968f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:15.772031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5f3dc074-3989-4b99-afd5-9e0bd4f84624 req-b6a60ecc-78ad-4b3b-8418-c06de415968f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:15.782928 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-5f3dc074-3989-4b99-afd5-9e0bd4f84624 req-b6a60ecc-78ad-4b3b-8418-c06de415968f service nova] Creating event network-changed:b8ce8642-3363-42a2-afad-1a4e62608841 for instance ba31eefc-640b-41f5-8c00-a6d021cef3ca on n-h1-860863-1 Oct 10 18:51:15.783907 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1c448a47-d64f-4a02-82ed-352ae06c3815 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136995 Oct 10 18:51:15.793977 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 250/567] 10.222.0.43 () {58 vars in 1275 bytes} [Mon Oct 10 18:51:15 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:15.795978 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-5f3dc074-3989-4b99-afd5-9e0bd4f84624 req-b6a60ecc-78ad-4b3b-8418-c06de415968f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051962 Oct 10 18:51:15.798080 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 318/568] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:15.802817 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-97a3b925-83b8-40be-9949-707ebc2dcec2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.161"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:15.803840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8f909f00-671b-4e91-a6e4-52f6753cd6d0 tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:15.862779 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8f909f00-671b-4e91-a6e4-52f6753cd6d0 tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/238734496" status: 202 len: 0 microversion: 2.1 time: 0.064597 Oct 10 18:51:15.863596 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 319/569] 10.222.0.43 () {58 vars in 1158 bytes} [Mon Oct 10 18:51:15 2022] DELETE /compute/v2.1/flavors/238734496 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:51:15.869055 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-867e45bc-b654-45b5-b112-5efc98b907d4 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Action: 'create', calling method: .version_select at 0x7f318e5c6310>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:15.919083 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-867e45bc-b654-45b5-b112-5efc98b907d4 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] HTTP exception thrown: Image not found. Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-867e45bc-b654-45b5-b112-5efc98b907d4 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Request method failure captured: Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/images/06c85932-e025-4494-86c9-7b90b23a5551/metadata HTTP/1.1 Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 57 Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmhxJef0mrRleHtmYwPZn5xhnoYs8Xwn6pzxGwqkhfJ9iXwM76KHjJd53uXbn0_IsZmZjea7qulrXx4rpVAdB0J2FXQ2bqltBc1QsvvOosUlZb9pAHY8BAdK8uT8_VFRjeHSrx2zkOPBf2my4jLZwFWBgoMZC0bIGSRCZGWQfIqmeY Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 6a9469128a8f47c4832a9e2cd12c26ac Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:15.922151 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:15.923494 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6a9469128a8f47c4832a9e2cd12c26ac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6a9469128a8f47c4832a9e2cd12c26ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6a9469128a8f47c4832a9e2cd12c26ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6a9469128a8f47c4832a9e2cd12c26ac"}]}] Oct 10 18:51:15.923494 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:15.923494 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 6a9469128a8f47c4832a9e2cd12c26ac Oct 10 18:51:15.923494 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086 Oct 10 18:51:15.923494 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesMetadataNegativeTestJSON-1967345086-project Oct 10 18:51:15.923494 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:15.923494 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:15.923494 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: fc9ee88dc5c94fb6951ab4333e1d6481 Oct 10 18:51:15.923494 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1967345086-project Oct 10 18:51:15.923494 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:51:15.923494 n-d-860863-1 devstack@n-api.service[127288]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 10 18:51:15.923494 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:15.923494 n-d-860863-1 devstack@n-api.service[127288]: exception: Image not found. Oct 10 18:51:15.923494 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'image_id': '06c85932-e025-4494-86c9-7b90b23a5551', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:51:15.924356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 06c85932-e025-4494-86c9-7b90b23a5551 Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:51:15.925476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 06c85932-e025-4494-86c9-7b90b23a5551 could not be found. Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:15.927507 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 18:51:15.930341 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:15.934955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-867e45bc-b654-45b5-b112-5efc98b907d4 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] Returning 404 to user: Image not found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:15.936103 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-867e45bc-b654-45b5-b112-5efc98b907d4 tempest-ImagesMetadataNegativeTestJSON-1967345086 tempest-ImagesMetadataNegativeTestJSON-1967345086-project] 10.222.0.43 "POST /compute/v2.1/images/06c85932-e025-4494-86c9-7b90b23a5551/metadata" status: 404 len: 62 microversion: 2.1 time: 0.071190 Oct 10 18:51:15.937210 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 320/570] 10.222.0.43 () {60 vars in 1281 bytes} [Mon Oct 10 18:51:15 2022] POST /compute/v2.1/images/06c85932-e025-4494-86c9-7b90b23a5551/metadata => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:51:15.952885 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0dbf338d-a3f0-4ef0-a1eb-22b23f8264ac tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:15.994069 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0dbf338d-a3f0-4ef0-a1eb-22b23f8264ac tempest-FlavorsAccessTestJSON-603079873 tempest-FlavorsAccessTestJSON-603079873-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.055551 Oct 10 18:51:15.995295 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 321/571] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:15 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:16.093142 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-97a3b925-83b8-40be-9949-707ebc2dcec2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:16.100914 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-97a3b925-83b8-40be-9949-707ebc2dcec2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:16.101530 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-97a3b925-83b8-40be-9949-707ebc2dcec2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:16.102240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-97a3b925-83b8-40be-9949-707ebc2dcec2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:16.108896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-97a3b925-83b8-40be-9949-707ebc2dcec2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:16.108896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-97a3b925-83b8-40be-9949-707ebc2dcec2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:16.108896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-97a3b925-83b8-40be-9949-707ebc2dcec2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:16.562302 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-97a3b925-83b8-40be-9949-707ebc2dcec2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "refresh_cache-ba31eefc-640b-41f5-8c00-a6d021cef3ca" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 18:51:16.567511 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-97a3b925-83b8-40be-9949-707ebc2dcec2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquired lock "refresh_cache-ba31eefc-640b-41f5-8c00-a6d021cef3ca" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 18:51:16.694336 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ef55a2b8-1c92-4830-ad97-0a0f5fe5bbc7 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:16.695605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ef55a2b8-1c92-4830-ad97-0a0f5fe5bbc7 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:16.705540 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ef55a2b8-1c92-4830-ad97-0a0f5fe5bbc7 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:16.709346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ef55a2b8-1c92-4830-ad97-0a0f5fe5bbc7 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:16.711192 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ef55a2b8-1c92-4830-ad97-0a0f5fe5bbc7 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:16.712103 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ef55a2b8-1c92-4830-ad97-0a0f5fe5bbc7 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:16.714609 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ef55a2b8-1c92-4830-ad97-0a0f5fe5bbc7 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:16.715058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ef55a2b8-1c92-4830-ad97-0a0f5fe5bbc7 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:16.853434 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-ef55a2b8-1c92-4830-ad97-0a0f5fe5bbc7 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:16.896105 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ef55a2b8-1c92-4830-ad97-0a0f5fe5bbc7 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.205455 Oct 10 18:51:16.908561 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 322/572] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:16 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:51:17.394827 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c60442a8-bd84-485d-845e-d15b3748758a tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Action: 'create', calling method: .version_select at 0x7f318e9c2ca0>, body: {"keypair": {"name": "tempest-keypair-528622759", "type": "ssh", "user_id": "a09354afdc094feb8997608abeaaefd9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTkDk3sSFrj65QATZ+FLWyWpjmzCxpweAk2wZPYt2x5xdJeMYicHyGJ/CvRYi1Tm62n/LHeYIhF6uVHeutvehFZ4EMv855NMeONr1MHD6AaOiQ8ayX4V4zqDFGTO2lBFw=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:17.423833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-c60442a8-bd84-485d-845e-d15b3748758a tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Getting quotas for project 55b9b2f431294ddbba85b63b7c5f952e. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:17.429186 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-c60442a8-bd84-485d-845e-d15b3748758a tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Getting quotas for user 096bde6b10f747eabcb62a50cf710162 and project 55b9b2f431294ddbba85b63b7c5f952e. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:17.660115 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c60442a8-bd84-485d-845e-d15b3748758a tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.447976 Oct 10 18:51:17.661750 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 323/573] 10.222.0.43 () {62 vars in 1200 bytes} [Mon Oct 10 18:51:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 450 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 10 18:51:17.676798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2fd521b8-eccc-4906-b7a0-e62b95fe1a30 tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Action: 'create', calling method: .version_select at 0x7f318e5c6430>, body: {"keypair": {"name": "tempest-keypair-1518719028", "type": "ssh", "user_id": "a09354afdc094feb8997608abeaaefd9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb76rnd1zHVq4oJYWBa/0GA4jYgkzRwcKP/8Er7P/b+yrcYDY7ygeF2NYYC/bGYD/MC9sQx3KArIhO+In7CAxp5L7NE99+LSpt8znK227FSza8Vobax90UU98X6HlL+nQ=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:17.724232 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-2fd521b8-eccc-4906-b7a0-e62b95fe1a30 tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Getting quotas for project 55b9b2f431294ddbba85b63b7c5f952e. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:17.732464 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-2fd521b8-eccc-4906-b7a0-e62b95fe1a30 tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Getting quotas for user 096bde6b10f747eabcb62a50cf710162 and project 55b9b2f431294ddbba85b63b7c5f952e. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:17.826067 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2fd521b8-eccc-4906-b7a0-e62b95fe1a30 tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.153368 Oct 10 18:51:17.827020 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 324/574] 10.222.0.43 () {62 vars in 1200 bytes} [Mon Oct 10 18:51:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 18:51:17.843760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-66e4b08f-1dc7-491a-a2ba-30f01bb843a2 tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Calling method '.version_select at 0x7f318e5c4550>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:17.856026 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-66e4b08f-1dc7-491a-a2ba-30f01bb843a2 tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-528622759?user_id=a09354afdc094feb8997608abeaaefd9" status: 200 len: 511 microversion: 2.10 time: 0.018482 Oct 10 18:51:17.860660 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 325/575] 10.222.0.43 () {60 vars in 1337 bytes} [Mon Oct 10 18:51:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-528622759?user_id=a09354afdc094feb8997608abeaaefd9 => generated 511 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:51:17.872597 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4ceddb0d-3756-4327-8790-710bc7274aca tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Action: 'create', calling method: .version_select at 0x7f318e5c4ca0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2074696089", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzfa8T30C0PtagEi95kqM6aoGx+LDFvJh3XC0YH2SaJ/kDDiel2aiNhw/hZkMn/OT7R6Md5C2WA/xDZJks7dI4poBw31idwI5W4rTXwjCTt7DrPulwyF2j5CZLGVFk3eg=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:17.893836 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-4ceddb0d-3756-4327-8790-710bc7274aca tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Getting quotas for project 55b9b2f431294ddbba85b63b7c5f952e. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:17.899106 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-4ceddb0d-3756-4327-8790-710bc7274aca tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Getting quotas for user 096bde6b10f747eabcb62a50cf710162 and project 55b9b2f431294ddbba85b63b7c5f952e. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:18.014074 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4ceddb0d-3756-4327-8790-710bc7274aca tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.146058 Oct 10 18:51:18.015271 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 326/576] 10.222.0.43 () {62 vars in 1200 bytes} [Mon Oct 10 18:51:17 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 18:51:18.026982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-92ae2391-2eba-4f5e-a7c9-7ff274d108b4 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:18.029596 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-92ae2391-2eba-4f5e-a7c9-7ff274d108b4 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:18.038338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92ae2391-2eba-4f5e-a7c9-7ff274d108b4 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:18.039130 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92ae2391-2eba-4f5e-a7c9-7ff274d108b4 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:18.039572 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92ae2391-2eba-4f5e-a7c9-7ff274d108b4 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:18.040298 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92ae2391-2eba-4f5e-a7c9-7ff274d108b4 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:18.040798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92ae2391-2eba-4f5e-a7c9-7ff274d108b4 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:18.041434 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92ae2391-2eba-4f5e-a7c9-7ff274d108b4 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:18.136366 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-92ae2391-2eba-4f5e-a7c9-7ff274d108b4 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:18.184734 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-92ae2391-2eba-4f5e-a7c9-7ff274d108b4 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.167863 Oct 10 18:51:18.185204 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 327/577] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:18 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:18.195130 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2841f3c2-e2fc-4433-b512-792dae5d82bb tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:18.200314 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2841f3c2-e2fc-4433-b512-792dae5d82bb tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:18.218002 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2841f3c2-e2fc-4433-b512-792dae5d82bb tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:18.219154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2841f3c2-e2fc-4433-b512-792dae5d82bb tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:18.219669 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2841f3c2-e2fc-4433-b512-792dae5d82bb tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:18.220520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2841f3c2-e2fc-4433-b512-792dae5d82bb tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:18.221235 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2841f3c2-e2fc-4433-b512-792dae5d82bb tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:18.222401 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2841f3c2-e2fc-4433-b512-792dae5d82bb tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:18.651761 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2841f3c2-e2fc-4433-b512-792dae5d82bb tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:18.661586 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2841f3c2-e2fc-4433-b512-792dae5d82bb tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1587 microversion: 2.1 time: 0.475075 Oct 10 18:51:18.663194 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 328/578] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:18 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1587 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:18.670205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-0075b9e8-ced7-4080-9b1f-557c871e4d4a req-a1eb2f50-13e6-400b-aee4-4aadee7b40d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010c33e9-e125-40ee-bc0a-2a9c98c5c36c", "tag": "431fe82a-d096-423c-9fb6-a785452351e7"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:18.686175 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0075b9e8-ced7-4080-9b1f-557c871e4d4a req-a1eb2f50-13e6-400b-aee4-4aadee7b40d0 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:18.688072 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0075b9e8-ced7-4080-9b1f-557c871e4d4a req-a1eb2f50-13e6-400b-aee4-4aadee7b40d0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:18.689144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0075b9e8-ced7-4080-9b1f-557c871e4d4a req-a1eb2f50-13e6-400b-aee4-4aadee7b40d0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:18.716906 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-0075b9e8-ced7-4080-9b1f-557c871e4d4a req-a1eb2f50-13e6-400b-aee4-4aadee7b40d0 service nova] Creating event network-changed:431fe82a-d096-423c-9fb6-a785452351e7 for instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c on n-h1-860863-1 Oct 10 18:51:18.723451 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-0075b9e8-ced7-4080-9b1f-557c871e4d4a req-a1eb2f50-13e6-400b-aee4-4aadee7b40d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057606 Oct 10 18:51:18.724819 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 329/579] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:18.730919 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f68a892d-fc9b-447d-92f0-3bacad9f3121 tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Calling method '.version_select at 0x7f318e531ee0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:18.735623 n-d-860863-1 devstack@n-api.service[127288]: WARNING oslo_db.sqlalchemy.utils [None req-f68a892d-fc9b-447d-92f0-3bacad9f3121 tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 18:51:18.746936 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f68a892d-fc9b-447d-92f0-3bacad9f3121 tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] 10.222.0.43 "GET /compute/v2.1/os-keypairs?user_id=a09354afdc094feb8997608abeaaefd9" status: 200 len: 725 microversion: 2.10 time: 0.020214 Oct 10 18:51:18.750555 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 330/580] 10.222.0.43 () {60 vars in 1259 bytes} [Mon Oct 10 18:51:18 2022] GET /compute/v2.1/os-keypairs?user_id=a09354afdc094feb8997608abeaaefd9 => generated 725 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:51:18.773652 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ff6a1838-7e59-4ed5-95c5-5841a60dd21b tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Calling method '.version_select at 0x7f318e5c4430>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:18.876862 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ff6a1838-7e59-4ed5-95c5-5841a60dd21b tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2074696089" status: 204 len: 0 microversion: 2.10 time: 0.109493 Oct 10 18:51:18.879788 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 331/581] 10.222.0.43 () {60 vars in 1325 bytes} [Mon Oct 10 18:51:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2074696089 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 18:51:18.888844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-54fb4136-125f-4807-97f0-6f36592863b0 tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Calling method '.version_select at 0x7f318e5c4a60>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:18.988248 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-54fb4136-125f-4807-97f0-6f36592863b0 tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1518719028?user_id=a09354afdc094feb8997608abeaaefd9" status: 204 len: 0 microversion: 2.10 time: 0.104452 Oct 10 18:51:18.989657 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 332/582] 10.222.0.43 () {60 vars in 1343 bytes} [Mon Oct 10 18:51:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1518719028?user_id=a09354afdc094feb8997608abeaaefd9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 18:51:18.999440 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f35e6477-00e9-4783-a348-9be5cc3ed649 tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] Calling method '.version_select at 0x7f318e531820>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:19.156297 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f35e6477-00e9-4783-a348-9be5cc3ed649 tempest-KeyPairsV210TestJSON-376926237 tempest-KeyPairsV210TestJSON-376926237-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-528622759?user_id=a09354afdc094feb8997608abeaaefd9" status: 204 len: 0 microversion: 2.10 time: 0.161868 Oct 10 18:51:19.162037 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 333/583] 10.222.0.43 () {60 vars in 1340 bytes} [Mon Oct 10 18:51:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-528622759?user_id=a09354afdc094feb8997608abeaaefd9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 18:51:19.216706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e56c829d-f749-4db8-be89-f1f5a21d3655 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:19.217503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e56c829d-f749-4db8-be89-f1f5a21d3655 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:19.232828 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e56c829d-f749-4db8-be89-f1f5a21d3655 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:19.233572 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e56c829d-f749-4db8-be89-f1f5a21d3655 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:19.235932 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e56c829d-f749-4db8-be89-f1f5a21d3655 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:19.237121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e56c829d-f749-4db8-be89-f1f5a21d3655 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:19.238075 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e56c829d-f749-4db8-be89-f1f5a21d3655 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:19.239299 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e56c829d-f749-4db8-be89-f1f5a21d3655 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:19.352184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-97a3b925-83b8-40be-9949-707ebc2dcec2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Building network info cache for instance {{(pid=127289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 18:51:19.445571 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-e56c829d-f749-4db8-be89-f1f5a21d3655 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:19.521704 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e56c829d-f749-4db8-be89-f1f5a21d3655 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.310291 Oct 10 18:51:19.545304 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 334/584] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:19 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:51:19.565785 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-946995ce-365d-4648-99ed-f4b66f48f563 req-46373987-65eb-484a-97ba-c03021e7dbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba31eefc-640b-41f5-8c00-a6d021cef3ca", "tag": "b8ce8642-3363-42a2-afad-1a4e62608841"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:19.590694 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-946995ce-365d-4648-99ed-f4b66f48f563 req-46373987-65eb-484a-97ba-c03021e7dbb2 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:19.591288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-946995ce-365d-4648-99ed-f4b66f48f563 req-46373987-65eb-484a-97ba-c03021e7dbb2 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:19.591823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-946995ce-365d-4648-99ed-f4b66f48f563 req-46373987-65eb-484a-97ba-c03021e7dbb2 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:19.622394 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-946995ce-365d-4648-99ed-f4b66f48f563 req-46373987-65eb-484a-97ba-c03021e7dbb2 service nova] Creating event network-changed:b8ce8642-3363-42a2-afad-1a4e62608841 for instance ba31eefc-640b-41f5-8c00-a6d021cef3ca on n-h1-860863-1 Oct 10 18:51:19.630416 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-946995ce-365d-4648-99ed-f4b66f48f563 req-46373987-65eb-484a-97ba-c03021e7dbb2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082006 Oct 10 18:51:19.633260 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 335/585] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:20.561305 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5f2c8b38-f830-4bf7-918c-499ca6ff633d tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:20.562019 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5f2c8b38-f830-4bf7-918c-499ca6ff633d tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:20.575454 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f2c8b38-f830-4bf7-918c-499ca6ff633d tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:20.579237 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f2c8b38-f830-4bf7-918c-499ca6ff633d tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:20.581077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f2c8b38-f830-4bf7-918c-499ca6ff633d tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:20.585401 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f2c8b38-f830-4bf7-918c-499ca6ff633d tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:20.589636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f2c8b38-f830-4bf7-918c-499ca6ff633d tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:20.589636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f2c8b38-f830-4bf7-918c-499ca6ff633d tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:20.871464 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-5f2c8b38-f830-4bf7-918c-499ca6ff633d tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:20.915907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:20.928702 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5f2c8b38-f830-4bf7-918c-499ca6ff633d tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1927 microversion: 2.75 time: 0.374648 Oct 10 18:51:20.931555 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 336/586] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:20 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1927 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:21.639605 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-97a3b925-83b8-40be-9949-707ebc2dcec2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Updating instance_info_cache with network_info: [{"id": "b8ce8642-3363-42a2-afad-1a4e62608841", "address": "fa:16:3e:05:fa:56", "network": {"id": "c5f3fcff-69f9-404c-aeaa-2f1924041f8b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2042277977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "38266e43742d4a9598d44340cac9bf92", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb8ce8642-33", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 18:51:21.747538 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-97a3b925-83b8-40be-9949-707ebc2dcec2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Releasing lock "refresh_cache-ba31eefc-640b-41f5-8c00-a6d021cef3ca" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 18:51:21.748699 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-97a3b925-83b8-40be-9949-707ebc2dcec2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "POST /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca/action" status: 202 len: 0 microversion: 2.1 time: 5.953663 Oct 10 18:51:21.749537 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 251/587] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:51:15 2022] POST /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca/action => generated 0 bytes in 5955 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 18:51:21.759907 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2d42da07-f971-4397-a005-5e2c50019f39 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:21.765133 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2d42da07-f971-4397-a005-5e2c50019f39 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:21.791272 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2d42da07-f971-4397-a005-5e2c50019f39 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:21.791272 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2d42da07-f971-4397-a005-5e2c50019f39 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:21.791272 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2d42da07-f971-4397-a005-5e2c50019f39 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:21.791272 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2d42da07-f971-4397-a005-5e2c50019f39 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:21.791634 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2d42da07-f971-4397-a005-5e2c50019f39 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:21.791634 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2d42da07-f971-4397-a005-5e2c50019f39 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:21.819376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-20dfa58f-6222-4bb9-b2ef-36a9b52219db tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Action: 'create', calling method: .version_select at 0x7f318e7331f0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtvEEz+xr6gjW/pdg4/6LIOjqrDjqYzFZrjXj92bNMMmYFzy8eVsFLQZVwWIgELeplhKGq7hkvIOXFrDQ6djeaHLK9b0ryph7CchKsP25NtaEJmiVknhl5HxIezARommw=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-20dfa58f-6222-4bb9-b2ef-36a9b52219db tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Request method failure captured: Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 257 Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmpb8UCzIVfiHoh2Hm6EzFc4uX73pTltX5USj9cptMiPuAmVxCeno1aeZdyaHK9k5URMVSwpgmuKqq0fj6ihvIZLIF2sQrVRyblb2B3Q10CKEjsMLwjkb7MVHeatR_rVnSMhvUjjj7ob6MZd0wKRC98_-dXJZNgZLmm7w_2FrHz26I Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:21.826465 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:21.828074 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b9be3e6a40804047be3a8ea2fc38a1ca", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}] Oct 10 18:51:21.828074 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:21.828074 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:21.828074 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:21.828074 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:21.828074 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:21.828074 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:21.828074 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c327041922ad4a088954fecb86f9df31 Oct 10 18:51:21.828074 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:21.828074 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:51:21.828074 n-d-860863-1 devstack@n-api.service[127288]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtvEEz+xr6gjW/pdg4/6LIOjqrDjqYzFZrjXj92bNMMmYFzy8eVsFLQZVwWIgELeplhKGq7hkvIOXFrDQ6djeaHLK9b0ryph7CchKsP25NtaEJmiVknhl5HxIezARommw=="}} Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtvEEz+xr6gjW/pdg4/6LIOjqrDjqYzFZrjXj92bNMMmYFzy8eVsFLQZVwWIgELeplhKGq7hkvIOXFrDQ6djeaHLK9b0ryph7CchKsP25NtaEJmiVknhl5HxIezARommw=='}}} Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:21.828957 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise error Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:21.830324 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 18:51:21.832026 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 18:51:21.833440 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 10 18:51:21.833440 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.833440 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-20dfa58f-6222-4bb9-b2ef-36a9b52219db tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:21.836629 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-20dfa58f-6222-4bb9-b2ef-36a9b52219db tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.312465 Oct 10 18:51:21.837406 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 337/588] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:51:21 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 317 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 18:51:21.852090 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2d42da07-f971-4397-a005-5e2c50019f39 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:51:21.855101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0181812d-1d03-47cd-8eab-494a9aaf1554 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Action: 'create', calling method: .version_select at 0x7f318e5c61f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1368461424", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:21.895167 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:21.902009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0181812d-1d03-47cd-8eab-494a9aaf1554 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Getting quotas for project b9be3e6a40804047be3a8ea2fc38a1ca. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:21.913432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0181812d-1d03-47cd-8eab-494a9aaf1554 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Getting quotas for user c327041922ad4a088954fecb86f9df31 and project b9be3e6a40804047be3a8ea2fc38a1ca. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:21.969203 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-0181812d-1d03-47cd-8eab-494a9aaf1554 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0181812d-1d03-47cd-8eab-494a9aaf1554 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Request method failure captured: Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 2167 Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmpb8UCzIVfiHoh2Hm6EzFc4uX73pTltX5USj9cptMiPuAmVxCeno1aeZdyaHK9k5URMVSwpgmuKqq0fj6ihvIZLIF2sQrVRyblb2B3Q10CKEjsMLwjkb7MVHeatR_rVnSMhvUjjj7ob6MZd0wKRC98_-dXJZNgZLmm7w_2FrHz26I Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b9be3e6a40804047be3a8ea2fc38a1ca", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}] Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c327041922ad4a088954fecb86f9df31 Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1368461424", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:21.980399 n-d-860863-1 devstack@n-api.service[127288]: exception: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1368461424', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:21.982970 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:21.986444 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:21.988768 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0181812d-1d03-47cd-8eab-494a9aaf1554 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:21.989973 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0181812d-1d03-47cd-8eab-494a9aaf1554 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.146563 Oct 10 18:51:21.991342 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 338/589] 10.222.0.43 () {60 vars in 1160 bytes} [Mon Oct 10 18:51:21 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 18:51:22.002863 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c9b4070f-76fe-4be1-ad38-6ab18d69df57 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:22.005170 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c9b4070f-76fe-4be1-ad38-6ab18d69df57 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:22.015984 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9b4070f-76fe-4be1-ad38-6ab18d69df57 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:22.016935 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9b4070f-76fe-4be1-ad38-6ab18d69df57 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:22.017677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9b4070f-76fe-4be1-ad38-6ab18d69df57 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:22.018448 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9b4070f-76fe-4be1-ad38-6ab18d69df57 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:22.018912 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9b4070f-76fe-4be1-ad38-6ab18d69df57 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:22.019543 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9b4070f-76fe-4be1-ad38-6ab18d69df57 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:22.138926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:22.147372 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-c9b4070f-76fe-4be1-ad38-6ab18d69df57 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:22.181364 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c9b4070f-76fe-4be1-ad38-6ab18d69df57 tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1933 microversion: 2.75 time: 0.188917 Oct 10 18:51:22.182397 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 339/590] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:21 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1933 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:22.187179 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-546a6d0b-e3bb-4a77-ba55-6f7aea04b464 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Action: 'create', calling method: .version_select at 0x7f318e5c63a0>, body: {"keypair": {"name": "tempest-keypair-431109852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIX9Fi0WvzF7ATzLcxyN65xwjUgWMcgNuWCQyXM/sCm5eW5KoMt1iikfSnS2/iKdCCJPBPWmf6D8xkdn2eQGu5Dg7a8tJWYBiMl4tS3XI/uqbclRClTjd6XrSCuU1X6ng=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:22.204326 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-546a6d0b-e3bb-4a77-ba55-6f7aea04b464 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Getting quotas for project b9be3e6a40804047be3a8ea2fc38a1ca. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:22.208491 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-546a6d0b-e3bb-4a77-ba55-6f7aea04b464 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Getting quotas for user c327041922ad4a088954fecb86f9df31 and project b9be3e6a40804047be3a8ea2fc38a1ca. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:22.278677 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2d42da07-f971-4397-a005-5e2c50019f39 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca" status: 204 len: 0 microversion: 2.1 time: 0.524266 Oct 10 18:51:22.279466 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 252/591] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:51:21 2022] DELETE /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:51:22.303075 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-140c26cb-7b6d-49b3-a5bf-5736007c1af1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.161"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:22.307485 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-140c26cb-7b6d-49b3-a5bf-5736007c1af1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:22.319824 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-546a6d0b-e3bb-4a77-ba55-6f7aea04b464 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.136286 Oct 10 18:51:22.321139 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 340/592] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:51:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:22.324337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140c26cb-7b6d-49b3-a5bf-5736007c1af1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:22.325024 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140c26cb-7b6d-49b3-a5bf-5736007c1af1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:22.325640 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140c26cb-7b6d-49b3-a5bf-5736007c1af1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:22.331259 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140c26cb-7b6d-49b3-a5bf-5736007c1af1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:22.331743 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140c26cb-7b6d-49b3-a5bf-5736007c1af1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:22.332298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140c26cb-7b6d-49b3-a5bf-5736007c1af1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:22.336212 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f0bc2a11-1522-45e3-94ea-619a533010ad tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Action: 'create', calling method: .version_select at 0x7f318e531b80>, body: {"keypair": {"name": "tempest-keypair-431109852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxds8Lv9mgnpewzHWotR2mZjhAV4kTspHiQWce2gyBfLbrEpgAZtRl8FSgTZ5zl6mYmtVqFFuFPtdwWD6dqeEcCz5VgUwBBW2u3V/NlC1GGul28kLnCrXln4n9n4adcMg=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:22.374359 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-f0bc2a11-1522-45e3-94ea-619a533010ad tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Getting quotas for project b9be3e6a40804047be3a8ea2fc38a1ca. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:22.382742 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-f0bc2a11-1522-45e3-94ea-619a533010ad tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Getting quotas for user c327041922ad4a088954fecb86f9df31 and project b9be3e6a40804047be3a8ea2fc38a1ca. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:22.383289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140c26cb-7b6d-49b3-a5bf-5736007c1af1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "refresh_cache-d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 18:51:22.387889 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140c26cb-7b6d-49b3-a5bf-5736007c1af1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquired lock "refresh_cache-d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 18:51:22.528234 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-f0bc2a11-1522-45e3-94ea-619a533010ad tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] HTTP exception thrown: Key pair 'tempest-keypair-431109852' already exists. Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f0bc2a11-1522-45e3-94ea-619a533010ad tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Request method failure captured: Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 272 Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmpb8UCzIVfiHoh2Hm6EzFc4uX73pTltX5USj9cptMiPuAmVxCeno1aeZdyaHK9k5URMVSwpgmuKqq0fj6ihvIZLIF2sQrVRyblb2B3Q10CKEjsMLwjkb7MVHeatR_rVnSMhvUjjj7ob6MZd0wKRC98_-dXJZNgZLmm7w_2FrHz26I Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b9be3e6a40804047be3a8ea2fc38a1ca", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}] Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c327041922ad4a088954fecb86f9df31 Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: {"keypair": {"name": "tempest-keypair-431109852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxds8Lv9mgnpewzHWotR2mZjhAV4kTspHiQWce2gyBfLbrEpgAZtRl8FSgTZ5zl6mYmtVqFFuFPtdwWD6dqeEcCz5VgUwBBW2u3V/NlC1GGul28kLnCrXln4n9n4adcMg=="}} Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: exception: Key pair 'tempest-keypair-431109852' already exists. Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-431109852', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxds8Lv9mgnpewzHWotR2mZjhAV4kTspHiQWce2gyBfLbrEpgAZtRl8FSgTZ5zl6mYmtVqFFuFPtdwWD6dqeEcCz5VgUwBBW2u3V/NlC1GGul28kLnCrXln4n9n4adcMg=='}}} Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result.read() Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'c327041922ad4a088954fecb86f9df31-tempest-keypair-431109852' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 10 18:51:22.553937 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi session.flush() Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result.read() Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 10 18:51:22.558506 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'c327041922ad4a088954fecb86f9df31-tempest-keypair-431109852' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 10, 18, 51, 22, 445532), 'updated_at': None, 'name': 'tempest-keypair-431109852', 'user_id': 'c327041922ad4a088954fecb86f9df31', 'fingerprint': '16:43:56:70:79:78:39:dd:ad:0a:68:2a:11:59:95:f7', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxds8Lv9mgnpewzHWotR2mZjhAV4kTspHiQWce2gyBfLbrEpgAZtRl8FSgTZ5zl6mYmtVqFFuFPtdwWD6dqeEcCz5VgUwBBW2u3V/NlC1GGul28kLnCrXln4n9n4adcMg==', 'type': 'ssh'}] Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi keypair.create() Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._create() Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-431109852' already exists. Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 10 18:51:22.564330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-431109852' already exists. Oct 10 18:51:22.571776 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.571776 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:22.571776 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.571776 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.571776 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:22.571776 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:22.571776 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:22.571776 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:22.571776 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-431109852' already exists. Oct 10 18:51:22.571776 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.574804 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f0bc2a11-1522-45e3-94ea-619a533010ad tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Returning 409 to user: Key pair 'tempest-keypair-431109852' already exists. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:22.575863 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f0bc2a11-1522-45e3-94ea-619a533010ad tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.244236 Oct 10 18:51:22.577031 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 341/593] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:51:22 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 246 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:51:22.586027 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f101e053-ca1b-4f3d-8701-4f7b9e21aabd tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Calling method '.version_select at 0x7f318e31fc10>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:22.697942 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f101e053-ca1b-4f3d-8701-4f7b9e21aabd tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-431109852" status: 202 len: 0 microversion: 2.1 time: 0.116414 Oct 10 18:51:22.700713 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 342/594] 10.222.0.43 () {58 vars in 1218 bytes} [Mon Oct 10 18:51:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-431109852 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 18:51:22.710688 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8c8c9989-c002-4665-b2a0-f9f95a118ac1 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Action: 'create', calling method: .version_select at 0x7f318e329f70>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdcjAS9g8EjItvLLB+5rmrKCrljLhMAXemnlmKBPX+3utudHUvYvG0OcwlqJUMQBOcfcd8twDxmk6Vfea1yfgBTP3CGjpu/Bv4OHC40mXTCUN9EgfFevEvR7GEMoW+gbQ=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8c8c9989-c002-4665-b2a0-f9f95a118ac1 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Request method failure captured: Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 247 Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmpb8UCzIVfiHoh2Hm6EzFc4uX73pTltX5USj9cptMiPuAmVxCeno1aeZdyaHK9k5URMVSwpgmuKqq0fj6ihvIZLIF2sQrVRyblb2B3Q10CKEjsMLwjkb7MVHeatR_rVnSMhvUjjj7ob6MZd0wKRC98_-dXJZNgZLmm7w_2FrHz26I Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b9be3e6a40804047be3a8ea2fc38a1ca", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}] Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c327041922ad4a088954fecb86f9df31 Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdcjAS9g8EjItvLLB+5rmrKCrljLhMAXemnlmKBPX+3utudHUvYvG0OcwlqJUMQBOcfcd8twDxmk6Vfea1yfgBTP3CGjpu/Bv4OHC40mXTCUN9EgfFevEvR7GEMoW+gbQ=="}} Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdcjAS9g8EjItvLLB+5rmrKCrljLhMAXemnlmKBPX+3utudHUvYvG0OcwlqJUMQBOcfcd8twDxmk6Vfea1yfgBTP3CGjpu/Bv4OHC40mXTCUN9EgfFevEvR7GEMoW+gbQ=='}}} Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise error Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi '' Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 18:51:22.722363 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 10 18:51:22.726311 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.733651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8c8c9989-c002-4665-b2a0-f9f95a118ac1 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:22.737101 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8c8c9989-c002-4665-b2a0-f9f95a118ac1 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.030328 Oct 10 18:51:22.740646 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 343/595] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:51:22 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 18:51:22.758933 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7d746324-d110-4ddf-98b7-3ec6bfeff910 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Action: 'create', calling method: .version_select at 0x7f318e329430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-153854667", "public_key": " "}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:22.808624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-7d746324-d110-4ddf-98b7-3ec6bfeff910 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Getting quotas for project b9be3e6a40804047be3a8ea2fc38a1ca. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:22.814935 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-7d746324-d110-4ddf-98b7-3ec6bfeff910 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Getting quotas for user c327041922ad4a088954fecb86f9df31 and project b9be3e6a40804047be3a8ea2fc38a1ca. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:22.853318 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-7d746324-d110-4ddf-98b7-3ec6bfeff910 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7d746324-d110-4ddf-98b7-3ec6bfeff910 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Request method failure captured: Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 94 Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmpb8UCzIVfiHoh2Hm6EzFc4uX73pTltX5USj9cptMiPuAmVxCeno1aeZdyaHK9k5URMVSwpgmuKqq0fj6ihvIZLIF2sQrVRyblb2B3Q10CKEjsMLwjkb7MVHeatR_rVnSMhvUjjj7ob6MZd0wKRC98_-dXJZNgZLmm7w_2FrHz26I Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b9be3e6a40804047be3a8ea2fc38a1ca", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}] Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c327041922ad4a088954fecb86f9df31 Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-153854667", "public_key": " "}} Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: exception: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-153854667', 'public_key': ' '}}} Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:22.855495 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7d746324-d110-4ddf-98b7-3ec6bfeff910 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:22.861174 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7d746324-d110-4ddf-98b7-3ec6bfeff910 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.114335 Oct 10 18:51:22.863808 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 344/596] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Oct 10 18:51:22 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 18:51:22.874964 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c8dbec1c-13e5-44ae-bc76-b042860d70c0 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Action: 'create', calling method: .version_select at 0x7f318e32c310>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQKDn1vcrCfWnADQ61bLtb1xYsNkinBLihfMVckd2+N7JLdgLonN4lJ/7wNyD0ncDYpzmwBV3AqXpihiye7nlm4TeJP/LlagvyuuqFq0rGpduzQQRrok5OFJnuo6lCCpA=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c8dbec1c-13e5-44ae-bc76-b042860d70c0 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Request method failure captured: Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 507 Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmpb8UCzIVfiHoh2Hm6EzFc4uX73pTltX5USj9cptMiPuAmVxCeno1aeZdyaHK9k5URMVSwpgmuKqq0fj6ihvIZLIF2sQrVRyblb2B3Q10CKEjsMLwjkb7MVHeatR_rVnSMhvUjjj7ob6MZd0wKRC98_-dXJZNgZLmm7w_2FrHz26I Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b9be3e6a40804047be3a8ea2fc38a1ca", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}] Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c327041922ad4a088954fecb86f9df31 Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQKDn1vcrCfWnADQ61bLtb1xYsNkinBLihfMVckd2+N7JLdgLonN4lJ/7wNyD0ncDYpzmwBV3AqXpihiye7nlm4TeJP/LlagvyuuqFq0rGpduzQQRrok5OFJnuo6lCCpA=="}} Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQKDn1vcrCfWnADQ61bLtb1xYsNkinBLihfMVckd2+N7JLdgLonN4lJ/7wNyD0ncDYpzmwBV3AqXpihiye7nlm4TeJP/LlagvyuuqFq0rGpduzQQRrok5OFJnuo6lCCpA=='}}} Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise error Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 10 18:51:22.880256 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c8dbec1c-13e5-44ae-bc76-b042860d70c0 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c8dbec1c-13e5-44ae-bc76-b042860d70c0 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.012159 Oct 10 18:51:22.884065 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 345/597] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:51:22 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 10 18:51:22.893081 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-528ca23b-350e-4075-a26b-2f8b9030d059 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Action: 'create', calling method: .version_select at 0x7f318e31fd30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-631891162", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:22.911700 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-528ca23b-350e-4075-a26b-2f8b9030d059 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Getting quotas for project b9be3e6a40804047be3a8ea2fc38a1ca. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:22.917378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-528ca23b-350e-4075-a26b-2f8b9030d059 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Getting quotas for user c327041922ad4a088954fecb86f9df31 and project b9be3e6a40804047be3a8ea2fc38a1ca. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-528ca23b-350e-4075-a26b-2f8b9030d059 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-528ca23b-350e-4075-a26b-2f8b9030d059 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Request method failure captured: Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 117 Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmpb8UCzIVfiHoh2Hm6EzFc4uX73pTltX5USj9cptMiPuAmVxCeno1aeZdyaHK9k5URMVSwpgmuKqq0fj6ihvIZLIF2sQrVRyblb2B3Q10CKEjsMLwjkb7MVHeatR_rVnSMhvUjjj7ob6MZd0wKRC98_-dXJZNgZLmm7w_2FrHz26I Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b9be3e6a40804047be3a8ea2fc38a1ca", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}] Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c327041922ad4a088954fecb86f9df31 Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-631891162", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: exception: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-631891162', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:51:23.376101 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-528ca23b-350e-4075-a26b-2f8b9030d059 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-528ca23b-350e-4075-a26b-2f8b9030d059 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.064486 Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 346/598] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:51:22 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e2862029-7389-4d2f-bf10-a40275d3b70f tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e2862029-7389-4d2f-bf10-a40275d3b70f tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:23.394249 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2862029-7389-4d2f-bf10-a40275d3b70f tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:23.398923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2862029-7389-4d2f-bf10-a40275d3b70f tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:23.398923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2862029-7389-4d2f-bf10-a40275d3b70f tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:23.398923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2862029-7389-4d2f-bf10-a40275d3b70f tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:23.398923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2862029-7389-4d2f-bf10-a40275d3b70f tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:23.398923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2862029-7389-4d2f-bf10-a40275d3b70f tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:23.398923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-e2862029-7389-4d2f-bf10-a40275d3b70f tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:23.398923 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e2862029-7389-4d2f-bf10-a40275d3b70f tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1933 microversion: 2.75 time: 0.102405 Oct 10 18:51:23.398923 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 347/599] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:23 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1933 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:51:23.398923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3e87f861-4ba1-4459-9236-6c468a3181b2 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Calling method '.version_select at 0x7f318e329e50>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:23.400019 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-3e87f861-4ba1-4459-9236-6c468a3181b2 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1405395150 not found for user c327041922ad4a088954fecb86f9df31 Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3e87f861-4ba1-4459-9236-6c468a3181b2 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Request method failure captured: Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1405395150 HTTP/1.1 Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmpb8UCzIVfiHoh2Hm6EzFc4uX73pTltX5USj9cptMiPuAmVxCeno1aeZdyaHK9k5URMVSwpgmuKqq0fj6ihvIZLIF2sQrVRyblb2B3Q10CKEjsMLwjkb7MVHeatR_rVnSMhvUjjj7ob6MZd0wKRC98_-dXJZNgZLmm7w_2FrHz26I Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b9be3e6a40804047be3a8ea2fc38a1ca", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b9be3e6a40804047be3a8ea2fc38a1ca"}]}] Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b9be3e6a40804047be3a8ea2fc38a1ca Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-886859349 Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c327041922ad4a088954fecb86f9df31 Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-KeyPairsNegativeTestJSON-886859349-project Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: exception: Keypair tempest-keypair-non-existent-1405395150 not found for user c327041922ad4a088954fecb86f9df31 Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'tempest-keypair-non-existent-1405395150'} Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1405395150 not found for user c327041922ad4a088954fecb86f9df31 Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:23.401218 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1405395150 not found for user c327041922ad4a088954fecb86f9df31 Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1405395150 not found for user c327041922ad4a088954fecb86f9df31 Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3e87f861-4ba1-4459-9236-6c468a3181b2 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1405395150 not found for user c327041922ad4a088954fecb86f9df31 {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3e87f861-4ba1-4459-9236-6c468a3181b2 tempest-KeyPairsNegativeTestJSON-886859349 tempest-KeyPairsNegativeTestJSON-886859349-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1405395150" status: 404 len: 145 microversion: 2.1 time: 0.045877 Oct 10 18:51:23.405858 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 348/600] 10.222.0.43 () {58 vars in 1260 bytes} [Mon Oct 10 18:51:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1405395150 => generated 145 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:24.380951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5cf0e5ae-652a-4e04-a103-06c017619e2c tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:24.386582 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5cf0e5ae-652a-4e04-a103-06c017619e2c tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:24.401726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cf0e5ae-652a-4e04-a103-06c017619e2c tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:24.403190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cf0e5ae-652a-4e04-a103-06c017619e2c tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:24.404736 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cf0e5ae-652a-4e04-a103-06c017619e2c tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:24.405834 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cf0e5ae-652a-4e04-a103-06c017619e2c tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:24.408202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cf0e5ae-652a-4e04-a103-06c017619e2c tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:24.410317 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cf0e5ae-652a-4e04-a103-06c017619e2c tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:24.567760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-5cf0e5ae-652a-4e04-a103-06c017619e2c tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] Lazy-loading 'services' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:24.621717 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5cf0e5ae-652a-4e04-a103-06c017619e2c tempest-ServersAdmin275Test-901571119 tempest-ServersAdmin275Test-901571119-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1918 microversion: 2.75 time: 0.247483 Oct 10 18:51:24.622312 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 349/601] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:24 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1918 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:24.660038 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-729ae67b-71ee-4719-8e02-cf138bd15f0a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:24.660566 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-729ae67b-71ee-4719-8e02-cf138bd15f0a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:24.670907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-729ae67b-71ee-4719-8e02-cf138bd15f0a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:24.680273 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-729ae67b-71ee-4719-8e02-cf138bd15f0a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:24.681060 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-729ae67b-71ee-4719-8e02-cf138bd15f0a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:24.682022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-729ae67b-71ee-4719-8e02-cf138bd15f0a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:24.682650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-729ae67b-71ee-4719-8e02-cf138bd15f0a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:24.683436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-729ae67b-71ee-4719-8e02-cf138bd15f0a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:24.735407 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-729ae67b-71ee-4719-8e02-cf138bd15f0a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:51:25.199988 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-729ae67b-71ee-4719-8e02-cf138bd15f0a tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "DELETE /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 204 len: 0 microversion: 2.75 time: 0.543981 Oct 10 18:51:25.200853 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 350/602] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:51:24 2022] DELETE /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 10 18:51:25.217144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d7cae46f-e4db-49bf-a265-82f25a22379d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:25.218617 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d7cae46f-e4db-49bf-a265-82f25a22379d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:25.237338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d7cae46f-e4db-49bf-a265-82f25a22379d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:25.237338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d7cae46f-e4db-49bf-a265-82f25a22379d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:25.241268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d7cae46f-e4db-49bf-a265-82f25a22379d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:25.242286 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d7cae46f-e4db-49bf-a265-82f25a22379d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:25.243444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d7cae46f-e4db-49bf-a265-82f25a22379d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:25.244109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d7cae46f-e4db-49bf-a265-82f25a22379d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:25.320852 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-140c26cb-7b6d-49b3-a5bf-5736007c1af1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Building network info cache for instance {{(pid=127289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 18:51:25.450744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d7cae46f-e4db-49bf-a265-82f25a22379d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:25.463501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d7cae46f-e4db-49bf-a265-82f25a22379d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:25.470388 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d7cae46f-e4db-49bf-a265-82f25a22379d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:25.476677 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d7cae46f-e4db-49bf-a265-82f25a22379d tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1443 microversion: 2.75 time: 0.264873 Oct 10 18:51:25.489147 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 351/603] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:25 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1443 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:51:25.503809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-da54bda7-e4d7-411c-95ee-c71fdf56be4c req-b93933e1-e1d8-4361-a0b0-ee978c4a5b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0af7e1f-fea0-4343-9d8d-4ca0f78c1948", "tag": "c9a0326e-ae77-42a1-8db7-434146a99516"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:25.515086 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-da54bda7-e4d7-411c-95ee-c71fdf56be4c req-b93933e1-e1d8-4361-a0b0-ee978c4a5b8f service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:25.515746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-da54bda7-e4d7-411c-95ee-c71fdf56be4c req-b93933e1-e1d8-4361-a0b0-ee978c4a5b8f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:25.516335 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-da54bda7-e4d7-411c-95ee-c71fdf56be4c req-b93933e1-e1d8-4361-a0b0-ee978c4a5b8f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:25.528910 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-da54bda7-e4d7-411c-95ee-c71fdf56be4c req-b93933e1-e1d8-4361-a0b0-ee978c4a5b8f service nova] Creating event network-changed:c9a0326e-ae77-42a1-8db7-434146a99516 for instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 on n-h2-860863-1 Oct 10 18:51:25.544044 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-da54bda7-e4d7-411c-95ee-c71fdf56be4c req-b93933e1-e1d8-4361-a0b0-ee978c4a5b8f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051224 Oct 10 18:51:25.544952 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 352/604] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:26.101317 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c0e0755d-f5b1-44bd-a802-ac2b97bfec10 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Action: 'create', calling method: .version_select at 0x7f318e329670>, body: {"keypair": {"name": "tempest-keypair-1689307306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVThfiA33M3kpObpt/QVvlSiYSlRn9Hne84g2VtE3rOXOWZdnqfQx9391QZae/eL/G4MvjLc39rRvDqGFn159NS28lupurO7tTPB6VgjJguPMDaDGoTanoZthkzomPmNw=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:26.140717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-c0e0755d-f5b1-44bd-a802-ac2b97bfec10 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Getting quotas for project f6ec8b0e87fd4e2c8d67076d2b8c797f. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:26.147870 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-c0e0755d-f5b1-44bd-a802-ac2b97bfec10 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Getting quotas for user f9ec15e796424161be9af968e6167528 and project f6ec8b0e87fd4e2c8d67076d2b8c797f. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:26.276799 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c0e0755d-f5b1-44bd-a802-ac2b97bfec10 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.730423 Oct 10 18:51:26.277602 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 353/605] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:51:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:26.508389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-dd3a0eff-97c2-43ee-a676-bdc45ec7d860 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:26.511605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-dd3a0eff-97c2-43ee-a676-bdc45ec7d860 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:26.518702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:26.520577 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd3a0eff-97c2-43ee-a676-bdc45ec7d860 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:26.521391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd3a0eff-97c2-43ee-a676-bdc45ec7d860 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:26.521995 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd3a0eff-97c2-43ee-a676-bdc45ec7d860 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:26.522854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd3a0eff-97c2-43ee-a676-bdc45ec7d860 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:26.527781 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd3a0eff-97c2-43ee-a676-bdc45ec7d860 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:26.531972 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd3a0eff-97c2-43ee-a676-bdc45ec7d860 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:26.562561 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-140c26cb-7b6d-49b3-a5bf-5736007c1af1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Updating instance_info_cache with network_info: [{"id": "c9a0326e-ae77-42a1-8db7-434146a99516", "address": "fa:16:3e:7c:40:3e", "network": {"id": "c5f3fcff-69f9-404c-aeaa-2f1924041f8b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2042277977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "38266e43742d4a9598d44340cac9bf92", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc9a0326e-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 18:51:26.711970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140c26cb-7b6d-49b3-a5bf-5736007c1af1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Releasing lock "refresh_cache-d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 18:51:26.718323 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-140c26cb-7b6d-49b3-a5bf-5736007c1af1 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "POST /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948/action" status: 202 len: 0 microversion: 2.1 time: 4.414129 Oct 10 18:51:26.718323 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 253/606] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:51:22 2022] POST /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948/action => generated 0 bytes in 4417 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 18:51:26.723621 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d73d3658-cb5f-45ba-b0df-1a6fe4c2089a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '.version_select at 0x7f318e44b430>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:26.741368 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dd3a0eff-97c2-43ee-a676-bdc45ec7d860 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:26.758845 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dd3a0eff-97c2-43ee-a676-bdc45ec7d860 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:26.762228 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dd3a0eff-97c2-43ee-a676-bdc45ec7d860 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:26.791661 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-dd3a0eff-97c2-43ee-a676-bdc45ec7d860 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1443 microversion: 2.75 time: 0.287606 Oct 10 18:51:26.799578 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 354/607] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:26 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1443 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:27.080416 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d73d3658-cb5f-45ba-b0df-1a6fe4c2089a tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/5ed10bc8-271e-4853-a929-1f3d54688200" status: 200 len: 185 microversion: 2.1 time: 0.360365 Oct 10 18:51:27.081473 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 254/608] 10.222.0.43 () {58 vars in 1260 bytes} [Mon Oct 10 18:51:26 2022] GET /compute/v2.1/os-floating-ips/5ed10bc8-271e-4853-a929-1f3d54688200 => generated 185 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:27.096032 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4719181c-ff8d-4fa7-880c-0fbd206024b2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.161"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:27.467888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4719181c-ff8d-4fa7-880c-0fbd206024b2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:27.479614 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4719181c-ff8d-4fa7-880c-0fbd206024b2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.482210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4719181c-ff8d-4fa7-880c-0fbd206024b2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.482210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4719181c-ff8d-4fa7-880c-0fbd206024b2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.483347 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4719181c-ff8d-4fa7-880c-0fbd206024b2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.486031 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4719181c-ff8d-4fa7-880c-0fbd206024b2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.486774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4719181c-ff8d-4fa7-880c-0fbd206024b2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.571647 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b4705c05-a326-49b3-9ddf-0582ace14f82 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Calling method '.version_select at 0x7f318e32c280>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:27.578962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4705c05-a326-49b3-9ddf-0582ace14f82 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.578962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4705c05-a326-49b3-9ddf-0582ace14f82 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.578962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4705c05-a326-49b3-9ddf-0582ace14f82 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.610269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4705c05-a326-49b3-9ddf-0582ace14f82 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.612520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4705c05-a326-49b3-9ddf-0582ace14f82 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.619227 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4705c05-a326-49b3-9ddf-0582ace14f82 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.639978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4705c05-a326-49b3-9ddf-0582ace14f82 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.640834 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4705c05-a326-49b3-9ddf-0582ace14f82 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.641438 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4705c05-a326-49b3-9ddf-0582ace14f82 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.652523 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b4705c05-a326-49b3-9ddf-0582ace14f82 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.693406 Oct 10 18:51:27.654230 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 355/609] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:51:27.673209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e562c21c-9975-4984-bc4d-b527ddd89eb8 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Calling method '.version_select at 0x7f318e32cc10>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:27.678873 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e562c21c-9975-4984-bc4d-b527ddd89eb8 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.679420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e562c21c-9975-4984-bc4d-b527ddd89eb8 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.680658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e562c21c-9975-4984-bc4d-b527ddd89eb8 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.703382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e562c21c-9975-4984-bc4d-b527ddd89eb8 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.704125 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e562c21c-9975-4984-bc4d-b527ddd89eb8 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.704803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e562c21c-9975-4984-bc4d-b527ddd89eb8 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.754057 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e562c21c-9975-4984-bc4d-b527ddd89eb8 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.755191 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e562c21c-9975-4984-bc4d-b527ddd89eb8 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.755858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e562c21c-9975-4984-bc4d-b527ddd89eb8 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.764274 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e562c21c-9975-4984-bc4d-b527ddd89eb8 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/n-h1-860863-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.103318 Oct 10 18:51:27.764988 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 356/610] 10.222.0.43 () {58 vars in 1212 bytes} [Mon Oct 10 18:51:27 2022] GET /compute/v2.1/os-hypervisors/n-h1-860863-1/servers => generated 196 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:27.777209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-b0e5eee3-9be5-44db-b37e-2caefee3b512 req-650f89cb-21af-4fa3-a685-0be5526fe76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba31eefc-640b-41f5-8c00-a6d021cef3ca", "name": "network-vif-deleted", "tag": "b8ce8642-3363-42a2-afad-1a4e62608841"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:27.787341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b0e5eee3-9be5-44db-b37e-2caefee3b512 req-650f89cb-21af-4fa3-a685-0be5526fe76b service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.788221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b0e5eee3-9be5-44db-b37e-2caefee3b512 req-650f89cb-21af-4fa3-a685-0be5526fe76b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.788930 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b0e5eee3-9be5-44db-b37e-2caefee3b512 req-650f89cb-21af-4fa3-a685-0be5526fe76b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.819180 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-b0e5eee3-9be5-44db-b37e-2caefee3b512 req-650f89cb-21af-4fa3-a685-0be5526fe76b service nova] Creating event network-vif-deleted:b8ce8642-3363-42a2-afad-1a4e62608841 for instance ba31eefc-640b-41f5-8c00-a6d021cef3ca on n-h1-860863-1 Oct 10 18:51:27.829209 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-b0e5eee3-9be5-44db-b37e-2caefee3b512 req-650f89cb-21af-4fa3-a685-0be5526fe76b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062763 Oct 10 18:51:27.830333 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 357/611] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:27.836429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-35efcc72-d0d7-4640-b1c5-bd4ae6870925 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Calling method '.version_select at 0x7f318e31f430>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:27.839324 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35efcc72-d0d7-4640-b1c5-bd4ae6870925 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.839625 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35efcc72-d0d7-4640-b1c5-bd4ae6870925 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.840373 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35efcc72-d0d7-4640-b1c5-bd4ae6870925 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.857238 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35efcc72-d0d7-4640-b1c5-bd4ae6870925 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.858023 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35efcc72-d0d7-4640-b1c5-bd4ae6870925 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.858526 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35efcc72-d0d7-4640-b1c5-bd4ae6870925 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.870465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35efcc72-d0d7-4640-b1c5-bd4ae6870925 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.871954 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35efcc72-d0d7-4640-b1c5-bd4ae6870925 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.872641 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35efcc72-d0d7-4640-b1c5-bd4ae6870925 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.874214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4719181c-ff8d-4fa7-880c-0fbd206024b2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "refresh_cache-d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 10 18:51:27.874634 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4719181c-ff8d-4fa7-880c-0fbd206024b2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquired lock "refresh_cache-d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 10 18:51:27.880413 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-35efcc72-d0d7-4640-b1c5-bd4ae6870925 tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048698 Oct 10 18:51:27.887164 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 358/612] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:27.892205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:27.898733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:27.898733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.899228 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.900117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.901059 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.901880 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.902502 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.950746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:27.951446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:27.952247 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:27.953103 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lazy-loading 'fault' on Instance uuid 71146662-a680-4a91-81e6-40cbea2284ab {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:28.054582 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:28.072371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:28.076190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7914aad2d75e45ff83670105b7383e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef741d9b69c440c86b92b1a74dc3967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:28.086043 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-645706a3-0dac-44ab-b334-c75cb03db580 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 200 len: 1448 microversion: 2.75 time: 0.196972 Oct 10 18:51:28.086949 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 359/613] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:27 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 1448 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:51:28.452104 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-448012cc-0c45-43a5-bb5b-b5c4869112dd tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Calling method '.version_select at 0x7f318e342dc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:28.455486 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-448012cc-0c45-43a5-bb5b-b5c4869112dd tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.456085 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-448012cc-0c45-43a5-bb5b-b5c4869112dd tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.456389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-448012cc-0c45-43a5-bb5b-b5c4869112dd tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.460362 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-448012cc-0c45-43a5-bb5b-b5c4869112dd tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.460926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-448012cc-0c45-43a5-bb5b-b5c4869112dd tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.461385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-448012cc-0c45-43a5-bb5b-b5c4869112dd tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.527287 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-448012cc-0c45-43a5-bb5b-b5c4869112dd tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.438975 Oct 10 18:51:28.527882 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 360/614] 10.222.0.43 () {58 vars in 1128 bytes} [Mon Oct 10 18:51:28 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:28.534377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1689561f-14f6-4922-9b2e-b0cd04ce5b1a tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Calling method '.version_select at 0x7f318e342430>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:28.534377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1689561f-14f6-4922-9b2e-b0cd04ce5b1a tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.534625 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1689561f-14f6-4922-9b2e-b0cd04ce5b1a tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.534887 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1689561f-14f6-4922-9b2e-b0cd04ce5b1a tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.579334 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1689561f-14f6-4922-9b2e-b0cd04ce5b1a tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.579932 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1689561f-14f6-4922-9b2e-b0cd04ce5b1a tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.580163 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1689561f-14f6-4922-9b2e-b0cd04ce5b1a tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.590221 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1689561f-14f6-4922-9b2e-b0cd04ce5b1a tempest-HypervisorAdminUnderV252Test-1159604342 tempest-HypervisorAdminUnderV252Test-1159604342-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/n-h1-860863-1/search" status: 200 len: 104 microversion: 2.1 time: 0.059284 Oct 10 18:51:28.592906 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 361/615] 10.222.0.43 () {58 vars in 1209 bytes} [Mon Oct 10 18:51:28 2022] GET /compute/v2.1/os-hypervisors/n-h1-860863-1/search => generated 104 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:28.599999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-72462e26-1587-492c-8975-09132c125435 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Calling method '.version_select at 0x7f318e329550>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:28.616005 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-72462e26-1587-492c-8975-09132c125435 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.616805 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-72462e26-1587-492c-8975-09132c125435 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.617425 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-72462e26-1587-492c-8975-09132c125435 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.618322 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-72462e26-1587-492c-8975-09132c125435 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.618928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-72462e26-1587-492c-8975-09132c125435 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.619535 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-72462e26-1587-492c-8975-09132c125435 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.650475 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-72462e26-1587-492c-8975-09132c125435 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.055192 Oct 10 18:51:28.651899 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 362/616] 10.222.0.43 () {58 vars in 1139 bytes} [Mon Oct 10 18:51:28 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:28.665908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2039729b-cffa-4c1e-8e09-90b8ce60c944 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Calling method '.version_select at 0x7f318e329e50>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:28.670824 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2039729b-cffa-4c1e-8e09-90b8ce60c944 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.671619 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2039729b-cffa-4c1e-8e09-90b8ce60c944 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.672337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2039729b-cffa-4c1e-8e09-90b8ce60c944 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.673747 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2039729b-cffa-4c1e-8e09-90b8ce60c944 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.674520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2039729b-cffa-4c1e-8e09-90b8ce60c944 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.676931 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2039729b-cffa-4c1e-8e09-90b8ce60c944 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.717746 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2039729b-cffa-4c1e-8e09-90b8ce60c944 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.056448 Oct 10 18:51:28.718932 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 363/617] 10.222.0.43 () {58 vars in 1145 bytes} [Mon Oct 10 18:51:28 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:51:28.732089 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bcab46c0-9ee9-4a7b-bba2-c3bf4add98ad tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Calling method '.version_select at 0x7f318e3428b0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:28.735318 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bcab46c0-9ee9-4a7b-bba2-c3bf4add98ad tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.735797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bcab46c0-9ee9-4a7b-bba2-c3bf4add98ad tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.736234 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bcab46c0-9ee9-4a7b-bba2-c3bf4add98ad tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.737614 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bcab46c0-9ee9-4a7b-bba2-c3bf4add98ad tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.738282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bcab46c0-9ee9-4a7b-bba2-c3bf4add98ad tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.738886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bcab46c0-9ee9-4a7b-bba2-c3bf4add98ad tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.767212 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bcab46c0-9ee9-4a7b-bba2-c3bf4add98ad tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.040249 Oct 10 18:51:28.769449 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 364/618] 10.222.0.43 () {58 vars in 1128 bytes} [Mon Oct 10 18:51:28 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:51:28.780320 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bc545e81-62c8-426f-96ba-395acdd49050 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Calling method '.version_select at 0x7f318e342820>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:28.784716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc545e81-62c8-426f-96ba-395acdd49050 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.785703 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc545e81-62c8-426f-96ba-395acdd49050 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.786404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc545e81-62c8-426f-96ba-395acdd49050 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.787800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc545e81-62c8-426f-96ba-395acdd49050 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.788648 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc545e81-62c8-426f-96ba-395acdd49050 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.789360 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc545e81-62c8-426f-96ba-395acdd49050 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.817144 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bc545e81-62c8-426f-96ba-395acdd49050 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.041412 Oct 10 18:51:28.821642 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 365/619] 10.222.0.43 () {58 vars in 1155 bytes} [Mon Oct 10 18:51:28 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:28.833044 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-db6c077e-ac23-424f-ba00-2ccc470fab76 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Calling method '.version_select at 0x7f318e342f70>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:28.839348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db6c077e-ac23-424f-ba00-2ccc470fab76 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.841666 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db6c077e-ac23-424f-ba00-2ccc470fab76 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.842134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db6c077e-ac23-424f-ba00-2ccc470fab76 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.843012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db6c077e-ac23-424f-ba00-2ccc470fab76 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.843476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db6c077e-ac23-424f-ba00-2ccc470fab76 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.843956 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db6c077e-ac23-424f-ba00-2ccc470fab76 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.868247 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-db6c077e-ac23-424f-ba00-2ccc470fab76 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.039309 Oct 10 18:51:28.869101 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 366/620] 10.222.0.43 () {58 vars in 1128 bytes} [Mon Oct 10 18:51:28 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:51:28.879363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4e371130-500c-484e-be9b-9dd2206c7c06 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Calling method '.version_select at 0x7f318e329790>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:28.887071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e371130-500c-484e-be9b-9dd2206c7c06 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.887558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e371130-500c-484e-be9b-9dd2206c7c06 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.887994 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e371130-500c-484e-be9b-9dd2206c7c06 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.917236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e371130-500c-484e-be9b-9dd2206c7c06 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.917902 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e371130-500c-484e-be9b-9dd2206c7c06 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.919409 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e371130-500c-484e-be9b-9dd2206c7c06 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.934900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:28.943012 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4e371130-500c-484e-be9b-9dd2206c7c06 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-h1-860863-1" status: 200 len: 467 microversion: 2.1 time: 0.066849 Oct 10 18:51:28.943834 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 367/621] 10.222.0.43 () {58 vars in 1170 bytes} [Mon Oct 10 18:51:28 2022] GET /compute/v2.1/os-hosts/n-h1-860863-1 => generated 467 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:51:28.956579 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-548b71c0-2e38-45d6-a777-250908850d46 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Calling method '.version_select at 0x7f318e3290d0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:28.970059 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-548b71c0-2e38-45d6-a777-250908850d46 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.970643 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-548b71c0-2e38-45d6-a777-250908850d46 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.971197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-548b71c0-2e38-45d6-a777-250908850d46 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:28.989383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-548b71c0-2e38-45d6-a777-250908850d46 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:28.989960 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-548b71c0-2e38-45d6-a777-250908850d46 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:28.990483 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-548b71c0-2e38-45d6-a777-250908850d46 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:29.023723 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-548b71c0-2e38-45d6-a777-250908850d46 tempest-HostsAdminTestJSON-167891211 tempest-HostsAdminTestJSON-167891211-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/n-h2-860863-1" status: 200 len: 467 microversion: 2.1 time: 0.072037 Oct 10 18:51:29.025699 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 368/622] 10.222.0.43 () {58 vars in 1170 bytes} [Mon Oct 10 18:51:28 2022] GET /compute/v2.1/os-hosts/n-h2-860863-1 => generated 467 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:51:29.115635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b50a5bc9-ce30-472e-b7dc-2f06812b7fd9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:29.116398 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b50a5bc9-ce30-472e-b7dc-2f06812b7fd9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] [instance: 71146662-a680-4a91-81e6-40cbea2284ab] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:29.124789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b50a5bc9-ce30-472e-b7dc-2f06812b7fd9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:29.125281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b50a5bc9-ce30-472e-b7dc-2f06812b7fd9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:29.128923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b50a5bc9-ce30-472e-b7dc-2f06812b7fd9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:29.131263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b50a5bc9-ce30-472e-b7dc-2f06812b7fd9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:29.131757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b50a5bc9-ce30-472e-b7dc-2f06812b7fd9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:29.132252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b50a5bc9-ce30-472e-b7dc-2f06812b7fd9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:29.170513 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-b50a5bc9-ce30-472e-b7dc-2f06812b7fd9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] HTTP exception thrown: Instance 71146662-a680-4a91-81e6-40cbea2284ab could not be found. Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b50a5bc9-ce30-472e-b7dc-2f06812b7fd9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Request method failure captured: Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab HTTP/1.1 Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGlb3UbutHDJZ8ZxanAWAgSQBNeEPLje4EKH11BlaT4ss7oigIX9nTdLm6nburBGd4OyTz2uiUR1zoM2VAZRHPfscmYe-FI250-HUwoHCz83Cl-xMw07VSMudGJO8qgQa5lBp0VbbwlVBJkFFx6ODzD0mcg3imwYUjtQmVVQ5c5XARM Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Openstack-Nova-Api-Version: 2.75 Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 8ef741d9b69c440c86b92b1a74dc3967 Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersAdmin275Test-1484897998 Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ef741d9b69c440c86b92b1a74dc3967", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ef741d9b69c440c86b92b1a74dc3967"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ef741d9b69c440c86b92b1a74dc3967"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ef741d9b69c440c86b92b1a74dc3967"}]}] Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersAdmin275Test-1484897998 Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 8ef741d9b69c440c86b92b1a74dc3967 Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersAdmin275Test-1484897998 Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersAdmin275Test-1484897998-project Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 7914aad2d75e45ff83670105b7383e74 Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersAdmin275Test-1484897998-project Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 71146662-a680-4a91-81e6-40cbea2284ab could not be found. Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '71146662-a680-4a91-81e6-40cbea2284ab'} Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71146662-a680-4a91-81e6-40cbea2284ab could not be found. Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71146662-a680-4a91-81e6-40cbea2284ab could not be found. Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:29.173033 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:29.177950 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:29.177950 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:29.177950 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:29.177950 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:29.177950 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:29.177950 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71146662-a680-4a91-81e6-40cbea2284ab could not be found. Oct 10 18:51:29.177950 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:29.177950 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b50a5bc9-ce30-472e-b7dc-2f06812b7fd9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] Returning 404 to user: Instance 71146662-a680-4a91-81e6-40cbea2284ab could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:29.177950 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b50a5bc9-ce30-472e-b7dc-2f06812b7fd9 tempest-ServersAdmin275Test-1484897998 tempest-ServersAdmin275Test-1484897998-project] 10.222.0.43 "GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab" status: 404 len: 111 microversion: 2.75 time: 0.063480 Oct 10 18:51:29.179965 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 369/623] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:51:29 2022] GET /compute/v2.1/servers/71146662-a680-4a91-81e6-40cbea2284ab => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:51:29.612239 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-4719181c-ff8d-4fa7-880c-0fbd206024b2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Building network info cache for instance {{(pid=127289) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 10 18:51:29.869532 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-e3749f70-78bf-4654-a4aa-0fde543f2cec req-79de9d5c-524f-4c68-b6ed-425ec2c3577a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0af7e1f-fea0-4343-9d8d-4ca0f78c1948", "tag": "c9a0326e-ae77-42a1-8db7-434146a99516"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:29.894345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-e3749f70-78bf-4654-a4aa-0fde543f2cec req-79de9d5c-524f-4c68-b6ed-425ec2c3577a service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:29.898416 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-e3749f70-78bf-4654-a4aa-0fde543f2cec req-79de9d5c-524f-4c68-b6ed-425ec2c3577a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:29.898884 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-e3749f70-78bf-4654-a4aa-0fde543f2cec req-79de9d5c-524f-4c68-b6ed-425ec2c3577a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:29.932394 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-e3749f70-78bf-4654-a4aa-0fde543f2cec req-79de9d5c-524f-4c68-b6ed-425ec2c3577a service nova] Creating event network-changed:c9a0326e-ae77-42a1-8db7-434146a99516 for instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 on n-h2-860863-1 Oct 10 18:51:29.947730 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-e3749f70-78bf-4654-a4aa-0fde543f2cec req-79de9d5c-524f-4c68-b6ed-425ec2c3577a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082716 Oct 10 18:51:29.950763 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 370/624] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:51:30.678240 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-829d8edf-a5ce-459c-83c3-1cabf7debb69 tempest-NetworksTest-1413418353 tempest-NetworksTest-1413418353-project-admin] Calling method '.version_select at 0x7f318e32ca60>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:30.748526 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-4719181c-ff8d-4fa7-880c-0fbd206024b2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Updating instance_info_cache with network_info: [{"id": "c9a0326e-ae77-42a1-8db7-434146a99516", "address": "fa:16:3e:7c:40:3e", "network": {"id": "c5f3fcff-69f9-404c-aeaa-2f1924041f8b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2042277977-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "38266e43742d4a9598d44340cac9bf92", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc9a0326e-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 18:51:30.826910 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4719181c-ff8d-4fa7-880c-0fbd206024b2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Releasing lock "refresh_cache-d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" {{(pid=127289) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 10 18:51:30.828096 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4719181c-ff8d-4fa7-880c-0fbd206024b2 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "POST /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948/action" status: 202 len: 0 microversion: 2.1 time: 3.738299 Oct 10 18:51:30.833454 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 255/625] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:51:27 2022] POST /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948/action => generated 0 bytes in 3744 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 10 18:51:30.843288 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f6067972-782e-400b-b1b5-141483b33f0f tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:30.844125 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f6067972-782e-400b-b1b5-141483b33f0f tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:30.852005 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6067972-782e-400b-b1b5-141483b33f0f tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:30.852926 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6067972-782e-400b-b1b5-141483b33f0f tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:30.854168 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6067972-782e-400b-b1b5-141483b33f0f tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:30.855614 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6067972-782e-400b-b1b5-141483b33f0f tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:30.866513 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6067972-782e-400b-b1b5-141483b33f0f tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:30.867087 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6067972-782e-400b-b1b5-141483b33f0f tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:30.905817 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-f6067972-782e-400b-b1b5-141483b33f0f tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] HTTP exception thrown: Instance ba31eefc-640b-41f5-8c00-a6d021cef3ca could not be found. Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f6067972-782e-400b-b1b5-141483b33f0f tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Request method failure captured: Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca HTTP/1.1 Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGlxNI1Tw5WgiRccZTiPVdjOZX1h_DUuR3h-4MeKt7Jxa0ya6rT4nQDPIqngeeVBXzAo3xkOK-1UQcE_E7HkNUcnxWryHcPT20Nid4bweyOC3EnQe-QNcwR4UvwBZswt2utrtqEahB6KH6xCWzCwG2lRCOVl-B8VyAsAOpMiMC_beIg Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 38266e43742d4a9598d44340cac9bf92 Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-312378003 Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_38266e43742d4a9598d44340cac9bf92", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/38266e43742d4a9598d44340cac9bf92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38266e43742d4a9598d44340cac9bf92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38266e43742d4a9598d44340cac9bf92"}]}] Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-312378003 Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 38266e43742d4a9598d44340cac9bf92 Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-312378003 Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-FloatingIPsAssociationTestJSON-312378003-project Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: fc8eaa5f3d6b44cfaff60781c3381e80 Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-312378003-project Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance ba31eefc-640b-41f5-8c00-a6d021cef3ca could not be found. Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'ba31eefc-640b-41f5-8c00-a6d021cef3ca'} Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba31eefc-640b-41f5-8c00-a6d021cef3ca could not be found. Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:51:30.907504 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:51:30.911722 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba31eefc-640b-41f5-8c00-a6d021cef3ca could not be found. Oct 10 18:51:30.911722 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:30.911722 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:30.911722 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:30.911722 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:30.911722 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:30.911722 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:30.911722 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:30.911722 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:30.911722 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba31eefc-640b-41f5-8c00-a6d021cef3ca could not be found. Oct 10 18:51:30.911722 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:30.911722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f6067972-782e-400b-b1b5-141483b33f0f tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Returning 404 to user: Instance ba31eefc-640b-41f5-8c00-a6d021cef3ca could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:30.911722 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f6067972-782e-400b-b1b5-141483b33f0f tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca" status: 404 len: 111 microversion: 2.1 time: 0.074196 Oct 10 18:51:30.911722 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 256/626] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:51:30 2022] DELETE /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:30.916593 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1951911448", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d421c9d3-8cd6-4578-8986-9488901306d0"}], "security_groups": [{"name": "tempest-securitygroup--1738875740"}], "key_name": "tempest-keypair-1689307306", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:31.115475 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] validate_networks() for [('d421c9d3-8cd6-4578-8986-9488901306d0', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:51:31.152120 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-829d8edf-a5ce-459c-83c3-1cabf7debb69 tempest-NetworksTest-1413418353 tempest-NetworksTest-1413418353-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks" status: 200 len: 4701 microversion: 2.1 time: 0.730123 Oct 10 18:51:31.153311 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 371/627] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:51:30 2022] GET /compute/v2.1/os-networks => generated 4701 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:51:31.160879 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7e4c1312-1af0-43ad-a066-fc56dadb9091 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:31.165748 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7e4c1312-1af0-43ad-a066-fc56dadb9091 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: ba31eefc-640b-41f5-8c00-a6d021cef3ca] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:31.175610 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e4c1312-1af0-43ad-a066-fc56dadb9091 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:31.176776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e4c1312-1af0-43ad-a066-fc56dadb9091 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:31.177364 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e4c1312-1af0-43ad-a066-fc56dadb9091 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:31.178357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e4c1312-1af0-43ad-a066-fc56dadb9091 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:31.178822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e4c1312-1af0-43ad-a066-fc56dadb9091 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:31.179457 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e4c1312-1af0-43ad-a066-fc56dadb9091 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:31.210662 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-7e4c1312-1af0-43ad-a066-fc56dadb9091 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] HTTP exception thrown: Instance ba31eefc-640b-41f5-8c00-a6d021cef3ca could not be found. Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7e4c1312-1af0-43ad-a066-fc56dadb9091 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Request method failure captured: Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca HTTP/1.1 Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGlxNI1Tw5WgiRccZTiPVdjOZX1h_DUuR3h-4MeKt7Jxa0ya6rT4nQDPIqngeeVBXzAo3xkOK-1UQcE_E7HkNUcnxWryHcPT20Nid4bweyOC3EnQe-QNcwR4UvwBZswt2utrtqEahB6KH6xCWzCwG2lRCOVl-B8VyAsAOpMiMC_beIg Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 38266e43742d4a9598d44340cac9bf92 Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-312378003 Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_38266e43742d4a9598d44340cac9bf92", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/38266e43742d4a9598d44340cac9bf92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38266e43742d4a9598d44340cac9bf92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38266e43742d4a9598d44340cac9bf92"}]}] Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-312378003 Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 38266e43742d4a9598d44340cac9bf92 Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-312378003 Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FloatingIPsAssociationTestJSON-312378003-project Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: fc8eaa5f3d6b44cfaff60781c3381e80 Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-312378003-project Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance ba31eefc-640b-41f5-8c00-a6d021cef3ca could not be found. Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'ba31eefc-640b-41f5-8c00-a6d021cef3ca'} Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba31eefc-640b-41f5-8c00-a6d021cef3ca could not be found. Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba31eefc-640b-41f5-8c00-a6d021cef3ca could not be found. Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:31.233321 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:31.241567 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:31.241567 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:31.241567 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:31.241567 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:31.241567 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:31.241567 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:31.241567 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba31eefc-640b-41f5-8c00-a6d021cef3ca could not be found. Oct 10 18:51:31.241567 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:51:31.241567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7e4c1312-1af0-43ad-a066-fc56dadb9091 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Returning 404 to user: Instance ba31eefc-640b-41f5-8c00-a6d021cef3ca could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:31.243438 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7e4c1312-1af0-43ad-a066-fc56dadb9091 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca" status: 404 len: 111 microversion: 2.1 time: 0.081851 Oct 10 18:51:31.246298 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 372/628] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:31 2022] GET /compute/v2.1/servers/ba31eefc-640b-41f5-8c00-a6d021cef3ca => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:31.259508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b6d936c2-6707-4add-be2d-892003078924 tempest-NetworksTest-1413418353 tempest-NetworksTest-1413418353-project-admin] Calling method '.version_select at 0x7f318e329a60>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:31.561923 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b6d936c2-6707-4add-be2d-892003078924 tempest-NetworksTest-1413418353 tempest-NetworksTest-1413418353-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks/f1d4af5b-71b6-463b-9712-d164bf8b9149" status: 200 len: 652 microversion: 2.1 time: 0.314305 Oct 10 18:51:31.562793 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 373/629] 10.222.0.43 () {58 vars in 1248 bytes} [Mon Oct 10 18:51:31 2022] GET /compute/v2.1/os-networks/f1d4af5b-71b6-463b-9712-d164bf8b9149 => generated 652 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:31.569004 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6d497b27-2d7c-4452-84ad-5fddad3384f8 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '.version_select at 0x7f318e31f550>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:31.858483 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Getting quotas for project f6ec8b0e87fd4e2c8d67076d2b8c797f. Resources: dict_keys(['metadata_items']) {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:31.863479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Getting quotas for user f9ec15e796424161be9af968e6167528 and project f6ec8b0e87fd4e2c8d67076d2b8c797f. Resources: dict_keys(['metadata_items']) {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:31.876682 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:51:31.877315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:51:31.877997 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:51:31.878756 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:51:31.879399 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:51:31.890067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:31.891047 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:31.891909 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:31.893264 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:31.894181 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:31.894869 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:31.915990 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Getting quotas for project f6ec8b0e87fd4e2c8d67076d2b8c797f. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:31.920140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Getting quotas for user f9ec15e796424161be9af968e6167528 and project f6ec8b0e87fd4e2c8d67076d2b8c797f. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:31.937496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:51:31.945571 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:51:32.060474 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-339b7852-cfd0-47f7-a475-097160d13ecf tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.149927 Oct 10 18:51:32.061484 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 257/630] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:51:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:51:32.067068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-15a04d54-281b-4809-b08a-7b3c67e59f35 tempest-NetworksTest-1413418353 tempest-NetworksTest-1413418353-project-admin] Calling method '.version_select at 0x7f318e44bc10>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:32.331598 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-15a04d54-281b-4809-b08a-7b3c67e59f35 tempest-NetworksTest-1413418353 tempest-NetworksTest-1413418353-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks" status: 200 len: 5384 microversion: 2.1 time: 0.268251 Oct 10 18:51:32.333013 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 258/631] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:51:32 2022] GET /compute/v2.1/os-networks => generated 5384 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:32.339590 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d67ba118-71fa-4277-ad3e-dd6e42cf7314 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:32.340831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d67ba118-71fa-4277-ad3e-dd6e42cf7314 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:32.458012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d67ba118-71fa-4277-ad3e-dd6e42cf7314 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:32.469706 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d67ba118-71fa-4277-ad3e-dd6e42cf7314 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1278 microversion: 2.1 time: 0.134546 Oct 10 18:51:32.471274 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 259/632] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:32 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1278 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:32.982217 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6d497b27-2d7c-4452-84ad-5fddad3384f8 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/5ed10bc8-271e-4853-a929-1f3d54688200" status: 202 len: 0 microversion: 2.1 time: 1.418227 Oct 10 18:51:32.983362 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 374/633] 10.222.0.43 () {58 vars in 1263 bytes} [Mon Oct 10 18:51:31 2022] DELETE /compute/v2.1/os-floating-ips/5ed10bc8-271e-4853-a929-1f3d54688200 => generated 0 bytes in 1420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:51:32.992979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-07331826-2186-49cc-bad4-541c51931fae tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:32.993555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-07331826-2186-49cc-bad4-541c51931fae tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:33.001011 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07331826-2186-49cc-bad4-541c51931fae tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:33.001732 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07331826-2186-49cc-bad4-541c51931fae tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:33.002332 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07331826-2186-49cc-bad4-541c51931fae tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:33.003874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07331826-2186-49cc-bad4-541c51931fae tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:33.004587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07331826-2186-49cc-bad4-541c51931fae tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:33.005213 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07331826-2186-49cc-bad4-541c51931fae tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:33.042189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-07331826-2186-49cc-bad4-541c51931fae tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:51:33.496844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5944cf32-7cb6-4664-bdc3-febcba670534 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:33.497733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5944cf32-7cb6-4664-bdc3-febcba670534 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:33.542447 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-07331826-2186-49cc-bad4-541c51931fae tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 204 len: 0 microversion: 2.1 time: 0.551025 Oct 10 18:51:33.544146 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 260/634] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:51:32 2022] DELETE /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:51:33.570017 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-de2b7d89-2e62-4947-8eb0-adb2209c4016 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:33.571762 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-de2b7d89-2e62-4947-8eb0-adb2209c4016 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:33.586318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-de2b7d89-2e62-4947-8eb0-adb2209c4016 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:33.591274 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-de2b7d89-2e62-4947-8eb0-adb2209c4016 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:33.594074 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-de2b7d89-2e62-4947-8eb0-adb2209c4016 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:33.597651 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-de2b7d89-2e62-4947-8eb0-adb2209c4016 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:33.597651 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-de2b7d89-2e62-4947-8eb0-adb2209c4016 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:33.601154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-de2b7d89-2e62-4947-8eb0-adb2209c4016 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:33.612447 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5944cf32-7cb6-4664-bdc3-febcba670534 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:33.620292 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5944cf32-7cb6-4664-bdc3-febcba670534 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1278 microversion: 2.1 time: 0.130258 Oct 10 18:51:33.621212 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 375/635] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:33 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1278 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:34.012147 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-de2b7d89-2e62-4947-8eb0-adb2209c4016 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:34.020953 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-de2b7d89-2e62-4947-8eb0-adb2209c4016 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1526 microversion: 2.1 time: 0.464901 Oct 10 18:51:34.021543 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 261/636] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:33 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1526 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:34.655975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f20f3c73-eea0-43c4-b4df-a35083d2bd03 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:34.657179 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f20f3c73-eea0-43c4-b4df-a35083d2bd03 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:34.663210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f20f3c73-eea0-43c4-b4df-a35083d2bd03 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:34.664824 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f20f3c73-eea0-43c4-b4df-a35083d2bd03 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:34.664824 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f20f3c73-eea0-43c4-b4df-a35083d2bd03 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:34.665364 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f20f3c73-eea0-43c4-b4df-a35083d2bd03 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:34.666519 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f20f3c73-eea0-43c4-b4df-a35083d2bd03 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:34.667137 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f20f3c73-eea0-43c4-b4df-a35083d2bd03 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:34.770256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f20f3c73-eea0-43c4-b4df-a35083d2bd03 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:34.780998 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f20f3c73-eea0-43c4-b4df-a35083d2bd03 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1330 microversion: 2.1 time: 0.130793 Oct 10 18:51:34.781585 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 376/637] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:34 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1330 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:35.047645 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2a8aebb7-f6b3-4338-97d6-233d8968f604 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:35.048576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2a8aebb7-f6b3-4338-97d6-233d8968f604 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:35.057823 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2a8aebb7-f6b3-4338-97d6-233d8968f604 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:35.058316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2a8aebb7-f6b3-4338-97d6-233d8968f604 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:35.058752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2a8aebb7-f6b3-4338-97d6-233d8968f604 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:35.062669 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2a8aebb7-f6b3-4338-97d6-233d8968f604 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:35.068673 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2a8aebb7-f6b3-4338-97d6-233d8968f604 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:35.068673 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2a8aebb7-f6b3-4338-97d6-233d8968f604 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:35.805257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1d0ada39-7f7c-40aa-b83f-6805c6309180 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:35.813802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1d0ada39-7f7c-40aa-b83f-6805c6309180 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:35.819126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d0ada39-7f7c-40aa-b83f-6805c6309180 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:35.820585 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d0ada39-7f7c-40aa-b83f-6805c6309180 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:35.821838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d0ada39-7f7c-40aa-b83f-6805c6309180 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:35.824848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d0ada39-7f7c-40aa-b83f-6805c6309180 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:35.827244 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d0ada39-7f7c-40aa-b83f-6805c6309180 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:35.827875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d0ada39-7f7c-40aa-b83f-6805c6309180 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:36.027604 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1d0ada39-7f7c-40aa-b83f-6805c6309180 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:36.050984 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1d0ada39-7f7c-40aa-b83f-6805c6309180 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1336 microversion: 2.1 time: 0.249110 Oct 10 18:51:36.052371 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 377/638] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:35 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1336 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:36.063886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-8728f78e-242f-497a-a311-408885e2cc87 req-73660389-c107-4da6-99f5-42292955ab99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0af7e1f-fea0-4343-9d8d-4ca0f78c1948", "name": "network-vif-deleted", "tag": "c9a0326e-ae77-42a1-8db7-434146a99516"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:36.084452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8728f78e-242f-497a-a311-408885e2cc87 req-73660389-c107-4da6-99f5-42292955ab99 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:36.086397 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8728f78e-242f-497a-a311-408885e2cc87 req-73660389-c107-4da6-99f5-42292955ab99 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:36.088196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8728f78e-242f-497a-a311-408885e2cc87 req-73660389-c107-4da6-99f5-42292955ab99 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:36.113776 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-8728f78e-242f-497a-a311-408885e2cc87 req-73660389-c107-4da6-99f5-42292955ab99 service nova] Creating event network-vif-deleted:c9a0326e-ae77-42a1-8db7-434146a99516 for instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 on n-h2-860863-1 Oct 10 18:51:36.126918 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-8728f78e-242f-497a-a311-408885e2cc87 req-73660389-c107-4da6-99f5-42292955ab99 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071684 Oct 10 18:51:36.129659 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 378/639] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:36.143134 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2a8aebb7-f6b3-4338-97d6-233d8968f604 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:36.173754 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2a8aebb7-f6b3-4338-97d6-233d8968f604 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1526 microversion: 2.1 time: 1.123218 Oct 10 18:51:36.178666 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 262/640] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:35 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1526 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:37.076313 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-09cabcb5-fed6-4f55-89d8-32aae6dcd1f5 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:37.076934 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-09cabcb5-fed6-4f55-89d8-32aae6dcd1f5 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:37.084690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-09cabcb5-fed6-4f55-89d8-32aae6dcd1f5 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:37.085492 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-09cabcb5-fed6-4f55-89d8-32aae6dcd1f5 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:37.086130 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-09cabcb5-fed6-4f55-89d8-32aae6dcd1f5 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:37.087163 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-09cabcb5-fed6-4f55-89d8-32aae6dcd1f5 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:37.088599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-09cabcb5-fed6-4f55-89d8-32aae6dcd1f5 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:37.089228 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-09cabcb5-fed6-4f55-89d8-32aae6dcd1f5 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:37.202877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3fe75f52-ad2f-4d07-8bcc-6d3f79d9fda3 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:37.203496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3fe75f52-ad2f-4d07-8bcc-6d3f79d9fda3 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:37.211039 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe75f52-ad2f-4d07-8bcc-6d3f79d9fda3 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:37.213875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-09cabcb5-fed6-4f55-89d8-32aae6dcd1f5 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:37.214112 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe75f52-ad2f-4d07-8bcc-6d3f79d9fda3 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:37.215199 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe75f52-ad2f-4d07-8bcc-6d3f79d9fda3 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:37.216971 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe75f52-ad2f-4d07-8bcc-6d3f79d9fda3 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:37.218077 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe75f52-ad2f-4d07-8bcc-6d3f79d9fda3 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:37.220060 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe75f52-ad2f-4d07-8bcc-6d3f79d9fda3 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:37.225103 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-09cabcb5-fed6-4f55-89d8-32aae6dcd1f5 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1336 microversion: 2.1 time: 0.153600 Oct 10 18:51:37.230915 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 379/641] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:37 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1336 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:37.310640 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe75f52-ad2f-4d07-8bcc-6d3f79d9fda3 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:37.311543 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe75f52-ad2f-4d07-8bcc-6d3f79d9fda3 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:37.314265 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe75f52-ad2f-4d07-8bcc-6d3f79d9fda3 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:37.315093 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-3fe75f52-ad2f-4d07-8bcc-6d3f79d9fda3 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lazy-loading 'fault' on Instance uuid d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:51:37.391264 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3fe75f52-ad2f-4d07-8bcc-6d3f79d9fda3 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8eaa5f3d6b44cfaff60781c3381e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38266e43742d4a9598d44340cac9bf92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:37.402419 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3fe75f52-ad2f-4d07-8bcc-6d3f79d9fda3 tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 200 len: 1313 microversion: 2.1 time: 0.202674 Oct 10 18:51:37.420872 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 263/642] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:37 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:38.149670 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-80c4ae29-afa2-421f-a09c-d58662e67132 tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Calling method '.version_select at 0x7f318e342310>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:38.151877 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80c4ae29-afa2-421f-a09c-d58662e67132 tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:38.152359 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80c4ae29-afa2-421f-a09c-d58662e67132 tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:38.153689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80c4ae29-afa2-421f-a09c-d58662e67132 tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:38.183982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80c4ae29-afa2-421f-a09c-d58662e67132 tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:38.188307 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80c4ae29-afa2-421f-a09c-d58662e67132 tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:38.194963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80c4ae29-afa2-421f-a09c-d58662e67132 tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:38.215721 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80c4ae29-afa2-421f-a09c-d58662e67132 tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:38.216365 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80c4ae29-afa2-421f-a09c-d58662e67132 tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:38.218646 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80c4ae29-afa2-421f-a09c-d58662e67132 tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:38.232886 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-80c4ae29-afa2-421f-a09c-d58662e67132 tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.454153 Oct 10 18:51:38.242394 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 380/643] 10.222.0.43 () {60 vars in 1187 bytes} [Mon Oct 10 18:51:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:51:38.249203 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bc9bed47-98e0-4a74-9ce5-f42a708dbc4a tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Calling method '.version_select at 0x7f318e44b3a0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:38.251469 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc9bed47-98e0-4a74-9ce5-f42a708dbc4a tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:38.251892 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0132aa9d-f0bd-451f-88e6-3fbbc5893eeb tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:38.252359 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc9bed47-98e0-4a74-9ce5-f42a708dbc4a tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:38.252936 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0132aa9d-f0bd-451f-88e6-3fbbc5893eeb tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:38.253059 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc9bed47-98e0-4a74-9ce5-f42a708dbc4a tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:38.260408 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0132aa9d-f0bd-451f-88e6-3fbbc5893eeb tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:38.261168 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0132aa9d-f0bd-451f-88e6-3fbbc5893eeb tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:38.261758 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0132aa9d-f0bd-451f-88e6-3fbbc5893eeb tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:38.262633 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0132aa9d-f0bd-451f-88e6-3fbbc5893eeb tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:38.263246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0132aa9d-f0bd-451f-88e6-3fbbc5893eeb tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:38.263822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0132aa9d-f0bd-451f-88e6-3fbbc5893eeb tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:38.282374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:38.301161 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc9bed47-98e0-4a74-9ce5-f42a708dbc4a tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:38.302028 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc9bed47-98e0-4a74-9ce5-f42a708dbc4a tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:38.302488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc9bed47-98e0-4a74-9ce5-f42a708dbc4a tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:38.320733 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bc9bed47-98e0-4a74-9ce5-f42a708dbc4a tempest-HypervisorAdminV228Test-2061850522 tempest-HypervisorAdminV228Test-2061850522-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.077691 Oct 10 18:51:38.323075 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 264/644] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Oct 10 18:51:38 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 18:51:38.426804 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a1052a4b-b91d-4f8c-831a-8cd48ba4342c tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:38.427431 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a1052a4b-b91d-4f8c-831a-8cd48ba4342c tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] [instance: d0af7e1f-fea0-4343-9d8d-4ca0f78c1948] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:38.438427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1052a4b-b91d-4f8c-831a-8cd48ba4342c tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:38.442025 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1052a4b-b91d-4f8c-831a-8cd48ba4342c tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:38.442268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0132aa9d-f0bd-451f-88e6-3fbbc5893eeb tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:38.442512 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1052a4b-b91d-4f8c-831a-8cd48ba4342c tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:38.443191 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1052a4b-b91d-4f8c-831a-8cd48ba4342c tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:38.444224 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1052a4b-b91d-4f8c-831a-8cd48ba4342c tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:38.446585 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1052a4b-b91d-4f8c-831a-8cd48ba4342c tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:38.454627 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0132aa9d-f0bd-451f-88e6-3fbbc5893eeb tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1404 microversion: 2.1 time: 0.207287 Oct 10 18:51:38.458278 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 381/645] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:38 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1404 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:51:38.493266 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-a1052a4b-b91d-4f8c-831a-8cd48ba4342c tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] HTTP exception thrown: Instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 could not be found. Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a1052a4b-b91d-4f8c-831a-8cd48ba4342c tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Request method failure captured: Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 HTTP/1.1 Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGlxNI1Tw5WgiRccZTiPVdjOZX1h_DUuR3h-4MeKt7Jxa0ya6rT4nQDPIqngeeVBXzAo3xkOK-1UQcE_E7HkNUcnxWryHcPT20Nid4bweyOC3EnQe-QNcwR4UvwBZswt2utrtqEahB6KH6xCWzCwG2lRCOVl-B8VyAsAOpMiMC_beIg Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 38266e43742d4a9598d44340cac9bf92 Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-312378003 Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_38266e43742d4a9598d44340cac9bf92", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/38266e43742d4a9598d44340cac9bf92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38266e43742d4a9598d44340cac9bf92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/38266e43742d4a9598d44340cac9bf92"}]}] Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-312378003 Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 38266e43742d4a9598d44340cac9bf92 Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-312378003 Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-FloatingIPsAssociationTestJSON-312378003-project Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: fc8eaa5f3d6b44cfaff60781c3381e80 Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-312378003-project Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 could not be found. Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'd0af7e1f-fea0-4343-9d8d-4ca0f78c1948'} Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 could not be found. Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 could not be found. Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:38.493681 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:51:38.498277 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:38.498277 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:51:38.498277 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:51:38.498277 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:51:38.498277 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:51:38.498277 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:51:38.498277 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 could not be found. Oct 10 18:51:38.498277 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:51:38.498277 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a1052a4b-b91d-4f8c-831a-8cd48ba4342c tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] Returning 404 to user: Instance d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:51:38.498277 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a1052a4b-b91d-4f8c-831a-8cd48ba4342c tempest-FloatingIPsAssociationTestJSON-312378003 tempest-FloatingIPsAssociationTestJSON-312378003-project] 10.222.0.43 "GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948" status: 404 len: 111 microversion: 2.1 time: 0.075873 Oct 10 18:51:38.499028 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 265/646] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:38 2022] GET /compute/v2.1/servers/d0af7e1f-fea0-4343-9d8d-4ca0f78c1948 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:51:38.852683 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=12 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:39.318889 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4a1061cf-f28a-4606-b397-63e9fcf40c77 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Calling method '.version_select at 0x7f318e342ee0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:39.322436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a1061cf-f28a-4606-b397-63e9fcf40c77 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.325945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a1061cf-f28a-4606-b397-63e9fcf40c77 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.326873 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a1061cf-f28a-4606-b397-63e9fcf40c77 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:39.359805 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a1061cf-f28a-4606-b397-63e9fcf40c77 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.360725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a1061cf-f28a-4606-b397-63e9fcf40c77 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.361458 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a1061cf-f28a-4606-b397-63e9fcf40c77 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:39.377557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a1061cf-f28a-4606-b397-63e9fcf40c77 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.378222 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a1061cf-f28a-4606-b397-63e9fcf40c77 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.378815 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a1061cf-f28a-4606-b397-63e9fcf40c77 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:39.390409 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4a1061cf-f28a-4606-b397-63e9fcf40c77 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.756125 Oct 10 18:51:39.405159 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1dbc2698-9fc4-4a84-9f96-98f0d75b48ad tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Calling method '.version_select at 0x7f318e45ff70>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:39.405972 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 382/647] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:39.407043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1dbc2698-9fc4-4a84-9f96-98f0d75b48ad tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.407531 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1dbc2698-9fc4-4a84-9f96-98f0d75b48ad tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.407974 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1dbc2698-9fc4-4a84-9f96-98f0d75b48ad tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:39.464764 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1dbc2698-9fc4-4a84-9f96-98f0d75b48ad tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.465535 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1dbc2698-9fc4-4a84-9f96-98f0d75b48ad tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.467807 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1dbc2698-9fc4-4a84-9f96-98f0d75b48ad tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:39.480851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c38987e3-33d5-4ed6-9f9c-f1288139cd4c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:39.481574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c38987e3-33d5-4ed6-9f9c-f1288139cd4c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:39.501099 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c38987e3-33d5-4ed6-9f9c-f1288139cd4c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.501594 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c38987e3-33d5-4ed6-9f9c-f1288139cd4c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.511587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c38987e3-33d5-4ed6-9f9c-f1288139cd4c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:39.512419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c38987e3-33d5-4ed6-9f9c-f1288139cd4c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.512940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c38987e3-33d5-4ed6-9f9c-f1288139cd4c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.513376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c38987e3-33d5-4ed6-9f9c-f1288139cd4c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:39.540310 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1dbc2698-9fc4-4a84-9f96-98f0d75b48ad tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.556270 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1dbc2698-9fc4-4a84-9f96-98f0d75b48ad tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.556790 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1dbc2698-9fc4-4a84-9f96-98f0d75b48ad tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:39.585660 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1dbc2698-9fc4-4a84-9f96-98f0d75b48ad tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.186535 Oct 10 18:51:39.605568 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 266/648] 10.222.0.43 () {58 vars in 1167 bytes} [Mon Oct 10 18:51:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:39.622086 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a2602fc4-5201-4abe-ba7a-1bfdf85e1956 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Calling method '.version_select at 0x7f318e5f7040>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:39.646379 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2602fc4-5201-4abe-ba7a-1bfdf85e1956 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.658714 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2602fc4-5201-4abe-ba7a-1bfdf85e1956 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.660506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2602fc4-5201-4abe-ba7a-1bfdf85e1956 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:39.747835 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2602fc4-5201-4abe-ba7a-1bfdf85e1956 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.747835 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2602fc4-5201-4abe-ba7a-1bfdf85e1956 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.747835 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2602fc4-5201-4abe-ba7a-1bfdf85e1956 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:39.799177 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2602fc4-5201-4abe-ba7a-1bfdf85e1956 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.799685 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2602fc4-5201-4abe-ba7a-1bfdf85e1956 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.802220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a2602fc4-5201-4abe-ba7a-1bfdf85e1956 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:39.847500 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a2602fc4-5201-4abe-ba7a-1bfdf85e1956 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.237063 Oct 10 18:51:39.852274 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 267/649] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:39.865706 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-969e2786-c854-4085-8e60-56d9cb6f0aaa tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Calling method '.version_select at 0x7f318e45f280>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:39.870563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-969e2786-c854-4085-8e60-56d9cb6f0aaa tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.870563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-969e2786-c854-4085-8e60-56d9cb6f0aaa tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.870563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-969e2786-c854-4085-8e60-56d9cb6f0aaa tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:39.884017 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-969e2786-c854-4085-8e60-56d9cb6f0aaa tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.885072 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-969e2786-c854-4085-8e60-56d9cb6f0aaa tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.885559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-969e2786-c854-4085-8e60-56d9cb6f0aaa tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:39.895355 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-969e2786-c854-4085-8e60-56d9cb6f0aaa tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.033548 Oct 10 18:51:39.896295 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 268/650] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:51:39 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:39.913135 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b287a854-d597-401a-854c-119c311fddba tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Calling method '.version_select at 0x7f318e61a790>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:39.919520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b287a854-d597-401a-854c-119c311fddba tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.920078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b287a854-d597-401a-854c-119c311fddba tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.920650 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b287a854-d597-401a-854c-119c311fddba tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:39.964329 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b287a854-d597-401a-854c-119c311fddba tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.055689 Oct 10 18:51:39.964964 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 269/651] 10.222.0.43 () {58 vars in 1179 bytes} [Mon Oct 10 18:51:39 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:39.985135 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3001976b-cfeb-4e70-8b2d-9f6620010d14 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Calling method '.version_select at 0x7f318e61a820>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:39.988640 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3001976b-cfeb-4e70-8b2d-9f6620010d14 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:39.990950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3001976b-cfeb-4e70-8b2d-9f6620010d14 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:39.992337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3001976b-cfeb-4e70-8b2d-9f6620010d14 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:40.022384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3001976b-cfeb-4e70-8b2d-9f6620010d14 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:40.022932 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3001976b-cfeb-4e70-8b2d-9f6620010d14 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:40.023373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3001976b-cfeb-4e70-8b2d-9f6620010d14 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:40.037907 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3001976b-cfeb-4e70-8b2d-9f6620010d14 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:40.038399 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3001976b-cfeb-4e70-8b2d-9f6620010d14 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:40.038835 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3001976b-cfeb-4e70-8b2d-9f6620010d14 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:40.042445 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:40.047464 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3001976b-cfeb-4e70-8b2d-9f6620010d14 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.070449 Oct 10 18:51:40.049985 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 270/652] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:51:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:40.436449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-641322957", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:40.478656 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c38987e3-33d5-4ed6-9f9c-f1288139cd4c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:40.495867 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c38987e3-33d5-4ed6-9f9c-f1288139cd4c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1404 microversion: 2.1 time: 1.020367 Oct 10 18:51:40.496828 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 383/653] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:39 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1404 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:51:40.511086 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a671a149-66f3-4494-9236-be723d3ee594 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Calling method '.version_select at 0x7f318e329dc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:40.512991 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a671a149-66f3-4494-9236-be723d3ee594 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:40.513472 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a671a149-66f3-4494-9236-be723d3ee594 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:40.513899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a671a149-66f3-4494-9236-be723d3ee594 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:40.540745 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a671a149-66f3-4494-9236-be723d3ee594 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:40.547662 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a671a149-66f3-4494-9236-be723d3ee594 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:40.548397 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] validate_networks() for None {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:51:40.555096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a671a149-66f3-4494-9236-be723d3ee594 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:40.563697 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a671a149-66f3-4494-9236-be723d3ee594 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.065811 Oct 10 18:51:40.564306 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 384/654] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:51:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:40.577217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-62065c37-d655-4821-a3ca-6b835b3a4522 req-3db6dfc7-a674-478a-aef6-79d37f55978a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6283d5d-8892-4104-8a03-572870613047", "tag": "034630fa-5e8e-45c4-a128-ff0de6f706b1"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:40.587250 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-62065c37-d655-4821-a3ca-6b835b3a4522 req-3db6dfc7-a674-478a-aef6-79d37f55978a service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:40.599181 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-62065c37-d655-4821-a3ca-6b835b3a4522 req-3db6dfc7-a674-478a-aef6-79d37f55978a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:40.601046 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-62065c37-d655-4821-a3ca-6b835b3a4522 req-3db6dfc7-a674-478a-aef6-79d37f55978a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:40.623016 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-62065c37-d655-4821-a3ca-6b835b3a4522 req-3db6dfc7-a674-478a-aef6-79d37f55978a service nova] Creating event network-changed:034630fa-5e8e-45c4-a128-ff0de6f706b1 for instance d6283d5d-8892-4104-8a03-572870613047 on n-h1-860863-1 Oct 10 18:51:40.631883 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-62065c37-d655-4821-a3ca-6b835b3a4522 req-3db6dfc7-a674-478a-aef6-79d37f55978a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063006 Oct 10 18:51:40.632742 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 385/655] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:40.640902 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3e10de0a-f39b-47be-b07d-9d53a4a68089 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Calling method '.version_select at 0x7f318e51bdc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:40.643048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e10de0a-f39b-47be-b07d-9d53a4a68089 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:40.643735 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e10de0a-f39b-47be-b07d-9d53a4a68089 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:40.644380 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e10de0a-f39b-47be-b07d-9d53a4a68089 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:40.660110 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e10de0a-f39b-47be-b07d-9d53a4a68089 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:40.660858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e10de0a-f39b-47be-b07d-9d53a4a68089 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:40.661515 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e10de0a-f39b-47be-b07d-9d53a4a68089 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:40.669791 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3e10de0a-f39b-47be-b07d-9d53a4a68089 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.035546 Oct 10 18:51:40.671083 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 386/656] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 18:51:40 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:40.686196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9ddaecd3-91d4-4fc7-a17f-88e2013601d0 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Calling method '.version_select at 0x7f318e31fc10>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:40.692844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ddaecd3-91d4-4fc7-a17f-88e2013601d0 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:40.692844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ddaecd3-91d4-4fc7-a17f-88e2013601d0 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:40.692844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ddaecd3-91d4-4fc7-a17f-88e2013601d0 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:40.703162 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ddaecd3-91d4-4fc7-a17f-88e2013601d0 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:40.704018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ddaecd3-91d4-4fc7-a17f-88e2013601d0 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:40.704678 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ddaecd3-91d4-4fc7-a17f-88e2013601d0 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:40.718894 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ddaecd3-91d4-4fc7-a17f-88e2013601d0 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:40.719563 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ddaecd3-91d4-4fc7-a17f-88e2013601d0 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:40.720146 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ddaecd3-91d4-4fc7-a17f-88e2013601d0 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:40.754441 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9ddaecd3-91d4-4fc7-a17f-88e2013601d0 tempest-HypervisorAdminTestJSON-622406006 tempest-HypervisorAdminTestJSON-622406006-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.072733 Oct 10 18:51:40.755815 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 387/657] 10.222.0.43 () {58 vars in 1173 bytes} [Mon Oct 10 18:51:40 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:41.530705 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cf86ceaa-06ce-4b73-a2c2-beaaeb3389a3 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:41.531516 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cf86ceaa-06ce-4b73-a2c2-beaaeb3389a3 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:41.550903 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cf86ceaa-06ce-4b73-a2c2-beaaeb3389a3 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:41.557611 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cf86ceaa-06ce-4b73-a2c2-beaaeb3389a3 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:41.558166 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cf86ceaa-06ce-4b73-a2c2-beaaeb3389a3 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:41.558924 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cf86ceaa-06ce-4b73-a2c2-beaaeb3389a3 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:41.559385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cf86ceaa-06ce-4b73-a2c2-beaaeb3389a3 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:41.559805 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cf86ceaa-06ce-4b73-a2c2-beaaeb3389a3 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:41.629352 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:51:41.629941 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:51:41.630704 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:51:41.631335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:51:41.631925 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:51:41.655599 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:41.656231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:41.657484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:41.659717 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:41.661186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:41.662866 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:41.730805 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:41.736222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:41.772378 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:51:41.779574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:51:41.994482 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-91e8563e-91a6-4a93-97bd-a2d16b1120b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.942850 Oct 10 18:51:42.008260 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 271/658] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:51:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:51:42.295413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cf86ceaa-06ce-4b73-a2c2-beaaeb3389a3 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:42.303244 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cf86ceaa-06ce-4b73-a2c2-beaaeb3389a3 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1404 microversion: 2.1 time: 0.782923 Oct 10 18:51:42.304150 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 388/659] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:41 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1404 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:42.323619 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ac0216fb-3ba3-4a48-b166-740b4e8f98fe tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:42.324249 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ac0216fb-3ba3-4a48-b166-740b4e8f98fe tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:42.326346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:42.399546 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ac0216fb-3ba3-4a48-b166-740b4e8f98fe tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:42.407266 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=39 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:42.409933 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ac0216fb-3ba3-4a48-b166-740b4e8f98fe tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1216 microversion: 2.1 time: 0.104742 Oct 10 18:51:42.411122 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 389/660] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:42 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1216 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:42.567199 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-78178ab9-015d-4c08-96aa-febd1d6404dd tempest-QuotaClassesAdmin257Test-896577707 tempest-QuotaClassesAdmin257Test-896577707-project-admin] Calling method '.version_select at 0x7f318e359550>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:42.591301 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-78178ab9-015d-4c08-96aa-febd1d6404dd tempest-QuotaClassesAdmin257Test-896577707 tempest-QuotaClassesAdmin257Test-896577707-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.579728 Oct 10 18:51:42.598670 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 272/661] 10.222.0.43 () {60 vars in 1226 bytes} [Mon Oct 10 18:51:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:51:42.605173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-95fbb422-be72-48e7-8567-92d4203847ff tempest-QuotaClassesAdmin257Test-896577707 tempest-QuotaClassesAdmin257Test-896577707-project-admin] Action: 'update', calling method: .version_select at 0x7f318e2f5160>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:43.388941 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d16c33a7-63a5-4e63-820a-5e66168fcdaf tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'create', calling method: .version_select at 0x7f318e61a430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1559325330", "description": "tempest-description-1681048621"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:43.451277 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-95fbb422-be72-48e7-8567-92d4203847ff tempest-QuotaClassesAdmin257Test-896577707 tempest-QuotaClassesAdmin257Test-896577707-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.851368 Oct 10 18:51:43.466629 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 390/662] 10.222.0.43 () {62 vars in 1247 bytes} [Mon Oct 10 18:51:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:51:43.489070 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-69dd8ca7-c218-4242-9619-bbf4b4a9c3f4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:43.489691 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-69dd8ca7-c218-4242-9619-bbf4b4a9c3f4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:43.513363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-69dd8ca7-c218-4242-9619-bbf4b4a9c3f4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:43.513948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-69dd8ca7-c218-4242-9619-bbf4b4a9c3f4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:43.515590 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-69dd8ca7-c218-4242-9619-bbf4b4a9c3f4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:43.516942 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-69dd8ca7-c218-4242-9619-bbf4b4a9c3f4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:43.517507 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-69dd8ca7-c218-4242-9619-bbf4b4a9c3f4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:43.518011 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-69dd8ca7-c218-4242-9619-bbf4b4a9c3f4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:43.743936 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-69dd8ca7-c218-4242-9619-bbf4b4a9c3f4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:43.767476 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-69dd8ca7-c218-4242-9619-bbf4b4a9c3f4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1404 microversion: 2.1 time: 0.298768 Oct 10 18:51:43.774566 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 391/663] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:43 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1404 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:43.781849 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2340d9c6-945e-4eac-9620-18da7fd10d87 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:43.782879 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2340d9c6-945e-4eac-9620-18da7fd10d87 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:43.986975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2340d9c6-945e-4eac-9620-18da7fd10d87 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:44.000929 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2340d9c6-945e-4eac-9620-18da7fd10d87 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1216 microversion: 2.1 time: 0.219578 Oct 10 18:51:44.014815 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 392/664] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:43 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1216 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:44.028503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-80e51257-7ca2-4ad6-be54-1beddcb57090 tempest-QuotaClassesAdmin257Test-896577707 tempest-QuotaClassesAdmin257Test-896577707-project-admin] Calling method '.version_select at 0x7f318e2bef70>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:44.061639 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-80e51257-7ca2-4ad6-be54-1beddcb57090 tempest-QuotaClassesAdmin257Test-896577707 tempest-QuotaClassesAdmin257Test-896577707-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.045141 Oct 10 18:51:44.063877 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 393/665] 10.222.0.43 () {60 vars in 1226 bytes} [Mon Oct 10 18:51:44 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:51:44.077502 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2707d408-580f-4e3e-8f49-234fb851e00e tempest-QuotaClassesAdmin257Test-896577707 tempest-QuotaClassesAdmin257Test-896577707-project-admin] Action: 'update', calling method: .version_select at 0x7f318e2be670>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:44.085269 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d16c33a7-63a5-4e63-820a-5e66168fcdaf tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.077287 Oct 10 18:51:44.088206 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 273/666] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:51:43 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:44.102371 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d0aba619-a481-40c4-867e-8102acf81dd9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'create', calling method: .version_select at 0x7f318e6745e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1963219363", "description": "tempest-description-1740498031"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:44.695964 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d0aba619-a481-40c4-867e-8102acf81dd9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.597756 Oct 10 18:51:44.697678 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 274/667] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:51:44 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:44.797851 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5c43abd7-845a-4a79-8d91-d787f1338127 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:44.799212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5c43abd7-845a-4a79-8d91-d787f1338127 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:44.821586 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c43abd7-845a-4a79-8d91-d787f1338127 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:44.821586 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c43abd7-845a-4a79-8d91-d787f1338127 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:44.821586 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c43abd7-845a-4a79-8d91-d787f1338127 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:44.829270 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c43abd7-845a-4a79-8d91-d787f1338127 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:44.829776 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c43abd7-845a-4a79-8d91-d787f1338127 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:44.830217 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c43abd7-845a-4a79-8d91-d787f1338127 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:44.910562 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2707d408-580f-4e3e-8f49-234fb851e00e tempest-QuotaClassesAdmin257Test-896577707 tempest-QuotaClassesAdmin257Test-896577707-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.839907 Oct 10 18:51:44.912066 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 394/668] 10.222.0.43 () {62 vars in 1247 bytes} [Mon Oct 10 18:51:44 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 18:51:44.932432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1758423788", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "5bd04591-f6d1-4416-be97-f74846413e3e"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:44.999556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] validate_networks() for [('5bd04591-f6d1-4416-be97-f74846413e3e', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:51:45.022105 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5c43abd7-845a-4a79-8d91-d787f1338127 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:45.035234 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5c43abd7-845a-4a79-8d91-d787f1338127 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1404 microversion: 2.1 time: 0.243358 Oct 10 18:51:45.037055 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 275/669] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:44 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1404 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:45.043240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5c76ac6e-9820-4591-a783-667b50e49b88 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:45.044253 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5c76ac6e-9820-4591-a783-667b50e49b88 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:45.050999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c76ac6e-9820-4591-a783-667b50e49b88 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:45.051909 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c76ac6e-9820-4591-a783-667b50e49b88 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:45.052723 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c76ac6e-9820-4591-a783-667b50e49b88 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:45.054064 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c76ac6e-9820-4591-a783-667b50e49b88 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:45.054736 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c76ac6e-9820-4591-a783-667b50e49b88 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:45.057410 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5c76ac6e-9820-4591-a783-667b50e49b88 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:45.153786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5c76ac6e-9820-4591-a783-667b50e49b88 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:45.165738 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5c76ac6e-9820-4591-a783-667b50e49b88 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1268 microversion: 2.1 time: 0.127162 Oct 10 18:51:45.167313 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 276/670] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:45 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1268 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:45.647844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:51:45.647844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:51:45.647844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:51:45.647844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:51:45.648914 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:51:45.672231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:45.676621 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:45.677488 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:45.678271 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:45.678729 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:45.683067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:45.718646 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Getting quotas for project 8091182527c74871b45587d4ff107e9f. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:45.725143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Getting quotas for user 5ada4cd6646b4ba397f952d939e36814 and project 8091182527c74871b45587d4ff107e9f. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:45.774588 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:51:45.781082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:51:45.968685 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3f1dcc80-cfdf-4487-bf94-82a3a4aa82b7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.055074 Oct 10 18:51:45.973241 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 395/671] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:51:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:51:45.992200 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-927fbabb-dd48-40af-896c-00e039d9dcee tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:45.993131 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-927fbabb-dd48-40af-896c-00e039d9dcee tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:46.064639 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-32ba65d0-d9fb-4a68-bb4b-cb3c2fa92383 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:46.065636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-32ba65d0-d9fb-4a68-bb4b-cb3c2fa92383 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:46.077008 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32ba65d0-d9fb-4a68-bb4b-cb3c2fa92383 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:46.077985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32ba65d0-d9fb-4a68-bb4b-cb3c2fa92383 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:46.081329 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32ba65d0-d9fb-4a68-bb4b-cb3c2fa92383 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:46.082285 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32ba65d0-d9fb-4a68-bb4b-cb3c2fa92383 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:46.083118 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32ba65d0-d9fb-4a68-bb4b-cb3c2fa92383 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:46.085027 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32ba65d0-d9fb-4a68-bb4b-cb3c2fa92383 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:46.239892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-927fbabb-dd48-40af-896c-00e039d9dcee tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:46.251429 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-927fbabb-dd48-40af-896c-00e039d9dcee tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1216 microversion: 2.1 time: 0.267159 Oct 10 18:51:46.252058 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 277/672] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:45 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1216 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:46.273700 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e3cacac1-e145-479b-a1d6-c959c5dc75ff tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:46.274789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e3cacac1-e145-479b-a1d6-c959c5dc75ff tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:46.293727 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3cacac1-e145-479b-a1d6-c959c5dc75ff tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:46.294218 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3cacac1-e145-479b-a1d6-c959c5dc75ff tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:46.294652 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3cacac1-e145-479b-a1d6-c959c5dc75ff tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:46.297190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3cacac1-e145-479b-a1d6-c959c5dc75ff tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:46.297657 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3cacac1-e145-479b-a1d6-c959c5dc75ff tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:46.299291 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3cacac1-e145-479b-a1d6-c959c5dc75ff tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:46.459530 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e3cacac1-e145-479b-a1d6-c959c5dc75ff tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:46.474695 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e3cacac1-e145-479b-a1d6-c959c5dc75ff tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1274 microversion: 2.1 time: 0.220130 Oct 10 18:51:46.475091 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 278/673] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:46 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1274 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:46.534062 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-32ba65d0-d9fb-4a68-bb4b-cb3c2fa92383 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:46.543405 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-32ba65d0-d9fb-4a68-bb4b-cb3c2fa92383 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1404 microversion: 2.1 time: 0.483408 Oct 10 18:51:46.567762 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 396/674] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:46 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:47.276131 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-be6c50f8-aa61-4506-9692-6e0d9ed918a7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:47.277057 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-be6c50f8-aa61-4506-9692-6e0d9ed918a7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:47.396975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-be6c50f8-aa61-4506-9692-6e0d9ed918a7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:47.430465 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-be6c50f8-aa61-4506-9692-6e0d9ed918a7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1216 microversion: 2.1 time: 0.159620 Oct 10 18:51:47.432848 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 279/675] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:47 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:47.504899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-adc8a412-2c9e-4a12-9a85-e171cdaee3da tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:47.507578 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-adc8a412-2c9e-4a12-9a85-e171cdaee3da tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:47.525763 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-adc8a412-2c9e-4a12-9a85-e171cdaee3da tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:47.529766 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-adc8a412-2c9e-4a12-9a85-e171cdaee3da tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:47.530525 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-adc8a412-2c9e-4a12-9a85-e171cdaee3da tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:47.531890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-adc8a412-2c9e-4a12-9a85-e171cdaee3da tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:47.532843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-adc8a412-2c9e-4a12-9a85-e171cdaee3da tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:47.535297 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-adc8a412-2c9e-4a12-9a85-e171cdaee3da tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:47.588551 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-525d91d3-c31e-498f-a574-eeaab789e154 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:47.588551 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-525d91d3-c31e-498f-a574-eeaab789e154 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:47.598953 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-525d91d3-c31e-498f-a574-eeaab789e154 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:47.599713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-525d91d3-c31e-498f-a574-eeaab789e154 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:47.603216 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-525d91d3-c31e-498f-a574-eeaab789e154 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:47.607628 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-525d91d3-c31e-498f-a574-eeaab789e154 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:47.615576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-525d91d3-c31e-498f-a574-eeaab789e154 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:47.615576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-525d91d3-c31e-498f-a574-eeaab789e154 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:47.988980 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-525d91d3-c31e-498f-a574-eeaab789e154 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:48.022642 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-525d91d3-c31e-498f-a574-eeaab789e154 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1404 microversion: 2.1 time: 0.450955 Oct 10 18:51:48.028276 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 280/676] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:47 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:48.114202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-adc8a412-2c9e-4a12-9a85-e171cdaee3da tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:48.126103 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-adc8a412-2c9e-4a12-9a85-e171cdaee3da tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1316 microversion: 2.1 time: 0.627224 Oct 10 18:51:48.145612 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 397/677] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:47 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1316 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:48.399922 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-db3c5e03-6a0f-47f0-bef7-f7f9743f74f0 req-54e5d2f3-ebab-43ce-a748-5902ce42e919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6283d5d-8892-4104-8a03-572870613047", "name": "network-vif-plugged", "status": "completed", "tag": "034630fa-5e8e-45c4-a128-ff0de6f706b1"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:48.412387 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-db3c5e03-6a0f-47f0-bef7-f7f9743f74f0 req-54e5d2f3-ebab-43ce-a748-5902ce42e919 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:48.413256 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-db3c5e03-6a0f-47f0-bef7-f7f9743f74f0 req-54e5d2f3-ebab-43ce-a748-5902ce42e919 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:48.413876 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-db3c5e03-6a0f-47f0-bef7-f7f9743f74f0 req-54e5d2f3-ebab-43ce-a748-5902ce42e919 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:48.427984 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-db3c5e03-6a0f-47f0-bef7-f7f9743f74f0 req-54e5d2f3-ebab-43ce-a748-5902ce42e919 service nova] Creating event network-vif-plugged:034630fa-5e8e-45c4-a128-ff0de6f706b1 for instance d6283d5d-8892-4104-8a03-572870613047 on n-h1-860863-1 Oct 10 18:51:48.436219 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-db3c5e03-6a0f-47f0-bef7-f7f9743f74f0 req-54e5d2f3-ebab-43ce-a748-5902ce42e919 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040772 Oct 10 18:51:48.439342 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 281/678] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:48.457967 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-27cf7aae-c1e6-479d-b1e0-fe71d9d29d8a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:48.463542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-27cf7aae-c1e6-479d-b1e0-fe71d9d29d8a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:48.494666 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27cf7aae-c1e6-479d-b1e0-fe71d9d29d8a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:48.496615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27cf7aae-c1e6-479d-b1e0-fe71d9d29d8a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:48.497519 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27cf7aae-c1e6-479d-b1e0-fe71d9d29d8a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:48.500082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27cf7aae-c1e6-479d-b1e0-fe71d9d29d8a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:48.500773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27cf7aae-c1e6-479d-b1e0-fe71d9d29d8a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:48.503067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27cf7aae-c1e6-479d-b1e0-fe71d9d29d8a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:48.512611 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:48.691632 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-27cf7aae-c1e6-479d-b1e0-fe71d9d29d8a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:48.704556 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-27cf7aae-c1e6-479d-b1e0-fe71d9d29d8a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1268 microversion: 2.1 time: 0.250395 Oct 10 18:51:48.720572 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 398/679] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:48 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1268 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:49.050713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-124e3164-b40c-4e6b-a466-5e7a4ec7a665 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:49.051663 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-124e3164-b40c-4e6b-a466-5e7a4ec7a665 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:49.062550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-124e3164-b40c-4e6b-a466-5e7a4ec7a665 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:49.062550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-124e3164-b40c-4e6b-a466-5e7a4ec7a665 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:49.063183 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-124e3164-b40c-4e6b-a466-5e7a4ec7a665 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:49.064065 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-124e3164-b40c-4e6b-a466-5e7a4ec7a665 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:49.064782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-124e3164-b40c-4e6b-a466-5e7a4ec7a665 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:49.065447 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-124e3164-b40c-4e6b-a466-5e7a4ec7a665 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:49.154402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-32ed6b3c-0d36-4932-987a-8b4f3e29cba6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:49.155324 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-32ed6b3c-0d36-4932-987a-8b4f3e29cba6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:49.167059 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32ed6b3c-0d36-4932-987a-8b4f3e29cba6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:49.168510 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32ed6b3c-0d36-4932-987a-8b4f3e29cba6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:49.169133 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32ed6b3c-0d36-4932-987a-8b4f3e29cba6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:49.170007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32ed6b3c-0d36-4932-987a-8b4f3e29cba6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:49.170632 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32ed6b3c-0d36-4932-987a-8b4f3e29cba6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:49.171220 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32ed6b3c-0d36-4932-987a-8b4f3e29cba6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:49.389087 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-124e3164-b40c-4e6b-a466-5e7a4ec7a665 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:49.398614 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-124e3164-b40c-4e6b-a466-5e7a4ec7a665 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1404 microversion: 2.1 time: 0.352797 Oct 10 18:51:49.399205 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 282/680] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:49 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1404 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:49.735220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2efa8b58-6362-4bff-810a-e20667cfe685 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:49.735840 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2efa8b58-6362-4bff-810a-e20667cfe685 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:49.745174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2efa8b58-6362-4bff-810a-e20667cfe685 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:49.745939 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2efa8b58-6362-4bff-810a-e20667cfe685 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:49.746604 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2efa8b58-6362-4bff-810a-e20667cfe685 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:49.747487 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2efa8b58-6362-4bff-810a-e20667cfe685 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:49.748101 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2efa8b58-6362-4bff-810a-e20667cfe685 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:49.749325 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2efa8b58-6362-4bff-810a-e20667cfe685 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:49.755011 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-32ed6b3c-0d36-4932-987a-8b4f3e29cba6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:49.763183 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-32ed6b3c-0d36-4932-987a-8b4f3e29cba6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1316 microversion: 2.1 time: 0.613858 Oct 10 18:51:49.763963 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 399/681] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:49 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1316 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:51:50.090349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2efa8b58-6362-4bff-810a-e20667cfe685 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:50.110020 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2efa8b58-6362-4bff-810a-e20667cfe685 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1274 microversion: 2.1 time: 0.378165 Oct 10 18:51:50.128862 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 283/682] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:49 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1274 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:50.425070 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-162f69f3-d2af-47ce-ad11-a142bffb9a5c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:50.425925 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-162f69f3-d2af-47ce-ad11-a142bffb9a5c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:50.434496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-162f69f3-d2af-47ce-ad11-a142bffb9a5c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:50.435174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-162f69f3-d2af-47ce-ad11-a142bffb9a5c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:50.435755 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-162f69f3-d2af-47ce-ad11-a142bffb9a5c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:50.436953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-162f69f3-d2af-47ce-ad11-a142bffb9a5c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:50.437597 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-162f69f3-d2af-47ce-ad11-a142bffb9a5c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:50.438174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-162f69f3-d2af-47ce-ad11-a142bffb9a5c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:50.733628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-162f69f3-d2af-47ce-ad11-a142bffb9a5c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:50.741535 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-162f69f3-d2af-47ce-ad11-a142bffb9a5c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1591 microversion: 2.1 time: 0.320343 Oct 10 18:51:50.742104 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 400/683] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:50 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1591 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:50.766007 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-63dd4c72-889d-493b-a547-109dce96e002 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:50.767075 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-63dd4c72-889d-493b-a547-109dce96e002 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:50.773453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dd4c72-889d-493b-a547-109dce96e002 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:50.774383 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dd4c72-889d-493b-a547-109dce96e002 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:50.775137 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dd4c72-889d-493b-a547-109dce96e002 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:50.776291 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dd4c72-889d-493b-a547-109dce96e002 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:50.776982 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dd4c72-889d-493b-a547-109dce96e002 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:50.777606 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dd4c72-889d-493b-a547-109dce96e002 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:50.787047 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8627f2d2-931e-4412-8891-e90f540709e9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:50.788328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8627f2d2-931e-4412-8891-e90f540709e9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:50.804801 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8627f2d2-931e-4412-8891-e90f540709e9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:50.805534 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8627f2d2-931e-4412-8891-e90f540709e9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:50.808910 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8627f2d2-931e-4412-8891-e90f540709e9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:50.810943 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8627f2d2-931e-4412-8891-e90f540709e9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:50.812527 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8627f2d2-931e-4412-8891-e90f540709e9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:50.815161 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8627f2d2-931e-4412-8891-e90f540709e9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:51.061827 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-63dd4c72-889d-493b-a547-109dce96e002 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.298874 Oct 10 18:51:51.072996 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 284/684] 10.222.0.43 () {58 vars in 1275 bytes} [Mon Oct 10 18:51:50 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047/os-interface => generated 284 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:51.087713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-cac6a867-5465-4416-b967-529afd9087f3 req-f05a95f6-9349-4257-89ef-3b1059638906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bbc9663-3d8f-4bdf-a8a3-9398530d7415", "tag": "00715349-eae5-4d0a-b9d2-6de287066e04"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:51.115841 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-cac6a867-5465-4416-b967-529afd9087f3 req-f05a95f6-9349-4257-89ef-3b1059638906 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:51.119649 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-cac6a867-5465-4416-b967-529afd9087f3 req-f05a95f6-9349-4257-89ef-3b1059638906 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:51.120884 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-cac6a867-5465-4416-b967-529afd9087f3 req-f05a95f6-9349-4257-89ef-3b1059638906 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:51.146275 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-cac6a867-5465-4416-b967-529afd9087f3 req-f05a95f6-9349-4257-89ef-3b1059638906 service nova] Creating event network-changed:00715349-eae5-4d0a-b9d2-6de287066e04 for instance 1bbc9663-3d8f-4bdf-a8a3-9398530d7415 on n-h2-860863-1 Oct 10 18:51:51.152689 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-cac6a867-5465-4416-b967-529afd9087f3 req-f05a95f6-9349-4257-89ef-3b1059638906 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073226 Oct 10 18:51:51.155897 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 285/685] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:51.164566 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f359ce1e-c2b1-4b1c-8793-7aac067e7f9b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:51.165455 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f359ce1e-c2b1-4b1c-8793-7aac067e7f9b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:51.196850 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f359ce1e-c2b1-4b1c-8793-7aac067e7f9b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:51.198094 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f359ce1e-c2b1-4b1c-8793-7aac067e7f9b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:51.199916 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f359ce1e-c2b1-4b1c-8793-7aac067e7f9b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:51.201778 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f359ce1e-c2b1-4b1c-8793-7aac067e7f9b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:51.203178 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f359ce1e-c2b1-4b1c-8793-7aac067e7f9b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:51.204335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f359ce1e-c2b1-4b1c-8793-7aac067e7f9b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:51.310700 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f359ce1e-c2b1-4b1c-8793-7aac067e7f9b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:51:51.341586 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8627f2d2-931e-4412-8891-e90f540709e9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:51.355493 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8627f2d2-931e-4412-8891-e90f540709e9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1316 microversion: 2.1 time: 0.572850 Oct 10 18:51:51.368636 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 401/686] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:50 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1316 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:51.368887 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fd40a700-3822-4cd8-b04c-e6b3c155239a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:51.370077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fd40a700-3822-4cd8-b04c-e6b3c155239a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:51.386414 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd40a700-3822-4cd8-b04c-e6b3c155239a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:51.386915 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd40a700-3822-4cd8-b04c-e6b3c155239a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:51.388011 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd40a700-3822-4cd8-b04c-e6b3c155239a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:51.390347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd40a700-3822-4cd8-b04c-e6b3c155239a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:51.390860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd40a700-3822-4cd8-b04c-e6b3c155239a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:51.393219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd40a700-3822-4cd8-b04c-e6b3c155239a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:51.695130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=4 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:51.709549 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fd40a700-3822-4cd8-b04c-e6b3c155239a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:51.730325 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fd40a700-3822-4cd8-b04c-e6b3c155239a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1274 microversion: 2.1 time: 0.370896 Oct 10 18:51:51.730949 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 402/687] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:51 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1274 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:51.838586 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f359ce1e-c2b1-4b1c-8793-7aac067e7f9b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "DELETE /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 204 len: 0 microversion: 2.1 time: 0.679222 Oct 10 18:51:51.840591 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 286/688] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:51:51 2022] DELETE /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 0 bytes in 684 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:51:51.849498 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-edf25202-e954-4311-9b0e-030da8f608e3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:51.855951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-edf25202-e954-4311-9b0e-030da8f608e3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:51.874730 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edf25202-e954-4311-9b0e-030da8f608e3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:51.875675 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edf25202-e954-4311-9b0e-030da8f608e3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:51.876270 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edf25202-e954-4311-9b0e-030da8f608e3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:51.877180 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edf25202-e954-4311-9b0e-030da8f608e3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:51.877823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edf25202-e954-4311-9b0e-030da8f608e3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:51.878405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-edf25202-e954-4311-9b0e-030da8f608e3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:52.151671 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2124199035", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:52.212003 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] validate_networks() for None {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:51:52.318606 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-edf25202-e954-4311-9b0e-030da8f608e3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:52.339991 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-edf25202-e954-4311-9b0e-030da8f608e3 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1711 microversion: 2.1 time: 0.494200 Oct 10 18:51:52.343008 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 403/689] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:51 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1711 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:52.387768 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5a7f8a60-0a27-45f9-bac0-8f23f653e559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:52.389405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5a7f8a60-0a27-45f9-bac0-8f23f653e559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:52.399215 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a7f8a60-0a27-45f9-bac0-8f23f653e559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:52.402410 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a7f8a60-0a27-45f9-bac0-8f23f653e559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:52.403048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a7f8a60-0a27-45f9-bac0-8f23f653e559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:52.404792 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a7f8a60-0a27-45f9-bac0-8f23f653e559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:52.405471 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a7f8a60-0a27-45f9-bac0-8f23f653e559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:52.407173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a7f8a60-0a27-45f9-bac0-8f23f653e559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:52.841987 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5a7f8a60-0a27-45f9-bac0-8f23f653e559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:52.850037 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5a7f8a60-0a27-45f9-bac0-8f23f653e559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1316 microversion: 2.1 time: 0.471902 Oct 10 18:51:52.851568 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 404/690] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:52 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:51:52.870946 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e80bbdd8-8418-4c24-a465-d923d8e295e4 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:52.871862 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e80bbdd8-8418-4c24-a465-d923d8e295e4 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:52.875053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=14,nova_api:INSERT=10 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:52.879622 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e80bbdd8-8418-4c24-a465-d923d8e295e4 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:52.890521 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e80bbdd8-8418-4c24-a465-d923d8e295e4 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:52.892632 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e80bbdd8-8418-4c24-a465-d923d8e295e4 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:52.894473 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e80bbdd8-8418-4c24-a465-d923d8e295e4 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:52.895906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e80bbdd8-8418-4c24-a465-d923d8e295e4 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:52.896591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e80bbdd8-8418-4c24-a465-d923d8e295e4 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:53.180936 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e80bbdd8-8418-4c24-a465-d923d8e295e4 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:53.195517 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e80bbdd8-8418-4c24-a465-d923d8e295e4 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1316 microversion: 2.1 time: 0.342540 Oct 10 18:51:53.196763 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 405/691] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:52 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:53.370558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-dd55f3e6-5a73-454f-ad88-5089b853f29f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:53.371716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-dd55f3e6-5a73-454f-ad88-5089b853f29f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:53.378534 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd55f3e6-5a73-454f-ad88-5089b853f29f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:53.379242 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd55f3e6-5a73-454f-ad88-5089b853f29f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:53.379837 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd55f3e6-5a73-454f-ad88-5089b853f29f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:53.383698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd55f3e6-5a73-454f-ad88-5089b853f29f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:53.383698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd55f3e6-5a73-454f-ad88-5089b853f29f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:53.383698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd55f3e6-5a73-454f-ad88-5089b853f29f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:53.431418 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:51:53.432455 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:51:53.433107 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:51:53.434005 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:51:53.434577 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:51:53.445339 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:53.446123 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:53.447623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:53.448526 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:53.449188 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:53.449798 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:53.474685 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Getting quotas for project b15c92e4a6804ff5ba5d91c342f6c529. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:53.481123 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Getting quotas for user 53de519302254009b38a5324f76a1e92 and project b15c92e4a6804ff5ba5d91c342f6c529. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:53.500718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:51:53.505861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:51:53.566178 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dd55f3e6-5a73-454f-ad88-5089b853f29f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:53.576294 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-dd55f3e6-5a73-454f-ad88-5089b853f29f tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1711 microversion: 2.1 time: 0.210629 Oct 10 18:51:53.576918 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 406/692] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:53 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1711 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:51:53.686651 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3168a020-f725-4de0-9637-2600caf77e0a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.662577 Oct 10 18:51:53.688944 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 287/693] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:51:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 18:51:53.817039 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1111324693", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:53.879602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4ae55aea-21ed-4dc6-a779-296fe55de754 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:53.881022 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4ae55aea-21ed-4dc6-a779-296fe55de754 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:53.898594 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ae55aea-21ed-4dc6-a779-296fe55de754 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:53.901539 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] validate_networks() for None {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:51:53.908701 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ae55aea-21ed-4dc6-a779-296fe55de754 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:53.908701 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ae55aea-21ed-4dc6-a779-296fe55de754 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:53.908701 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ae55aea-21ed-4dc6-a779-296fe55de754 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:53.908701 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ae55aea-21ed-4dc6-a779-296fe55de754 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:53.911018 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ae55aea-21ed-4dc6-a779-296fe55de754 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:54.765659 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4ae55aea-21ed-4dc6-a779-296fe55de754 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:54.783651 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4ae55aea-21ed-4dc6-a779-296fe55de754 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1316 microversion: 2.1 time: 0.907543 Oct 10 18:51:54.801236 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 288/694] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:53 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1316 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:54.808309 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-02a116a2-12b4-4a0e-a54a-cfc5846d2fad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:54.809273 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-02a116a2-12b4-4a0e-a54a-cfc5846d2fad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:54.821500 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02a116a2-12b4-4a0e-a54a-cfc5846d2fad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:54.822408 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02a116a2-12b4-4a0e-a54a-cfc5846d2fad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:54.823099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02a116a2-12b4-4a0e-a54a-cfc5846d2fad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:54.824009 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02a116a2-12b4-4a0e-a54a-cfc5846d2fad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:54.826359 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02a116a2-12b4-4a0e-a54a-cfc5846d2fad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:54.830367 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02a116a2-12b4-4a0e-a54a-cfc5846d2fad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:55.501089 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-02a116a2-12b4-4a0e-a54a-cfc5846d2fad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:55.519588 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-02a116a2-12b4-4a0e-a54a-cfc5846d2fad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1316 microversion: 2.1 time: 0.716146 Oct 10 18:51:55.529182 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 289/695] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:54 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1316 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:55.549079 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8ccbebc9-9ff9-4e2f-8b46-48bac6c09ffa tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:55.549079 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8ccbebc9-9ff9-4e2f-8b46-48bac6c09ffa tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:55.566754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ccbebc9-9ff9-4e2f-8b46-48bac6c09ffa tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:55.567244 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ccbebc9-9ff9-4e2f-8b46-48bac6c09ffa tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:55.568117 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ccbebc9-9ff9-4e2f-8b46-48bac6c09ffa tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:55.572012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ccbebc9-9ff9-4e2f-8b46-48bac6c09ffa tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:55.575581 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ccbebc9-9ff9-4e2f-8b46-48bac6c09ffa tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:55.580527 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ccbebc9-9ff9-4e2f-8b46-48bac6c09ffa tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:55.657562 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:51:55.658100 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:51:55.659734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:51:55.660159 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:51:55.661626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:51:55.695512 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:55.698132 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:55.704139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:55.713971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:55.713971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:55.713971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:55.713971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:55.748320 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Getting quotas for project b15c92e4a6804ff5ba5d91c342f6c529. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:51:55.754596 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Getting quotas for user 53de519302254009b38a5324f76a1e92 and project b15c92e4a6804ff5ba5d91c342f6c529. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:51:55.793636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:51:55.801806 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:51:56.003177 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5ce5ddb5-50de-499a-a9f4-c8d195c5a12d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.190461 Oct 10 18:51:56.003847 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 407/696] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:51:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:51:56.035282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-dbcff7be-b1cd-46f4-8f8e-bbbb42b3861a tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:56.035909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-dbcff7be-b1cd-46f4-8f8e-bbbb42b3861a tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:56.065879 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dbcff7be-b1cd-46f4-8f8e-bbbb42b3861a tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:56.066379 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dbcff7be-b1cd-46f4-8f8e-bbbb42b3861a tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:56.066815 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dbcff7be-b1cd-46f4-8f8e-bbbb42b3861a tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:56.067532 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dbcff7be-b1cd-46f4-8f8e-bbbb42b3861a tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:56.067998 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dbcff7be-b1cd-46f4-8f8e-bbbb42b3861a tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:56.068419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dbcff7be-b1cd-46f4-8f8e-bbbb42b3861a tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:56.071012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8ccbebc9-9ff9-4e2f-8b46-48bac6c09ffa tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:56.082253 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8ccbebc9-9ff9-4e2f-8b46-48bac6c09ffa tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1711 microversion: 2.1 time: 0.551855 Oct 10 18:51:56.084757 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 290/697] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:55 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1711 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:56.100759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-17acadd0-b38d-487d-9ab2-b29adad2a648 req-8aacc526-2990-4922-b5a8-ef37664d925b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6283d5d-8892-4104-8a03-572870613047", "tag": "034630fa-5e8e-45c4-a128-ff0de6f706b1"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:56.120287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-17acadd0-b38d-487d-9ab2-b29adad2a648 req-8aacc526-2990-4922-b5a8-ef37664d925b service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:56.122015 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-17acadd0-b38d-487d-9ab2-b29adad2a648 req-8aacc526-2990-4922-b5a8-ef37664d925b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:56.123112 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-17acadd0-b38d-487d-9ab2-b29adad2a648 req-8aacc526-2990-4922-b5a8-ef37664d925b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:56.155921 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-17acadd0-b38d-487d-9ab2-b29adad2a648 req-8aacc526-2990-4922-b5a8-ef37664d925b service nova] Creating event network-changed:034630fa-5e8e-45c4-a128-ff0de6f706b1 for instance d6283d5d-8892-4104-8a03-572870613047 on n-h1-860863-1 Oct 10 18:51:56.162787 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-17acadd0-b38d-487d-9ab2-b29adad2a648 req-8aacc526-2990-4922-b5a8-ef37664d925b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073125 Oct 10 18:51:56.166732 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 291/698] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:56.182326 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-93eb2956-b4f9-442c-a61c-1435ae25abe4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:56.183359 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-93eb2956-b4f9-442c-a61c-1435ae25abe4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:56.199605 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-93eb2956-b4f9-442c-a61c-1435ae25abe4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:56.200337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-93eb2956-b4f9-442c-a61c-1435ae25abe4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:56.205695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-93eb2956-b4f9-442c-a61c-1435ae25abe4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:56.206579 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-93eb2956-b4f9-442c-a61c-1435ae25abe4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:56.207282 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-93eb2956-b4f9-442c-a61c-1435ae25abe4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:56.208032 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-93eb2956-b4f9-442c-a61c-1435ae25abe4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:56.961698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dbcff7be-b1cd-46f4-8f8e-bbbb42b3861a tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:56.972293 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-dbcff7be-b1cd-46f4-8f8e-bbbb42b3861a tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1591 microversion: 2.1 time: 0.963735 Oct 10 18:51:56.972928 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 408/699] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:56 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1591 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:56.988770 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-db422169-1a87-43ae-a659-62ddbbe65f3d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:56.990350 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-db422169-1a87-43ae-a659-62ddbbe65f3d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:57.201202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-db422169-1a87-43ae-a659-62ddbbe65f3d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:57.207223 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-db422169-1a87-43ae-a659-62ddbbe65f3d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1214 microversion: 2.1 time: 0.230546 Oct 10 18:51:57.217260 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 409/700] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:56 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:57.222159 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f52dfc4d-6f09-4cfc-a156-edb0892f351f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:57.228003 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f52dfc4d-6f09-4cfc-a156-edb0892f351f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:57.241009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f52dfc4d-6f09-4cfc-a156-edb0892f351f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:57.242732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f52dfc4d-6f09-4cfc-a156-edb0892f351f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:57.243420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f52dfc4d-6f09-4cfc-a156-edb0892f351f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:57.252264 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f52dfc4d-6f09-4cfc-a156-edb0892f351f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:57.253104 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f52dfc4d-6f09-4cfc-a156-edb0892f351f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:57.253789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f52dfc4d-6f09-4cfc-a156-edb0892f351f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:57.369546 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-93eb2956-b4f9-442c-a61c-1435ae25abe4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:57.399103 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-93eb2956-b4f9-442c-a61c-1435ae25abe4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1316 microversion: 2.1 time: 1.227736 Oct 10 18:51:57.399725 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 292/701] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:56 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1316 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:57.420675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-73d99aff-1761-46a2-bc70-16be500c1f4b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:57.427860 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-73d99aff-1761-46a2-bc70-16be500c1f4b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:57.455026 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-73d99aff-1761-46a2-bc70-16be500c1f4b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:57.455531 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-73d99aff-1761-46a2-bc70-16be500c1f4b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:57.458588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-73d99aff-1761-46a2-bc70-16be500c1f4b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:57.460419 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-73d99aff-1761-46a2-bc70-16be500c1f4b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:57.463533 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-73d99aff-1761-46a2-bc70-16be500c1f4b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:57.464175 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-73d99aff-1761-46a2-bc70-16be500c1f4b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:57.786790 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f52dfc4d-6f09-4cfc-a156-edb0892f351f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:57.800865 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f52dfc4d-6f09-4cfc-a156-edb0892f351f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1316 microversion: 2.1 time: 0.582117 Oct 10 18:51:57.807572 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 410/702] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:57 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:57.907123 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-73d99aff-1761-46a2-bc70-16be500c1f4b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2be8da9a544318b112ba8e8d3f498a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2029d88758407a9415b15747079079', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:57.942068 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-73d99aff-1761-46a2-bc70-16be500c1f4b tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 200 len: 1645 microversion: 2.1 time: 0.532410 Oct 10 18:51:57.943967 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 293/703] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:57 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 1645 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:57.988302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-5876d37e-77d1-474d-a8b4-2e483df0bb67 req-6e694e77-7246-41e9-a4bd-8fd3dcd6e7aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d7e0b3-09b9-43cd-a996-c33d4bed703b", "tag": "262c829d-3cff-42ed-af35-b1a9a1cfab8d"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:58.035452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5876d37e-77d1-474d-a8b4-2e483df0bb67 req-6e694e77-7246-41e9-a4bd-8fd3dcd6e7aa service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:58.037502 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5876d37e-77d1-474d-a8b4-2e483df0bb67 req-6e694e77-7246-41e9-a4bd-8fd3dcd6e7aa service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:58.038948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5876d37e-77d1-474d-a8b4-2e483df0bb67 req-6e694e77-7246-41e9-a4bd-8fd3dcd6e7aa service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:58.066959 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-5876d37e-77d1-474d-a8b4-2e483df0bb67 req-6e694e77-7246-41e9-a4bd-8fd3dcd6e7aa service nova] Creating event network-changed:262c829d-3cff-42ed-af35-b1a9a1cfab8d for instance 17d7e0b3-09b9-43cd-a996-c33d4bed703b on n-h2-860863-1 Oct 10 18:51:58.079374 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-5876d37e-77d1-474d-a8b4-2e483df0bb67 req-6e694e77-7246-41e9-a4bd-8fd3dcd6e7aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096148 Oct 10 18:51:58.083145 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 411/704] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:58.246490 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-baa62209-83b4-4f40-a1f7-70c35d9f4e70 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:58.247135 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-baa62209-83b4-4f40-a1f7-70c35d9f4e70 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:58.258110 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-baa62209-83b4-4f40-a1f7-70c35d9f4e70 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:58.258607 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-baa62209-83b4-4f40-a1f7-70c35d9f4e70 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:58.259055 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-baa62209-83b4-4f40-a1f7-70c35d9f4e70 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:58.262774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-baa62209-83b4-4f40-a1f7-70c35d9f4e70 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:58.263284 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-baa62209-83b4-4f40-a1f7-70c35d9f4e70 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:58.265251 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-baa62209-83b4-4f40-a1f7-70c35d9f4e70 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:58.314332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-dc5f23f9-b4d8-4869-8e8a-44b16ce5d517 req-cdcd9b65-41ad-4b2e-877d-e5c9c78a329c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010c33e9-e125-40ee-bc0a-2a9c98c5c36c", "name": "network-vif-deleted", "tag": "431fe82a-d096-423c-9fb6-a785452351e7"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:51:58.338988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:58.341474 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-dc5f23f9-b4d8-4869-8e8a-44b16ce5d517 req-cdcd9b65-41ad-4b2e-877d-e5c9c78a329c service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:58.343706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-dc5f23f9-b4d8-4869-8e8a-44b16ce5d517 req-cdcd9b65-41ad-4b2e-877d-e5c9c78a329c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:58.345593 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-dc5f23f9-b4d8-4869-8e8a-44b16ce5d517 req-cdcd9b65-41ad-4b2e-877d-e5c9c78a329c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:58.394640 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-dc5f23f9-b4d8-4869-8e8a-44b16ce5d517 req-cdcd9b65-41ad-4b2e-877d-e5c9c78a329c service nova] Creating event network-vif-deleted:431fe82a-d096-423c-9fb6-a785452351e7 for instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c on n-h1-860863-1 Oct 10 18:51:58.427288 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-dc5f23f9-b4d8-4869-8e8a-44b16ce5d517 req-cdcd9b65-41ad-4b2e-877d-e5c9c78a329c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118681 Oct 10 18:51:58.433943 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 412/705] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:51:58.440009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a41be233-4c7a-43f9-b280-75e2f7edbe96 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:58.445407 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a41be233-4c7a-43f9-b280-75e2f7edbe96 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:58.458174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a41be233-4c7a-43f9-b280-75e2f7edbe96 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:58.459076 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a41be233-4c7a-43f9-b280-75e2f7edbe96 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:58.459899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a41be233-4c7a-43f9-b280-75e2f7edbe96 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:58.461049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a41be233-4c7a-43f9-b280-75e2f7edbe96 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:58.461726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a41be233-4c7a-43f9-b280-75e2f7edbe96 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:58.462387 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a41be233-4c7a-43f9-b280-75e2f7edbe96 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:58.538325 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-baa62209-83b4-4f40-a1f7-70c35d9f4e70 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:58.551194 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-baa62209-83b4-4f40-a1f7-70c35d9f4e70 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1266 microversion: 2.1 time: 0.311356 Oct 10 18:51:58.553048 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 294/706] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:58 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:51:58.831646 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-af7567c8-bd6b-4569-9244-bf54ac8426a9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:51:58.832327 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-af7567c8-bd6b-4569-9244-bf54ac8426a9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:51:58.834301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:51:58.840196 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af7567c8-bd6b-4569-9244-bf54ac8426a9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:58.841201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af7567c8-bd6b-4569-9244-bf54ac8426a9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:58.846888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af7567c8-bd6b-4569-9244-bf54ac8426a9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:58.846888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af7567c8-bd6b-4569-9244-bf54ac8426a9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:51:58.846888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af7567c8-bd6b-4569-9244-bf54ac8426a9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:51:58.846888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af7567c8-bd6b-4569-9244-bf54ac8426a9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:51:59.987385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a41be233-4c7a-43f9-b280-75e2f7edbe96 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:51:59.995922 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a41be233-4c7a-43f9-b280-75e2f7edbe96 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1316 microversion: 2.1 time: 1.560407 Oct 10 18:52:00.000000 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 413/707] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:58 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1316 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:00.014374 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-58e1e935-805a-467e-ba8c-1039f05ea5b8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:00.015278 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-58e1e935-805a-467e-ba8c-1039f05ea5b8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:00.040287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-58e1e935-805a-467e-ba8c-1039f05ea5b8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:00.040825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-58e1e935-805a-467e-ba8c-1039f05ea5b8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:00.041325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-58e1e935-805a-467e-ba8c-1039f05ea5b8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:00.042092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-58e1e935-805a-467e-ba8c-1039f05ea5b8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:00.042513 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-58e1e935-805a-467e-ba8c-1039f05ea5b8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:00.053772 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-58e1e935-805a-467e-ba8c-1039f05ea5b8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:00.086517 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-58e1e935-805a-467e-ba8c-1039f05ea5b8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] HTTP exception thrown: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-58e1e935-805a-467e-ba8c-1039f05ea5b8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Request method failure captured: Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c HTTP/1.1 Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk8eMtNQVJ5rvXlEh4ml2TSFgvpdJlgm_o_u4Odv1W4zPQiy0d0JcbR2DTZKImK429mwbQ9hLNJNgEH1uz8Kyz_wMPxIUvrLpXUGrdOepoW6bJbnRvbSIzNfQIbYiSmftSPAvMaDN8hUi05PhAj3il0ZypyzgAzC7xDrabIfAzTRzE Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: ea2029d88758407a9415b15747079079 Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ea2029d88758407a9415b15747079079", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ea2029d88758407a9415b15747079079"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ea2029d88758407a9415b15747079079"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ea2029d88758407a9415b15747079079"}]}] Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: ea2029d88758407a9415b15747079079 Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1771027578-project Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: ad2be8da9a544318b112ba8e8d3f498a Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578-project Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '010c33e9-e125-40ee-bc0a-2a9c98c5c36c'} Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:00.091928 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.096754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:00.096754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.096754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:00.096754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:00.096754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:00.096754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:00.096754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:00.096754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:00.096754 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.100688 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-58e1e935-805a-467e-ba8c-1039f05ea5b8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Returning 404 to user: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:00.104195 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-58e1e935-805a-467e-ba8c-1039f05ea5b8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 404 len: 111 microversion: 2.1 time: 0.094325 Oct 10 18:52:00.105047 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 414/708] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:00 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:52:00.118076 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-13ff8e6c-f3bc-4076-bf1e-93537d46ac2a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:00.127987 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-13ff8e6c-f3bc-4076-bf1e-93537d46ac2a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:00.133803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-13ff8e6c-f3bc-4076-bf1e-93537d46ac2a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:00.134496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-13ff8e6c-f3bc-4076-bf1e-93537d46ac2a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:00.135685 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-13ff8e6c-f3bc-4076-bf1e-93537d46ac2a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:00.142621 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-13ff8e6c-f3bc-4076-bf1e-93537d46ac2a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:00.143327 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-13ff8e6c-f3bc-4076-bf1e-93537d46ac2a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:00.143955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-13ff8e6c-f3bc-4076-bf1e-93537d46ac2a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:00.316743 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-13ff8e6c-f3bc-4076-bf1e-93537d46ac2a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:00.325961 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-13ff8e6c-f3bc-4076-bf1e-93537d46ac2a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1272 microversion: 2.1 time: 0.212095 Oct 10 18:52:00.332293 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 415/709] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:00 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:00.346981 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1e695336-9980-46f6-8d8d-708a1f0b0164 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:00.347629 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1e695336-9980-46f6-8d8d-708a1f0b0164 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:00.374461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e695336-9980-46f6-8d8d-708a1f0b0164 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:00.375679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e695336-9980-46f6-8d8d-708a1f0b0164 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:00.376476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e695336-9980-46f6-8d8d-708a1f0b0164 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:00.377957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e695336-9980-46f6-8d8d-708a1f0b0164 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:00.379567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e695336-9980-46f6-8d8d-708a1f0b0164 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:00.381852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e695336-9980-46f6-8d8d-708a1f0b0164 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:00.443946 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-1e695336-9980-46f6-8d8d-708a1f0b0164 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] HTTP exception thrown: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1e695336-9980-46f6-8d8d-708a1f0b0164 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Request method failure captured: Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d HTTP/1.1 Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk8eMtNQVJ5rvXlEh4ml2TSFgvpdJlgm_o_u4Odv1W4zPQiy0d0JcbR2DTZKImK429mwbQ9hLNJNgEH1uz8Kyz_wMPxIUvrLpXUGrdOepoW6bJbnRvbSIzNfQIbYiSmftSPAvMaDN8hUi05PhAj3il0ZypyzgAzC7xDrabIfAzTRzE Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: ea2029d88758407a9415b15747079079 Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ea2029d88758407a9415b15747079079", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ea2029d88758407a9415b15747079079"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ea2029d88758407a9415b15747079079"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ea2029d88758407a9415b15747079079"}]}] Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: ea2029d88758407a9415b15747079079 Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1771027578-project Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: ad2be8da9a544318b112ba8e8d3f498a Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578-project Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '237bf8ad-542e-4814-a679-25fe8058682d'} Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:52:00.450714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:52:00.456605 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:00.456605 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.456605 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:00.456605 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.456605 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:00.456605 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:00.456605 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:00.456605 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:00.456605 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:00.456605 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:00.456605 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.474197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1e695336-9980-46f6-8d8d-708a1f0b0164 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Returning 404 to user: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:00.479439 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1e695336-9980-46f6-8d8d-708a1f0b0164 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "DELETE /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 404 len: 111 microversion: 2.1 time: 0.145860 Oct 10 18:52:00.480844 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 416/710] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:52:00 2022] DELETE /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:52:00.497666 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-33b202d2-1ffe-4cd4-b423-075e578dd1a4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:00.499776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-33b202d2-1ffe-4cd4-b423-075e578dd1a4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:00.524484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-af7567c8-bd6b-4569-9244-bf54ac8426a9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:00.538445 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-33b202d2-1ffe-4cd4-b423-075e578dd1a4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:00.539966 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-33b202d2-1ffe-4cd4-b423-075e578dd1a4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:00.542427 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-af7567c8-bd6b-4569-9244-bf54ac8426a9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1316 microversion: 2.1 time: 1.714818 Oct 10 18:52:00.546471 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-33b202d2-1ffe-4cd4-b423-075e578dd1a4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:00.547351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-33b202d2-1ffe-4cd4-b423-075e578dd1a4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:00.567365 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-33b202d2-1ffe-4cd4-b423-075e578dd1a4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:00.569185 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 295/711] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:51:58 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1316 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:52:00.569621 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-33b202d2-1ffe-4cd4-b423-075e578dd1a4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:00.619528 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-33b202d2-1ffe-4cd4-b423-075e578dd1a4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] HTTP exception thrown: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-33b202d2-1ffe-4cd4-b423-075e578dd1a4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Request method failure captured: Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d HTTP/1.1 Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk8eMtNQVJ5rvXlEh4ml2TSFgvpdJlgm_o_u4Odv1W4zPQiy0d0JcbR2DTZKImK429mwbQ9hLNJNgEH1uz8Kyz_wMPxIUvrLpXUGrdOepoW6bJbnRvbSIzNfQIbYiSmftSPAvMaDN8hUi05PhAj3il0ZypyzgAzC7xDrabIfAzTRzE Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: ea2029d88758407a9415b15747079079 Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ea2029d88758407a9415b15747079079", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ea2029d88758407a9415b15747079079"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ea2029d88758407a9415b15747079079"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ea2029d88758407a9415b15747079079"}]}] Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: ea2029d88758407a9415b15747079079 Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1771027578-project Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: ad2be8da9a544318b112ba8e8d3f498a Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578-project Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '237bf8ad-542e-4814-a679-25fe8058682d'} Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:00.623851 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.628090 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:00.628090 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.628090 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:00.628090 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:00.628090 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:00.628090 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:00.628090 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:00.628090 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:00.628090 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:00.628090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-33b202d2-1ffe-4cd4-b423-075e578dd1a4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Returning 404 to user: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:00.630644 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-33b202d2-1ffe-4cd4-b423-075e578dd1a4 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 404 len: 111 microversion: 2.1 time: 0.145430 Oct 10 18:52:00.637093 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 417/712] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:00 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:52:00.641615 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ba5ee363-62ca-4c56-9642-788a56448e97 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '.version_select at 0x7f318e44baf0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:00.761349 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ba5ee363-62ca-4c56-9642-788a56448e97 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701984569" status: 202 len: 0 microversion: 2.1 time: 0.123899 Oct 10 18:52:00.764284 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 296/713] 10.222.0.43 () {58 vars in 1221 bytes} [Mon Oct 10 18:52:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701984569 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 18:52:01.024146 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4f86b305-20a3-4395-998d-45e3197ad0d9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:01.029528 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4f86b305-20a3-4395-998d-45e3197ad0d9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:01.095674 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4f86b305-20a3-4395-998d-45e3197ad0d9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:01.100060 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4f86b305-20a3-4395-998d-45e3197ad0d9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:01.100243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4f86b305-20a3-4395-998d-45e3197ad0d9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:01.101345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4f86b305-20a3-4395-998d-45e3197ad0d9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:01.102135 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4f86b305-20a3-4395-998d-45e3197ad0d9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:01.102745 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4f86b305-20a3-4395-998d-45e3197ad0d9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:01.268707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-a0398008-ab20-43b0-b472-c91c7c746b70 req-0779afe9-3d5b-46ea-bbf7-7efe2a899b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bbc9663-3d8f-4bdf-a8a3-9398530d7415", "name": "network-vif-plugged", "status": "completed", "tag": "00715349-eae5-4d0a-b9d2-6de287066e04"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:01.285957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-a0398008-ab20-43b0-b472-c91c7c746b70 req-0779afe9-3d5b-46ea-bbf7-7efe2a899b67 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:01.288421 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-a0398008-ab20-43b0-b472-c91c7c746b70 req-0779afe9-3d5b-46ea-bbf7-7efe2a899b67 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:01.293756 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-a0398008-ab20-43b0-b472-c91c7c746b70 req-0779afe9-3d5b-46ea-bbf7-7efe2a899b67 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:01.317724 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-a0398008-ab20-43b0-b472-c91c7c746b70 req-0779afe9-3d5b-46ea-bbf7-7efe2a899b67 service nova] Creating event network-vif-plugged:00715349-eae5-4d0a-b9d2-6de287066e04 for instance 1bbc9663-3d8f-4bdf-a8a3-9398530d7415 on n-h2-860863-1 Oct 10 18:52:01.324317 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-a0398008-ab20-43b0-b472-c91c7c746b70 req-0779afe9-3d5b-46ea-bbf7-7efe2a899b67 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062222 Oct 10 18:52:01.327979 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 297/714] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:01.356903 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-eaa7423e-350f-4560-94be-3905f5776195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:01.357592 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-eaa7423e-350f-4560-94be-3905f5776195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:01.385650 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eaa7423e-350f-4560-94be-3905f5776195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:01.389914 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eaa7423e-350f-4560-94be-3905f5776195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:01.389914 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eaa7423e-350f-4560-94be-3905f5776195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:01.389914 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eaa7423e-350f-4560-94be-3905f5776195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:01.390699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eaa7423e-350f-4560-94be-3905f5776195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:01.399849 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eaa7423e-350f-4560-94be-3905f5776195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:01.646473 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-eaa7423e-350f-4560-94be-3905f5776195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:01.671677 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-eaa7423e-350f-4560-94be-3905f5776195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1272 microversion: 2.1 time: 0.319961 Oct 10 18:52:01.672270 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 298/715] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:01 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1272 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:52:01.685670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-04b2f412-a1db-43b0-bd55-fc90573c8bd3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:01.686291 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-04b2f412-a1db-43b0-bd55-fc90573c8bd3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:01.696428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4f86b305-20a3-4395-998d-45e3197ad0d9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:01.697722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04b2f412-a1db-43b0-bd55-fc90573c8bd3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:01.701731 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04b2f412-a1db-43b0-bd55-fc90573c8bd3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:01.702349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04b2f412-a1db-43b0-bd55-fc90573c8bd3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:01.703663 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04b2f412-a1db-43b0-bd55-fc90573c8bd3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:01.704443 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04b2f412-a1db-43b0-bd55-fc90573c8bd3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:01.705694 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04b2f412-a1db-43b0-bd55-fc90573c8bd3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:01.715454 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4f86b305-20a3-4395-998d-45e3197ad0d9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1316 microversion: 2.1 time: 0.695951 Oct 10 18:52:01.717441 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 418/716] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:01 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1316 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:02.395532 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-04b2f412-a1db-43b0-bd55-fc90573c8bd3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:02.409659 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-04b2f412-a1db-43b0-bd55-fc90573c8bd3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1316 microversion: 2.1 time: 0.735704 Oct 10 18:52:02.425513 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 299/717] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:01 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1316 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:02.697576 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9ecf8e3b-79a3-4c3f-b3d9-5ec85d1ecd78 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:02.698916 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9ecf8e3b-79a3-4c3f-b3d9-5ec85d1ecd78 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:02.718523 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ecf8e3b-79a3-4c3f-b3d9-5ec85d1ecd78 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:02.719289 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ecf8e3b-79a3-4c3f-b3d9-5ec85d1ecd78 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:02.719965 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ecf8e3b-79a3-4c3f-b3d9-5ec85d1ecd78 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:02.720978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ecf8e3b-79a3-4c3f-b3d9-5ec85d1ecd78 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:02.721651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ecf8e3b-79a3-4c3f-b3d9-5ec85d1ecd78 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:02.722526 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ecf8e3b-79a3-4c3f-b3d9-5ec85d1ecd78 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:02.743469 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fd50a3fa-0811-4dab-9c13-ca5c781cbd76 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:02.744114 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fd50a3fa-0811-4dab-9c13-ca5c781cbd76 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:02.752149 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd50a3fa-0811-4dab-9c13-ca5c781cbd76 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:02.754721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd50a3fa-0811-4dab-9c13-ca5c781cbd76 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:02.757658 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd50a3fa-0811-4dab-9c13-ca5c781cbd76 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:02.758607 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd50a3fa-0811-4dab-9c13-ca5c781cbd76 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:02.759390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd50a3fa-0811-4dab-9c13-ca5c781cbd76 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:02.762332 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd50a3fa-0811-4dab-9c13-ca5c781cbd76 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:02.996344 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9ecf8e3b-79a3-4c3f-b3d9-5ec85d1ecd78 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:03.003778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:03.021509 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9ecf8e3b-79a3-4c3f-b3d9-5ec85d1ecd78 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1272 microversion: 2.1 time: 0.327740 Oct 10 18:52:03.028192 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 419/718] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:02 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1272 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:03.311145 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fd50a3fa-0811-4dab-9c13-ca5c781cbd76 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:03.320934 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fd50a3fa-0811-4dab-9c13-ca5c781cbd76 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1316 microversion: 2.1 time: 0.581406 Oct 10 18:52:03.332044 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 300/719] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:02 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:52:03.435526 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-16fef162-c0ad-400f-a9c2-c6d52ed5e4a5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:03.436503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-16fef162-c0ad-400f-a9c2-c6d52ed5e4a5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:03.451253 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16fef162-c0ad-400f-a9c2-c6d52ed5e4a5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:03.451748 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16fef162-c0ad-400f-a9c2-c6d52ed5e4a5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:03.456103 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16fef162-c0ad-400f-a9c2-c6d52ed5e4a5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:03.456947 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16fef162-c0ad-400f-a9c2-c6d52ed5e4a5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:03.457427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16fef162-c0ad-400f-a9c2-c6d52ed5e4a5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:03.457861 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16fef162-c0ad-400f-a9c2-c6d52ed5e4a5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:04.050534 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-08bd6609-31f2-43a7-9e68-263588c1683a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:04.053425 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-08bd6609-31f2-43a7-9e68-263588c1683a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:04.056442 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:04.058461 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=30 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:04.060747 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-08bd6609-31f2-43a7-9e68-263588c1683a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:04.061487 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-08bd6609-31f2-43a7-9e68-263588c1683a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:04.062155 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-08bd6609-31f2-43a7-9e68-263588c1683a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:04.063095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-08bd6609-31f2-43a7-9e68-263588c1683a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:04.063787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-08bd6609-31f2-43a7-9e68-263588c1683a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:04.064635 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-08bd6609-31f2-43a7-9e68-263588c1683a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:04.351338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-16fef162-c0ad-400f-a9c2-c6d52ed5e4a5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:04.366956 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-16fef162-c0ad-400f-a9c2-c6d52ed5e4a5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1316 microversion: 2.1 time: 0.935704 Oct 10 18:52:04.374686 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 420/720] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:03 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1316 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:04.383217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-602e43df-80e5-464e-b561-c0032f89ae8c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:04.384358 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-602e43df-80e5-464e-b561-c0032f89ae8c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:04.398032 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-602e43df-80e5-464e-b561-c0032f89ae8c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:04.401860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-602e43df-80e5-464e-b561-c0032f89ae8c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:04.402561 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-602e43df-80e5-464e-b561-c0032f89ae8c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:04.403541 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-602e43df-80e5-464e-b561-c0032f89ae8c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:04.405765 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-602e43df-80e5-464e-b561-c0032f89ae8c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:04.406863 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-602e43df-80e5-464e-b561-c0032f89ae8c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:04.876856 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-602e43df-80e5-464e-b561-c0032f89ae8c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:04.915836 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-602e43df-80e5-464e-b561-c0032f89ae8c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1466 microversion: 2.1 time: 0.519324 Oct 10 18:52:04.918498 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 421/721] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:04 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1466 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:04.935051 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5c6f0dd2-5596-4a49-9208-5b6263f94ade tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:04.942401 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-08bd6609-31f2-43a7-9e68-263588c1683a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:04.987602 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-08bd6609-31f2-43a7-9e68-263588c1683a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1314 microversion: 2.1 time: 0.928935 Oct 10 18:52:04.994996 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 301/722] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:04 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1314 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:05.033527 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5c6f0dd2-5596-4a49-9208-5b6263f94ade tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1746818710" status: 202 len: 0 microversion: 2.1 time: 0.111919 Oct 10 18:52:05.034582 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 422/723] 10.222.0.43 () {58 vars in 1161 bytes} [Mon Oct 10 18:52:04 2022] DELETE /compute/v2.1/flavors/1746818710 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:52:05.043806 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a3366de3-0f12-4d0f-a342-277152cbf597 tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:05.152356 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a3366de3-0f12-4d0f-a342-277152cbf597 tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.111095 Oct 10 18:52:05.153708 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 423/724] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:52:05 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:52:05.173128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3b800221-2c0b-4f90-abd3-ed62c43f2ab8 tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:05.268293 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3b800221-2c0b-4f90-abd3-ed62c43f2ab8 tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1909171365" status: 202 len: 0 microversion: 2.1 time: 0.099585 Oct 10 18:52:05.269330 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 424/725] 10.222.0.43 () {58 vars in 1161 bytes} [Mon Oct 10 18:52:05 2022] DELETE /compute/v2.1/flavors/1909171365 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 18:52:05.277418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5c22ba60-fe48-4299-aa40-6bdeab13c69a tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:05.325497 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5c22ba60-fe48-4299-aa40-6bdeab13c69a tempest-ServersWithSpecificFlavorTestJSON-920939967 tempest-ServersWithSpecificFlavorTestJSON-920939967-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050184 Oct 10 18:52:05.328440 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 425/726] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:52:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:05.357254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-dd3ed6e9-589c-4dd8-9809-274e34035ff8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:05.358712 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-dd3ed6e9-589c-4dd8-9809-274e34035ff8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:05.367345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd3ed6e9-589c-4dd8-9809-274e34035ff8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:05.368087 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd3ed6e9-589c-4dd8-9809-274e34035ff8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:05.368935 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd3ed6e9-589c-4dd8-9809-274e34035ff8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:05.370461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd3ed6e9-589c-4dd8-9809-274e34035ff8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:05.371098 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd3ed6e9-589c-4dd8-9809-274e34035ff8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:05.371711 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd3ed6e9-589c-4dd8-9809-274e34035ff8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:05.390069 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-dd3ed6e9-589c-4dd8-9809-274e34035ff8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] HTTP exception thrown: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-dd3ed6e9-589c-4dd8-9809-274e34035ff8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Request method failure captured: Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c HTTP/1.1 Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk8eMtNQVJ5rvXlEh4ml2TSFgvpdJlgm_o_u4Odv1W4zPQiy0d0JcbR2DTZKImK429mwbQ9hLNJNgEH1uz8Kyz_wMPxIUvrLpXUGrdOepoW6bJbnRvbSIzNfQIbYiSmftSPAvMaDN8hUi05PhAj3il0ZypyzgAzC7xDrabIfAzTRzE Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: ea2029d88758407a9415b15747079079 Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ea2029d88758407a9415b15747079079", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ea2029d88758407a9415b15747079079"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ea2029d88758407a9415b15747079079"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ea2029d88758407a9415b15747079079"}]}] Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: ea2029d88758407a9415b15747079079 Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1771027578-project Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: ad2be8da9a544318b112ba8e8d3f498a Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578-project Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '010c33e9-e125-40ee-bc0a-2a9c98c5c36c'} Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:52:05.394749 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:52:05.405791 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:05.405791 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:05.405791 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:05.405791 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:05.405791 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:05.405791 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:05.405791 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:05.405791 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:05.405791 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:05.405791 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:05.405791 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:05.405791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-dd3ed6e9-589c-4dd8-9809-274e34035ff8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Returning 404 to user: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:05.405791 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-dd3ed6e9-589c-4dd8-9809-274e34035ff8 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "DELETE /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 404 len: 111 microversion: 2.1 time: 0.047373 Oct 10 18:52:05.405791 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 426/727] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:52:05 2022] DELETE /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 18:52:05.410977 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ca7ce781-5081-41b0-9609-79f5d93c91f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:05.412174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ca7ce781-5081-41b0-9609-79f5d93c91f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:05.420786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca7ce781-5081-41b0-9609-79f5d93c91f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:05.421825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca7ce781-5081-41b0-9609-79f5d93c91f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:05.423043 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca7ce781-5081-41b0-9609-79f5d93c91f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:05.427221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca7ce781-5081-41b0-9609-79f5d93c91f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:05.428038 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca7ce781-5081-41b0-9609-79f5d93c91f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:05.429577 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca7ce781-5081-41b0-9609-79f5d93c91f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:05.534502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a6201632-3cac-4b98-a8fb-70fe31cf9686 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:05.535747 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a6201632-3cac-4b98-a8fb-70fe31cf9686 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:05.562833 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6201632-3cac-4b98-a8fb-70fe31cf9686 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:05.563435 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6201632-3cac-4b98-a8fb-70fe31cf9686 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:05.564129 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6201632-3cac-4b98-a8fb-70fe31cf9686 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:05.565160 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6201632-3cac-4b98-a8fb-70fe31cf9686 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:05.566550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6201632-3cac-4b98-a8fb-70fe31cf9686 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:05.567214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6201632-3cac-4b98-a8fb-70fe31cf9686 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:06.208953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ca7ce781-5081-41b0-9609-79f5d93c91f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:06.228715 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ca7ce781-5081-41b0-9609-79f5d93c91f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1316 microversion: 2.1 time: 0.827368 Oct 10 18:52:06.233193 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 427/728] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:05 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1316 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:06.245880 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1f3ed549-633a-41f2-b827-e180e4004b04 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:06.251779 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1f3ed549-633a-41f2-b827-e180e4004b04 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 010c33e9-e125-40ee-bc0a-2a9c98c5c36c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:06.266207 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f3ed549-633a-41f2-b827-e180e4004b04 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:06.270825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f3ed549-633a-41f2-b827-e180e4004b04 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:06.271417 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f3ed549-633a-41f2-b827-e180e4004b04 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:06.274263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f3ed549-633a-41f2-b827-e180e4004b04 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:06.274747 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f3ed549-633a-41f2-b827-e180e4004b04 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:06.277597 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f3ed549-633a-41f2-b827-e180e4004b04 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:06.322075 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-1f3ed549-633a-41f2-b827-e180e4004b04 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] HTTP exception thrown: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1f3ed549-633a-41f2-b827-e180e4004b04 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Request method failure captured: Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c HTTP/1.1 Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk8eMtNQVJ5rvXlEh4ml2TSFgvpdJlgm_o_u4Odv1W4zPQiy0d0JcbR2DTZKImK429mwbQ9hLNJNgEH1uz8Kyz_wMPxIUvrLpXUGrdOepoW6bJbnRvbSIzNfQIbYiSmftSPAvMaDN8hUi05PhAj3il0ZypyzgAzC7xDrabIfAzTRzE Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: ea2029d88758407a9415b15747079079 Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ea2029d88758407a9415b15747079079", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ea2029d88758407a9415b15747079079"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ea2029d88758407a9415b15747079079"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ea2029d88758407a9415b15747079079"}]}] Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: ea2029d88758407a9415b15747079079 Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1771027578-project Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: ad2be8da9a544318b112ba8e8d3f498a Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578-project Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '010c33e9-e125-40ee-bc0a-2a9c98c5c36c'} Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:06.326682 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:06.331359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:06.331359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:06.331359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:06.331359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:06.331359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:06.331359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:06.331359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:06.331359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. Oct 10 18:52:06.331359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:06.334224 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1f3ed549-633a-41f2-b827-e180e4004b04 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Returning 404 to user: Instance 010c33e9-e125-40ee-bc0a-2a9c98c5c36c could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:06.335472 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1f3ed549-633a-41f2-b827-e180e4004b04 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c" status: 404 len: 111 microversion: 2.1 time: 0.100154 Oct 10 18:52:06.336688 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 428/729] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:06 2022] GET /compute/v2.1/servers/010c33e9-e125-40ee-bc0a-2a9c98c5c36c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:52:06.351273 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d2efd020-c0ac-40ba-abc5-3c911461371a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:06.355906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d2efd020-c0ac-40ba-abc5-3c911461371a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:06.363170 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d2efd020-c0ac-40ba-abc5-3c911461371a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:06.364978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d2efd020-c0ac-40ba-abc5-3c911461371a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:06.366576 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d2efd020-c0ac-40ba-abc5-3c911461371a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:06.368360 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d2efd020-c0ac-40ba-abc5-3c911461371a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:06.369674 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d2efd020-c0ac-40ba-abc5-3c911461371a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:06.370393 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d2efd020-c0ac-40ba-abc5-3c911461371a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:06.709667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:06.780236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d2efd020-c0ac-40ba-abc5-3c911461371a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:06.796466 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d2efd020-c0ac-40ba-abc5-3c911461371a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1314 microversion: 2.1 time: 0.456155 Oct 10 18:52:06.796782 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a6201632-3cac-4b98-a8fb-70fe31cf9686 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1617 microversion: 2.1 time: 1.800221 Oct 10 18:52:06.815075 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 429/730] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:06 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:06.819159 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 302/731] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:04 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1617 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:06.828859 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-a584317c-0a03-43e0-acba-60bfffac40ba req-097a2c66-2d7d-48bc-b324-d03cecfe4bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3624eba-30d5-486c-8753-86e4277189ff", "tag": "877788c4-8817-4a16-9c01-e7dd796eebdd"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:06.830230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ffe7fdb7-7fe4-45c6-b721-b40e25951dbc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:06.830742 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ffe7fdb7-7fe4-45c6-b721-b40e25951dbc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:06.846410 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffe7fdb7-7fe4-45c6-b721-b40e25951dbc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:06.846903 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffe7fdb7-7fe4-45c6-b721-b40e25951dbc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:06.847336 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffe7fdb7-7fe4-45c6-b721-b40e25951dbc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:06.847474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-a584317c-0a03-43e0-acba-60bfffac40ba req-097a2c66-2d7d-48bc-b324-d03cecfe4bc1 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:06.848012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-a584317c-0a03-43e0-acba-60bfffac40ba req-097a2c66-2d7d-48bc-b324-d03cecfe4bc1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:06.854821 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffe7fdb7-7fe4-45c6-b721-b40e25951dbc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:06.855312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffe7fdb7-7fe4-45c6-b721-b40e25951dbc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:06.855748 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffe7fdb7-7fe4-45c6-b721-b40e25951dbc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:06.864127 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-a584317c-0a03-43e0-acba-60bfffac40ba req-097a2c66-2d7d-48bc-b324-d03cecfe4bc1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:06.885835 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-a584317c-0a03-43e0-acba-60bfffac40ba req-097a2c66-2d7d-48bc-b324-d03cecfe4bc1 service nova] Creating event network-changed:877788c4-8817-4a16-9c01-e7dd796eebdd for instance d3624eba-30d5-486c-8753-86e4277189ff on n-h1-860863-1 Oct 10 18:52:06.898951 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-a584317c-0a03-43e0-acba-60bfffac40ba req-097a2c66-2d7d-48bc-b324-d03cecfe4bc1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075238 Oct 10 18:52:06.902192 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 303/732] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:06.913759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6a07d806-f69b-48cc-b421-80c84bfa4afa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Action: 'create', calling method: .version_select at 0x7f318e36f3a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1511369066", "policies": ["affinity"]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:06.922093 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-ffe7fdb7-7fe4-45c6-b721-b40e25951dbc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] HTTP exception thrown: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ffe7fdb7-7fe4-45c6-b721-b40e25951dbc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Request method failure captured: Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d HTTP/1.1 Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk8eMtNQVJ5rvXlEh4ml2TSFgvpdJlgm_o_u4Odv1W4zPQiy0d0JcbR2DTZKImK429mwbQ9hLNJNgEH1uz8Kyz_wMPxIUvrLpXUGrdOepoW6bJbnRvbSIzNfQIbYiSmftSPAvMaDN8hUi05PhAj3il0ZypyzgAzC7xDrabIfAzTRzE Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: ea2029d88758407a9415b15747079079 Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ea2029d88758407a9415b15747079079", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ea2029d88758407a9415b15747079079"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ea2029d88758407a9415b15747079079"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ea2029d88758407a9415b15747079079"}]}] Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: ea2029d88758407a9415b15747079079 Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1771027578-project Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: ad2be8da9a544318b112ba8e8d3f498a Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578-project Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '237bf8ad-542e-4814-a679-25fe8058682d'} Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:52:06.922577 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:52:06.927409 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:06.927409 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:06.927409 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:06.927409 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:06.927409 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:06.927409 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:06.927409 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:06.927409 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:06.927409 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:06.927409 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:06.927409 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:06.930863 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ffe7fdb7-7fe4-45c6-b721-b40e25951dbc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Returning 404 to user: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:06.934631 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ffe7fdb7-7fe4-45c6-b721-b40e25951dbc tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "DELETE /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 404 len: 111 microversion: 2.1 time: 0.117724 Oct 10 18:52:06.935786 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 430/733] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:52:06 2022] DELETE /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:52:06.970375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c9c9afc3-86ae-4352-9886-4b1420444240 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:06.970375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c9c9afc3-86ae-4352-9886-4b1420444240 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] [instance: 237bf8ad-542e-4814-a679-25fe8058682d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:06.970375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9c9afc3-86ae-4352-9886-4b1420444240 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:06.970375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9c9afc3-86ae-4352-9886-4b1420444240 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:06.970375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9c9afc3-86ae-4352-9886-4b1420444240 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:06.970375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9c9afc3-86ae-4352-9886-4b1420444240 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:06.970375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9c9afc3-86ae-4352-9886-4b1420444240 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:06.970375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9c9afc3-86ae-4352-9886-4b1420444240 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:06.976623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-6a07d806-f69b-48cc-b421-80c84bfa4afa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'server_groups'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:06.999171 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-c9c9afc3-86ae-4352-9886-4b1420444240 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] HTTP exception thrown: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:06.999434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-6a07d806-f69b-48cc-b421-80c84bfa4afa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'server_groups'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c9c9afc3-86ae-4352-9886-4b1420444240 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Request method failure captured: Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d HTTP/1.1 Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGk8eMtNQVJ5rvXlEh4ml2TSFgvpdJlgm_o_u4Odv1W4zPQiy0d0JcbR2DTZKImK429mwbQ9hLNJNgEH1uz8Kyz_wMPxIUvrLpXUGrdOepoW6bJbnRvbSIzNfQIbYiSmftSPAvMaDN8hUi05PhAj3il0ZypyzgAzC7xDrabIfAzTRzE Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: ea2029d88758407a9415b15747079079 Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ea2029d88758407a9415b15747079079", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ea2029d88758407a9415b15747079079"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ea2029d88758407a9415b15747079079"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ea2029d88758407a9415b15747079079"}]}] Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: ea2029d88758407a9415b15747079079 Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578 Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1771027578-project Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: ad2be8da9a544318b112ba8e8d3f498a Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1771027578-project Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '237bf8ad-542e-4814-a679-25fe8058682d'} Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:07.001397 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:07.006166 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:07.006166 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:07.006166 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:07.006166 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:07.006166 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:07.006166 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:07.006166 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:07.006166 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. Oct 10 18:52:07.006166 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:07.008108 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c9c9afc3-86ae-4352-9886-4b1420444240 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] Returning 404 to user: Instance 237bf8ad-542e-4814-a679-25fe8058682d could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:07.009196 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c9c9afc3-86ae-4352-9886-4b1420444240 tempest-ServersWithSpecificFlavorTestJSON-1771027578 tempest-ServersWithSpecificFlavorTestJSON-1771027578-project] 10.222.0.43 "GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d" status: 404 len: 111 microversion: 2.1 time: 0.067649 Oct 10 18:52:07.014734 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 431/734] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:06 2022] GET /compute/v2.1/servers/237bf8ad-542e-4814-a679-25fe8058682d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:52:07.192573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-6a07d806-f69b-48cc-b421-80c84bfa4afa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'server_groups'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:07.198415 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-6a07d806-f69b-48cc-b421-80c84bfa4afa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'server_groups'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:07.212175 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6a07d806-f69b-48cc-b421-80c84bfa4afa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.308118 Oct 10 18:52:07.214886 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 304/735] 10.222.0.43 () {60 vars in 1174 bytes} [Mon Oct 10 18:52:06 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:07.268012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a9780d28-939f-44c7-b86b-c5a6eef23325 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:07.268679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a9780d28-939f-44c7-b86b-c5a6eef23325 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:07.276650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=44,nova_cell0:UPDATE=7 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:07.278141 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a9780d28-939f-44c7-b86b-c5a6eef23325 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:07.278623 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a9780d28-939f-44c7-b86b-c5a6eef23325 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:07.279037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a9780d28-939f-44c7-b86b-c5a6eef23325 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:07.279738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a9780d28-939f-44c7-b86b-c5a6eef23325 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:07.280185 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a9780d28-939f-44c7-b86b-c5a6eef23325 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:07.280625 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a9780d28-939f-44c7-b86b-c5a6eef23325 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:07.394819 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-974713497", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "772e753d-bc05-4a67-86bc-fd8f2257d40d"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:07.489692 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] validate_networks() for None {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:52:07.618282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a9780d28-939f-44c7-b86b-c5a6eef23325 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:07.633354 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a9780d28-939f-44c7-b86b-c5a6eef23325 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1316 microversion: 2.1 time: 0.378722 Oct 10 18:52:07.633940 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 432/736] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:07 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:07.825376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4678803c-a2f3-4ce9-91b6-e39dd6b18601 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:07.826281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4678803c-a2f3-4ce9-91b6-e39dd6b18601 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:07.834049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4678803c-a2f3-4ce9-91b6-e39dd6b18601 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:07.835343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4678803c-a2f3-4ce9-91b6-e39dd6b18601 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:07.835781 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4678803c-a2f3-4ce9-91b6-e39dd6b18601 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:07.836675 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4678803c-a2f3-4ce9-91b6-e39dd6b18601 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:07.838623 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4678803c-a2f3-4ce9-91b6-e39dd6b18601 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:07.839188 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4678803c-a2f3-4ce9-91b6-e39dd6b18601 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:08.083961 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4678803c-a2f3-4ce9-91b6-e39dd6b18601 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:08.097384 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4678803c-a2f3-4ce9-91b6-e39dd6b18601 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1314 microversion: 2.1 time: 0.276466 Oct 10 18:52:08.098173 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 433/737] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:07 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:08.409716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-710586e1-ac91-4c89-9d70-f22a9235ede5 req-1e1b849d-bcf0-4ce7-88ef-cb3c86bfb7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d7e0b3-09b9-43cd-a996-c33d4bed703b", "name": "network-vif-plugged", "status": "completed", "tag": "262c829d-3cff-42ed-af35-b1a9a1cfab8d"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:08.429686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-710586e1-ac91-4c89-9d70-f22a9235ede5 req-1e1b849d-bcf0-4ce7-88ef-cb3c86bfb7aa service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:08.431607 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-710586e1-ac91-4c89-9d70-f22a9235ede5 req-1e1b849d-bcf0-4ce7-88ef-cb3c86bfb7aa service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:08.432764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-710586e1-ac91-4c89-9d70-f22a9235ede5 req-1e1b849d-bcf0-4ce7-88ef-cb3c86bfb7aa service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:08.460129 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-710586e1-ac91-4c89-9d70-f22a9235ede5 req-1e1b849d-bcf0-4ce7-88ef-cb3c86bfb7aa service nova] Creating event network-vif-plugged:262c829d-3cff-42ed-af35-b1a9a1cfab8d for instance 17d7e0b3-09b9-43cd-a996-c33d4bed703b on n-h2-860863-1 Oct 10 18:52:08.470087 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-710586e1-ac91-4c89-9d70-f22a9235ede5 req-1e1b849d-bcf0-4ce7-88ef-cb3c86bfb7aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067167 Oct 10 18:52:08.475722 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 434/738] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:52:08.664022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-22e8f662-d0d8-47f6-9abb-4e206780f845 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:08.665503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-22e8f662-d0d8-47f6-9abb-4e206780f845 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:08.676463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22e8f662-d0d8-47f6-9abb-4e206780f845 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:08.677717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22e8f662-d0d8-47f6-9abb-4e206780f845 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:08.678486 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22e8f662-d0d8-47f6-9abb-4e206780f845 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:08.680005 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22e8f662-d0d8-47f6-9abb-4e206780f845 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:08.680713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22e8f662-d0d8-47f6-9abb-4e206780f845 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:08.681463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22e8f662-d0d8-47f6-9abb-4e206780f845 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:09.045067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:52:09.045780 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:52:09.046329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:52:09.046822 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:52:09.047364 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:52:09.099163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:09.100703 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:09.100703 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:09.100858 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:09.101293 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:09.101896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:09.145325 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:09.155609 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:09.180099 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-22e8f662-d0d8-47f6-9abb-4e206780f845 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:09.184595 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Going to run 2 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:52:09.190317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 24f13450-d68f-4d4a-a1fd-c2da9dfd523f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:52:09.194815 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-22e8f662-d0d8-47f6-9abb-4e206780f845 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1316 microversion: 2.1 time: 0.534955 Oct 10 18:52:09.197751 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 435/739] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:08 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:52:09.202499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c8e88120-e4d7-4fb2-85f0-580c9c652407 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:09.203117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c8e88120-e4d7-4fb2-85f0-580c9c652407 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:09.229350 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8e88120-e4d7-4fb2-85f0-580c9c652407 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:09.237546 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8e88120-e4d7-4fb2-85f0-580c9c652407 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:09.240288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8e88120-e4d7-4fb2-85f0-580c9c652407 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:09.241178 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8e88120-e4d7-4fb2-85f0-580c9c652407 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:09.241727 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8e88120-e4d7-4fb2-85f0-580c9c652407 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:09.248349 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8e88120-e4d7-4fb2-85f0-580c9c652407 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:09.413995 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127289) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 10 18:52:09.455867 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:09.465899 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:09.672925 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:09.683423 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:09.703134 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=24f13450-d68f-4d4a-a1fd-c2da9dfd523f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:52:09.714432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c8e88120-e4d7-4fb2-85f0-580c9c652407 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:09.724980 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c8e88120-e4d7-4fb2-85f0-580c9c652407 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1314 microversion: 2.1 time: 0.526110 Oct 10 18:52:09.727625 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 436/740] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:09 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:09.740684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-80419ad0-2a4b-4f32-a03b-3ef69b30312e req-f38d7368-4fec-473b-a1c9-1a632c2f135d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01ef8a6-60ce-4468-a0e9-6a33c3392761", "tag": "69b5aea1-483c-4645-b02d-ca80e77bdc38"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:09.765549 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-80419ad0-2a4b-4f32-a03b-3ef69b30312e req-f38d7368-4fec-473b-a1c9-1a632c2f135d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:09.766038 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-80419ad0-2a4b-4f32-a03b-3ef69b30312e req-f38d7368-4fec-473b-a1c9-1a632c2f135d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:09.766471 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-80419ad0-2a4b-4f32-a03b-3ef69b30312e req-f38d7368-4fec-473b-a1c9-1a632c2f135d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:09.789377 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-80419ad0-2a4b-4f32-a03b-3ef69b30312e req-f38d7368-4fec-473b-a1c9-1a632c2f135d service nova] Creating event network-changed:69b5aea1-483c-4645-b02d-ca80e77bdc38 for instance f01ef8a6-60ce-4468-a0e9-6a33c3392761 on n-h1-860863-1 Oct 10 18:52:09.809934 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-80419ad0-2a4b-4f32-a03b-3ef69b30312e req-f38d7368-4fec-473b-a1c9-1a632c2f135d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073255 Oct 10 18:52:09.811491 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 437/741] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:09.924108 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:09.941553 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:09.944414 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:10.145568 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:10.153555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:10.220716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9cc56242-6d02-433b-980b-fd222ace48dc tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:10.221633 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9cc56242-6d02-433b-980b-fd222ace48dc tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:10.231500 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9cc56242-6d02-433b-980b-fd222ace48dc tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:10.234994 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9cc56242-6d02-433b-980b-fd222ace48dc tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:10.235627 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9cc56242-6d02-433b-980b-fd222ace48dc tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:10.244730 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9cc56242-6d02-433b-980b-fd222ace48dc tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:10.245566 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9cc56242-6d02-433b-980b-fd222ace48dc tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:10.247018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9cc56242-6d02-433b-980b-fd222ace48dc tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:10.247663 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-69326553-a83f-436c-9f62-32b5d5710372 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.858731 Oct 10 18:52:10.249069 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 305/742] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:52:07 2022] POST /compute/v2.1/servers => generated 32 bytes in 2863 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 10 18:52:10.259174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-476cc3b2-2398-4018-b98b-519e79a0996a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:10.285212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-476cc3b2-2398-4018-b98b-519e79a0996a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:10.290221 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-476cc3b2-2398-4018-b98b-519e79a0996a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Searching by: {'deleted': False, 'project_id': 'f536cb88016b414298031238fb251097'} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:52:10.324418 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-476cc3b2-2398-4018-b98b-519e79a0996a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:10.325232 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-476cc3b2-2398-4018-b98b-519e79a0996a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:10.326109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-476cc3b2-2398-4018-b98b-519e79a0996a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:10.327291 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-476cc3b2-2398-4018-b98b-519e79a0996a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:10.327965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-476cc3b2-2398-4018-b98b-519e79a0996a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:10.328731 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-476cc3b2-2398-4018-b98b-519e79a0996a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:10.491870 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.multi_cell_list [None req-476cc3b2-2398-4018-b98b-519e79a0996a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=127289) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 18:52:10.650213 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9cc56242-6d02-433b-980b-fd222ace48dc tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:10.659414 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9cc56242-6d02-433b-980b-fd222ace48dc tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1316 microversion: 2.1 time: 0.442864 Oct 10 18:52:10.660003 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 438/743] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:10 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:10.796581 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-476cc3b2-2398-4018-b98b-519e79a0996a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.540620 Oct 10 18:52:10.803875 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 306/744] 10.222.0.43 () {58 vars in 1125 bytes} [Mon Oct 10 18:52:10 2022] GET /compute/v2.1/servers => generated 1001 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:10.803875 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-26ebb5d8-da49-4d76-98f0-cc482305166e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:10.808095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-26ebb5d8-da49-4d76-98f0-cc482305166e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:10.811273 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26ebb5d8-da49-4d76-98f0-cc482305166e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:10.811964 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26ebb5d8-da49-4d76-98f0-cc482305166e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:10.813110 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26ebb5d8-da49-4d76-98f0-cc482305166e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:10.814052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26ebb5d8-da49-4d76-98f0-cc482305166e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:10.814698 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26ebb5d8-da49-4d76-98f0-cc482305166e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:10.815859 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26ebb5d8-da49-4d76-98f0-cc482305166e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:10.983860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ff2f1f3a-4cb0-4f3c-9cca-6171651946e9 tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] Action: 'create', calling method: .version_select at 0x7f318e2ccf70>, body: {"pool": null} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:11.602051 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-26ebb5d8-da49-4d76-98f0-cc482305166e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:11.616783 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-26ebb5d8-da49-4d76-98f0-cc482305166e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1314 microversion: 2.1 time: 0.816994 Oct 10 18:52:11.618386 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 307/745] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:10 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1314 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:11.625177 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f2736936-7fa1-4062-a620-765f25a8b9b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:11.626513 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f2736936-7fa1-4062-a620-765f25a8b9b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:11.815198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f2736936-7fa1-4062-a620-765f25a8b9b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:11.831402 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f2736936-7fa1-4062-a620-765f25a8b9b4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 200 len: 1218 microversion: 2.1 time: 0.203178 Oct 10 18:52:11.832477 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 308/746] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:11 2022] GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 1218 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:11.858644 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b60a7fa4-4391-43ea-bcea-30ef4f8d6bd6 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:11.858644 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b60a7fa4-4391-43ea-bcea-30ef4f8d6bd6 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:11.864452 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b60a7fa4-4391-43ea-bcea-30ef4f8d6bd6 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:11.864963 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b60a7fa4-4391-43ea-bcea-30ef4f8d6bd6 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:11.865388 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b60a7fa4-4391-43ea-bcea-30ef4f8d6bd6 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:11.866298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b60a7fa4-4391-43ea-bcea-30ef4f8d6bd6 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:11.866773 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b60a7fa4-4391-43ea-bcea-30ef4f8d6bd6 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:11.867169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b60a7fa4-4391-43ea-bcea-30ef4f8d6bd6 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:12.629159 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b60a7fa4-4391-43ea-bcea-30ef4f8d6bd6 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:12.638255 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b60a7fa4-4391-43ea-bcea-30ef4f8d6bd6 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1503 microversion: 2.1 time: 0.792124 Oct 10 18:52:12.639067 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 309/747] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:11 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1503 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:12.648025 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ec1f16b1-ba2a-41e2-a94d-6833963a2c27 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:12.650982 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ec1f16b1-ba2a-41e2-a94d-6833963a2c27 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:12.660700 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec1f16b1-ba2a-41e2-a94d-6833963a2c27 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:12.663542 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec1f16b1-ba2a-41e2-a94d-6833963a2c27 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:12.668245 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec1f16b1-ba2a-41e2-a94d-6833963a2c27 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:12.669230 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec1f16b1-ba2a-41e2-a94d-6833963a2c27 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:12.672810 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec1f16b1-ba2a-41e2-a94d-6833963a2c27 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:12.674101 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec1f16b1-ba2a-41e2-a94d-6833963a2c27 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:12.946855 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ec1f16b1-ba2a-41e2-a94d-6833963a2c27 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:12.957497 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ec1f16b1-ba2a-41e2-a94d-6833963a2c27 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1314 microversion: 2.1 time: 0.316726 Oct 10 18:52:12.958088 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 310/748] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:12 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:12.984295 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cc06fe94-8ac6-49ad-87cc-cfa21355942a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1559325330"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:12.993173 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cc06fe94-8ac6-49ad-87cc-cfa21355942a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:13.021891 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc06fe94-8ac6-49ad-87cc-cfa21355942a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:13.022755 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc06fe94-8ac6-49ad-87cc-cfa21355942a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:13.024008 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc06fe94-8ac6-49ad-87cc-cfa21355942a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:13.025166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc06fe94-8ac6-49ad-87cc-cfa21355942a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:13.026817 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc06fe94-8ac6-49ad-87cc-cfa21355942a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:13.027773 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc06fe94-8ac6-49ad-87cc-cfa21355942a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:13.420397 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.network.security_group_api [None req-cc06fe94-8ac6-49ad-87cc-cfa21355942a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Adding security group 50949f81-b1cd-469d-b594-bb9f293a7473 to port 262c829d-3cff-42ed-af35-b1a9a1cfab8d Oct 10 18:52:15.468477 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cc06fe94-8ac6-49ad-87cc-cfa21355942a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b/action" status: 202 len: 0 microversion: 2.1 time: 2.507495 Oct 10 18:52:15.469539 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 311/749] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:52:12 2022] POST /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b/action => generated 0 bytes in 2509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:52:15.475222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fd15933b-4f44-4ef2-bc1c-8f3705e669a8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:15.475222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fd15933b-4f44-4ef2-bc1c-8f3705e669a8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:15.485942 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd15933b-4f44-4ef2-bc1c-8f3705e669a8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:15.486277 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd15933b-4f44-4ef2-bc1c-8f3705e669a8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:15.499289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd15933b-4f44-4ef2-bc1c-8f3705e669a8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:15.500221 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd15933b-4f44-4ef2-bc1c-8f3705e669a8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:15.501824 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd15933b-4f44-4ef2-bc1c-8f3705e669a8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:15.502267 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd15933b-4f44-4ef2-bc1c-8f3705e669a8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:15.734175 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fd15933b-4f44-4ef2-bc1c-8f3705e669a8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:15.766523 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fd15933b-4f44-4ef2-bc1c-8f3705e669a8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 200 len: 1270 microversion: 2.1 time: 0.295690 Oct 10 18:52:15.773967 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 312/750] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:15 2022] GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 1270 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:15.784317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-637db10b-caab-4f1a-ba33-a37ba5678e09 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:15.784950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-637db10b-caab-4f1a-ba33-a37ba5678e09 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:15.795072 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-637db10b-caab-4f1a-ba33-a37ba5678e09 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:15.795831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-637db10b-caab-4f1a-ba33-a37ba5678e09 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:15.796470 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-637db10b-caab-4f1a-ba33-a37ba5678e09 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:15.797546 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-637db10b-caab-4f1a-ba33-a37ba5678e09 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:15.798153 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-637db10b-caab-4f1a-ba33-a37ba5678e09 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:15.798728 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-637db10b-caab-4f1a-ba33-a37ba5678e09 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:16.082036 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-637db10b-caab-4f1a-ba33-a37ba5678e09 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:16.095750 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-637db10b-caab-4f1a-ba33-a37ba5678e09 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1314 microversion: 2.1 time: 0.320238 Oct 10 18:52:16.096482 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 313/751] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:15 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:16.104508 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-38c78369-fcd4-486b-b33f-848e4d2b1fa3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1963219363"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:16.105505 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-38c78369-fcd4-486b-b33f-848e4d2b1fa3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:16.115388 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-38c78369-fcd4-486b-b33f-848e4d2b1fa3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:16.115879 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-38c78369-fcd4-486b-b33f-848e4d2b1fa3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:16.116310 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-38c78369-fcd4-486b-b33f-848e4d2b1fa3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:16.117044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-38c78369-fcd4-486b-b33f-848e4d2b1fa3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:16.117491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-38c78369-fcd4-486b-b33f-848e4d2b1fa3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:16.118086 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-38c78369-fcd4-486b-b33f-848e4d2b1fa3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:16.658887 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.network.security_group_api [None req-38c78369-fcd4-486b-b33f-848e4d2b1fa3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Adding security group e501335c-edbe-4587-af16-cc9a15683827 to port 262c829d-3cff-42ed-af35-b1a9a1cfab8d Oct 10 18:52:16.786198 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ff2f1f3a-4cb0-4f3c-9cca-6171651946e9 tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.096870 Oct 10 18:52:16.789207 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 439/752] 10.222.0.43 () {60 vars in 1170 bytes} [Mon Oct 10 18:52:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:16.811914 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-28b0fc6d-8f3d-4d2c-a3c5-d136624c8fab req-ae337128-5b9a-4fed-8b5b-2b1c4f6fb21a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d7e0b3-09b9-43cd-a996-c33d4bed703b", "tag": "262c829d-3cff-42ed-af35-b1a9a1cfab8d"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:16.851812 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-28b0fc6d-8f3d-4d2c-a3c5-d136624c8fab req-ae337128-5b9a-4fed-8b5b-2b1c4f6fb21a service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:16.852290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-28b0fc6d-8f3d-4d2c-a3c5-d136624c8fab req-ae337128-5b9a-4fed-8b5b-2b1c4f6fb21a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:16.852775 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-28b0fc6d-8f3d-4d2c-a3c5-d136624c8fab req-ae337128-5b9a-4fed-8b5b-2b1c4f6fb21a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:16.865912 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-28b0fc6d-8f3d-4d2c-a3c5-d136624c8fab req-ae337128-5b9a-4fed-8b5b-2b1c4f6fb21a service nova] Creating event network-changed:262c829d-3cff-42ed-af35-b1a9a1cfab8d for instance 17d7e0b3-09b9-43cd-a996-c33d4bed703b on n-h2-860863-1 Oct 10 18:52:16.873014 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-28b0fc6d-8f3d-4d2c-a3c5-d136624c8fab req-ae337128-5b9a-4fed-8b5b-2b1c4f6fb21a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071709 Oct 10 18:52:16.874318 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 440/753] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:16.906010 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a22c846a-d46d-4329-acc9-75c3928ea10d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:16.907005 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a22c846a-d46d-4329-acc9-75c3928ea10d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:16.915269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a22c846a-d46d-4329-acc9-75c3928ea10d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:16.916020 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a22c846a-d46d-4329-acc9-75c3928ea10d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:16.916628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a22c846a-d46d-4329-acc9-75c3928ea10d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:16.917487 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a22c846a-d46d-4329-acc9-75c3928ea10d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:16.918809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a22c846a-d46d-4329-acc9-75c3928ea10d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:16.919393 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a22c846a-d46d-4329-acc9-75c3928ea10d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:17.147773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a22c846a-d46d-4329-acc9-75c3928ea10d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:17.157772 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a22c846a-d46d-4329-acc9-75c3928ea10d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 200 len: 1276 microversion: 2.1 time: 0.281901 Oct 10 18:52:17.158380 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 441/754] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:16 2022] GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 1276 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:17.172580 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-604b80b6-fa9c-4ee3-bcae-2ea2b64a02b2 tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] Action: 'create', calling method: .version_select at 0x7f318e2c5820>, body: {"pool": null} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:18.091248 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-38c78369-fcd4-486b-b33f-848e4d2b1fa3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b/action" status: 202 len: 0 microversion: 2.1 time: 1.993499 Oct 10 18:52:18.094985 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 314/755] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:52:16 2022] POST /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b/action => generated 0 bytes in 1996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:52:18.098386 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4c1134e3-4882-4e99-a71b-99b205c1cee4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:18.098999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4c1134e3-4882-4e99-a71b-99b205c1cee4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:18.107807 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c1134e3-4882-4e99-a71b-99b205c1cee4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:18.115095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c1134e3-4882-4e99-a71b-99b205c1cee4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:18.115095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c1134e3-4882-4e99-a71b-99b205c1cee4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:18.115095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c1134e3-4882-4e99-a71b-99b205c1cee4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:18.115095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c1134e3-4882-4e99-a71b-99b205c1cee4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:18.115095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c1134e3-4882-4e99-a71b-99b205c1cee4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:19.006715 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4c1134e3-4882-4e99-a71b-99b205c1cee4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:19.031470 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4c1134e3-4882-4e99-a71b-99b205c1cee4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1314 microversion: 2.1 time: 0.937072 Oct 10 18:52:19.032067 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 315/756] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:18 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:19.052523 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-990a4dbd-7105-4944-85ba-3d9cae0e8460 req-efa30a90-6d1f-4c40-8915-c7e412e62122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3624eba-30d5-486c-8753-86e4277189ff", "name": "network-vif-plugged", "status": "completed", "tag": "877788c4-8817-4a16-9c01-e7dd796eebdd"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:19.066842 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-990a4dbd-7105-4944-85ba-3d9cae0e8460 req-efa30a90-6d1f-4c40-8915-c7e412e62122 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:19.067809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-990a4dbd-7105-4944-85ba-3d9cae0e8460 req-efa30a90-6d1f-4c40-8915-c7e412e62122 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:19.068407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-990a4dbd-7105-4944-85ba-3d9cae0e8460 req-efa30a90-6d1f-4c40-8915-c7e412e62122 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:19.099076 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-990a4dbd-7105-4944-85ba-3d9cae0e8460 req-efa30a90-6d1f-4c40-8915-c7e412e62122 service nova] Creating event network-vif-plugged:877788c4-8817-4a16-9c01-e7dd796eebdd for instance d3624eba-30d5-486c-8753-86e4277189ff on n-h1-860863-1 Oct 10 18:52:19.113109 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-990a4dbd-7105-4944-85ba-3d9cae0e8460 req-efa30a90-6d1f-4c40-8915-c7e412e62122 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066125 Oct 10 18:52:19.114842 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 316/757] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:19.146539 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cb8bc61b-6a90-4e47-b181-2b7ad90db475 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:19.146539 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cb8bc61b-6a90-4e47-b181-2b7ad90db475 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:19.172751 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cb8bc61b-6a90-4e47-b181-2b7ad90db475 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:19.173149 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cb8bc61b-6a90-4e47-b181-2b7ad90db475 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:19.176596 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cb8bc61b-6a90-4e47-b181-2b7ad90db475 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:19.177633 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cb8bc61b-6a90-4e47-b181-2b7ad90db475 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:19.178320 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cb8bc61b-6a90-4e47-b181-2b7ad90db475 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:19.180426 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cb8bc61b-6a90-4e47-b181-2b7ad90db475 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:19.198945 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:19.628388 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cb8bc61b-6a90-4e47-b181-2b7ad90db475 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.512108 Oct 10 18:52:19.643210 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 317/758] 10.222.0.43 () {58 vars in 1293 bytes} [Mon Oct 10 18:52:19 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b/os-security-groups => generated 1159 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:19.651628 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f69bceb4-6ee5-4f1b-a5e9-d92cd5b1dc15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:19.655735 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f69bceb4-6ee5-4f1b-a5e9-d92cd5b1dc15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:19.667744 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f69bceb4-6ee5-4f1b-a5e9-d92cd5b1dc15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:19.668248 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f69bceb4-6ee5-4f1b-a5e9-d92cd5b1dc15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:19.673368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f69bceb4-6ee5-4f1b-a5e9-d92cd5b1dc15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:19.674374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f69bceb4-6ee5-4f1b-a5e9-d92cd5b1dc15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:19.674979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f69bceb4-6ee5-4f1b-a5e9-d92cd5b1dc15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:19.675437 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f69bceb4-6ee5-4f1b-a5e9-d92cd5b1dc15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:20.159353 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f69bceb4-6ee5-4f1b-a5e9-d92cd5b1dc15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:20.195491 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f69bceb4-6ee5-4f1b-a5e9-d92cd5b1dc15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 200 len: 1318 microversion: 2.1 time: 0.548936 Oct 10 18:52:20.204475 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 318/759] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:19 2022] GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:20.221338 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-d7d91678-a5ae-4a9d-bc72-66850104bfd1 req-388a7602-8811-4d61-85fe-f7b10e1fb5af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d7e0b3-09b9-43cd-a996-c33d4bed703b", "tag": "262c829d-3cff-42ed-af35-b1a9a1cfab8d"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:20.243571 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d7d91678-a5ae-4a9d-bc72-66850104bfd1 req-388a7602-8811-4d61-85fe-f7b10e1fb5af service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:20.249454 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d7d91678-a5ae-4a9d-bc72-66850104bfd1 req-388a7602-8811-4d61-85fe-f7b10e1fb5af service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:20.267316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d7d91678-a5ae-4a9d-bc72-66850104bfd1 req-388a7602-8811-4d61-85fe-f7b10e1fb5af service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:20.284589 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-d7d91678-a5ae-4a9d-bc72-66850104bfd1 req-388a7602-8811-4d61-85fe-f7b10e1fb5af service nova] Creating event network-changed:262c829d-3cff-42ed-af35-b1a9a1cfab8d for instance 17d7e0b3-09b9-43cd-a996-c33d4bed703b on n-h2-860863-1 Oct 10 18:52:20.299102 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-d7d91678-a5ae-4a9d-bc72-66850104bfd1 req-388a7602-8811-4d61-85fe-f7b10e1fb5af service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092959 Oct 10 18:52:20.304068 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 319/760] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:20.312288 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b57533f8-b0c6-49d6-abcc-170ad81324f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'create', calling method: .version_select at 0x7f318e2a6160>, body: {"security_group": {"name": " tempest-securitygroup -27977468 ", "description": "tempest-description-1478467292"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:20.399113 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=4 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:21.820336 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=32 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:22.067336 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b57533f8-b0c6-49d6-abcc-170ad81324f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 1.760335 Oct 10 18:52:22.068856 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 320/761] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:52:20 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:22.082064 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-02121a0f-acb9-4a45-a7a5-1e7eb97d13f1 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:22.088904 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-02121a0f-acb9-4a45-a7a5-1e7eb97d13f1 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:22.095683 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02121a0f-acb9-4a45-a7a5-1e7eb97d13f1 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:22.096512 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02121a0f-acb9-4a45-a7a5-1e7eb97d13f1 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:22.097263 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02121a0f-acb9-4a45-a7a5-1e7eb97d13f1 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:22.098360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02121a0f-acb9-4a45-a7a5-1e7eb97d13f1 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:22.099131 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02121a0f-acb9-4a45-a7a5-1e7eb97d13f1 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:22.101055 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02121a0f-acb9-4a45-a7a5-1e7eb97d13f1 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:22.605839 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-02121a0f-acb9-4a45-a7a5-1e7eb97d13f1 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:22.629396 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-02121a0f-acb9-4a45-a7a5-1e7eb97d13f1 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1314 microversion: 2.1 time: 0.553775 Oct 10 18:52:22.631993 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 321/762] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:22 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:22.642120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6a616baf-e157-4e52-8a98-335a6cab1aa9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:22.642931 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6a616baf-e157-4e52-8a98-335a6cab1aa9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:22.676823 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a616baf-e157-4e52-8a98-335a6cab1aa9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:22.692113 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a616baf-e157-4e52-8a98-335a6cab1aa9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:22.693765 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a616baf-e157-4e52-8a98-335a6cab1aa9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:22.697231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a616baf-e157-4e52-8a98-335a6cab1aa9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:22.697701 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a616baf-e157-4e52-8a98-335a6cab1aa9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:22.698138 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a616baf-e157-4e52-8a98-335a6cab1aa9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:23.535092 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6a616baf-e157-4e52-8a98-335a6cab1aa9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:23.560604 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6a616baf-e157-4e52-8a98-335a6cab1aa9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 200 len: 1318 microversion: 2.1 time: 0.927170 Oct 10 18:52:23.561746 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 322/763] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:22 2022] GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 1318 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:23.566486 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ffb9c2df-ca27-432e-a7ed-9a0c89275589 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318e2a6670>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:23.753301 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ffb9c2df-ca27-432e-a7ed-9a0c89275589 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/0b702303-0b59-4872-9d04-3c7865319289" status: 200 len: 222 microversion: 2.1 time: 0.189595 Oct 10 18:52:23.765122 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 323/764] 10.222.0.43 () {58 vars in 1269 bytes} [Mon Oct 10 18:52:23 2022] GET /compute/v2.1/os-security-groups/0b702303-0b59-4872-9d04-3c7865319289 => generated 222 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:23.770672 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-6e2fe80c-7e0c-437e-905a-2af9ca97f3c5 req-ec8753a0-0ed1-4ffd-9732-f7b12772640b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f13450-d68f-4d4a-a1fd-c2da9dfd523f", "tag": "3d9104eb-ed91-4902-9529-aba084d49c09"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:23.782885 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6e2fe80c-7e0c-437e-905a-2af9ca97f3c5 req-ec8753a0-0ed1-4ffd-9732-f7b12772640b service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:23.783512 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6e2fe80c-7e0c-437e-905a-2af9ca97f3c5 req-ec8753a0-0ed1-4ffd-9732-f7b12772640b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:23.784055 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6e2fe80c-7e0c-437e-905a-2af9ca97f3c5 req-ec8753a0-0ed1-4ffd-9732-f7b12772640b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:23.796644 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-6e2fe80c-7e0c-437e-905a-2af9ca97f3c5 req-ec8753a0-0ed1-4ffd-9732-f7b12772640b service nova] Creating event network-changed:3d9104eb-ed91-4902-9529-aba084d49c09 for instance 24f13450-d68f-4d4a-a1fd-c2da9dfd523f on n-h2-860863-1 Oct 10 18:52:23.801409 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-6e2fe80c-7e0c-437e-905a-2af9ca97f3c5 req-ec8753a0-0ed1-4ffd-9732-f7b12772640b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034976 Oct 10 18:52:23.802150 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 324/765] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:23.809919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-7c801811-33bf-472e-8e5a-e33caa574bc4 req-c9899311-c420-4791-8c2f-9dd3cd1ff191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01ef8a6-60ce-4468-a0e9-6a33c3392761", "name": "network-vif-plugged", "status": "completed", "tag": "69b5aea1-483c-4645-b02d-ca80e77bdc38"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:23.823118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7c801811-33bf-472e-8e5a-e33caa574bc4 req-c9899311-c420-4791-8c2f-9dd3cd1ff191 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:23.823848 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7c801811-33bf-472e-8e5a-e33caa574bc4 req-c9899311-c420-4791-8c2f-9dd3cd1ff191 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:23.824516 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7c801811-33bf-472e-8e5a-e33caa574bc4 req-c9899311-c420-4791-8c2f-9dd3cd1ff191 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:23.837918 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-7c801811-33bf-472e-8e5a-e33caa574bc4 req-c9899311-c420-4791-8c2f-9dd3cd1ff191 service nova] Creating event network-vif-plugged:69b5aea1-483c-4645-b02d-ca80e77bdc38 for instance f01ef8a6-60ce-4468-a0e9-6a33c3392761 on n-h1-860863-1 Oct 10 18:52:23.843504 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-7c801811-33bf-472e-8e5a-e33caa574bc4 req-c9899311-c420-4791-8c2f-9dd3cd1ff191 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039690 Oct 10 18:52:23.844586 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 325/766] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:23.851439 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1853c249-ecc6-4952-9b90-c68abf75dad5 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:23.852396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1853c249-ecc6-4952-9b90-c68abf75dad5 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:23.858168 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-604b80b6-fa9c-4ee3-bcae-2ea2b64a02b2 tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.692751 Oct 10 18:52:23.861440 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 442/767] 10.222.0.43 () {60 vars in 1170 bytes} [Mon Oct 10 18:52:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:23.862205 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1853c249-ecc6-4952-9b90-c68abf75dad5 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:23.862918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1853c249-ecc6-4952-9b90-c68abf75dad5 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:23.863543 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1853c249-ecc6-4952-9b90-c68abf75dad5 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:23.864324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1853c249-ecc6-4952-9b90-c68abf75dad5 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:23.864886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1853c249-ecc6-4952-9b90-c68abf75dad5 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:23.865368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1853c249-ecc6-4952-9b90-c68abf75dad5 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:23.877432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-66d96551-7163-4129-95b6-f28ac3c7e2ca tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:23.890263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-66d96551-7163-4129-95b6-f28ac3c7e2ca tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:23.891117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-66d96551-7163-4129-95b6-f28ac3c7e2ca tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Searching by: {'deleted': False, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:52:23.911429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-66d96551-7163-4129-95b6-f28ac3c7e2ca tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:23.913482 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-66d96551-7163-4129-95b6-f28ac3c7e2ca tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:23.913926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-66d96551-7163-4129-95b6-f28ac3c7e2ca tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:23.914683 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-66d96551-7163-4129-95b6-f28ac3c7e2ca tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:23.915141 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-66d96551-7163-4129-95b6-f28ac3c7e2ca tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:23.915568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-66d96551-7163-4129-95b6-f28ac3c7e2ca tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:24.035141 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-66d96551-7163-4129-95b6-f28ac3c7e2ca tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 18:52:24.149722 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-66d96551-7163-4129-95b6-f28ac3c7e2ca tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.285221 Oct 10 18:52:24.150626 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 443/768] 10.222.0.43 () {58 vars in 1125 bytes} [Mon Oct 10 18:52:23 2022] GET /compute/v2.1/servers => generated 340 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:24.155576 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d9f87e34-4cb8-4e0d-9b35-491bd0d73155 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318e2bea60>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:24.288254 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1853c249-ecc6-4952-9b90-c68abf75dad5 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:24.299147 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1853c249-ecc6-4952-9b90-c68abf75dad5 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1314 microversion: 2.1 time: 0.452190 Oct 10 18:52:24.318287 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 326/769] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:23 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:24.323720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-15afc2f1-a150-447a-a3c8-ec407eb8171e tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] Action: 'create', calling method: .version_select at 0x7f318e2a6b80>, body: {"pool": null} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:24.862443 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d9f87e34-4cb8-4e0d-9b35-491bd0d73155 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/0b702303-0b59-4872-9d04-3c7865319289" status: 202 len: 0 microversion: 2.1 time: 0.710034 Oct 10 18:52:24.864121 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 444/770] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:52:24 2022] DELETE /compute/v2.1/os-security-groups/0b702303-0b59-4872-9d04-3c7865319289 => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:52:24.874589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:24.881304 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:24.882176 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Searching by: {'deleted': False, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:52:24.903785 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:24.907137 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:24.907785 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:24.908684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:24.909538 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:24.910784 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:24.911460 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:25.024755 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 18:52:25.114357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:25.121029 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:25.121654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:25.122230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:25.587560 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-01bc43e5-83e8-4a49-a188-2fe8398e80c0 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.532382 Oct 10 18:52:25.587560 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 445/771] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:52:24 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:25.587560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d0ee5973-0a18-4feb-975a-d252e5bde7ee tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:25.587560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d0ee5973-0a18-4feb-975a-d252e5bde7ee tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:25.587560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0ee5973-0a18-4feb-975a-d252e5bde7ee tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:25.587560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0ee5973-0a18-4feb-975a-d252e5bde7ee tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:25.587560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0ee5973-0a18-4feb-975a-d252e5bde7ee tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:25.587560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0ee5973-0a18-4feb-975a-d252e5bde7ee tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:25.587560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0ee5973-0a18-4feb-975a-d252e5bde7ee tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:25.587560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0ee5973-0a18-4feb-975a-d252e5bde7ee tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:26.122860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d0ee5973-0a18-4feb-975a-d252e5bde7ee tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:26.138096 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d0ee5973-0a18-4feb-975a-d252e5bde7ee tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 200 len: 1318 microversion: 2.1 time: 0.736010 Oct 10 18:52:26.141849 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 446/772] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:25 2022] GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 1318 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:26.154411 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f685fe6c-6928-4bcd-8154-b1e539456d02 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318e2ceee0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:26.269669 n-d-860863-1 devstack@n-api.service[127288]: DEBUG neutronclient.v2_0.client [None req-f685fe6c-6928-4bcd-8154-b1e539456d02 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist", "detail": ""}} {{(pid=127288) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:52:26.270358 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.security_group_api [None req-f685fe6c-6928-4bcd-8154-b1e539456d02 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Neutron security group 0b702303-0b59-4872-9d04-3c7865319289 not found {{(pid=127288) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:52:26.271059 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-f685fe6c-6928-4bcd-8154-b1e539456d02 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist Oct 10 18:52:26.271059 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-bbbd53bb-9e96-49d5-b7d4-cd411f4315f1'] Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f685fe6c-6928-4bcd-8154-b1e539456d02 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-security-groups/0b702303-0b59-4872-9d04-3c7865319289 HTTP/1.1 Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: exception: Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-bbbd53bb-9e96-49d5-b7d4-cd411f4315f1'] Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '0b702303-0b59-4872-9d04-3c7865319289'} Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:52:26.274305 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbbd53bb-9e96-49d5-b7d4-cd411f4315f1'] Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbbd53bb-9e96-49d5-b7d4-cd411f4315f1'] Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbbd53bb-9e96-49d5-b7d4-cd411f4315f1'] Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbbd53bb-9e96-49d5-b7d4-cd411f4315f1'] Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f685fe6c-6928-4bcd-8154-b1e539456d02 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 404 to user: Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist Oct 10 18:52:26.279575 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-bbbd53bb-9e96-49d5-b7d4-cd411f4315f1'] {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:26.283636 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f685fe6c-6928-4bcd-8154-b1e539456d02 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/0b702303-0b59-4872-9d04-3c7865319289" status: 404 len: 194 microversion: 2.1 time: 0.138613 Oct 10 18:52:26.284360 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 447/773] 10.222.0.43 () {58 vars in 1269 bytes} [Mon Oct 10 18:52:26 2022] GET /compute/v2.1/os-security-groups/0b702303-0b59-4872-9d04-3c7865319289 => generated 194 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:52:26.293332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c72789ad-93c1-45a4-bcb8-6b28a49422b6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:26.302975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c72789ad-93c1-45a4-bcb8-6b28a49422b6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:26.311357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c72789ad-93c1-45a4-bcb8-6b28a49422b6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:26.313800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c72789ad-93c1-45a4-bcb8-6b28a49422b6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:26.313800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c72789ad-93c1-45a4-bcb8-6b28a49422b6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:26.317051 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c72789ad-93c1-45a4-bcb8-6b28a49422b6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:26.317796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c72789ad-93c1-45a4-bcb8-6b28a49422b6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:26.318469 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c72789ad-93c1-45a4-bcb8-6b28a49422b6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:26.323997 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:26.901822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c72789ad-93c1-45a4-bcb8-6b28a49422b6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:26.909926 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c72789ad-93c1-45a4-bcb8-6b28a49422b6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1463 microversion: 2.1 time: 0.624433 Oct 10 18:52:26.910517 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 448/774] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:26 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1463 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:26.933230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bc73f0fd-717a-4fae-b5ac-56d0872a129c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:26.941447 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bc73f0fd-717a-4fae-b5ac-56d0872a129c tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015488 Oct 10 18:52:26.947944 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 449/775] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:52:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:26.947944 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-39927f9b-7194-4646-9f44-f5429b3d37e6 req-71ac7f8d-b1ee-4e09-b028-8e8ca4a24fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b378d3-5727-40a4-b211-c0dbcdbe4d93", "tag": "673afa70-c6a7-45ff-8ba0-6d9a0316b758"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:26.958526 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-39927f9b-7194-4646-9f44-f5429b3d37e6 req-71ac7f8d-b1ee-4e09-b028-8e8ca4a24fa0 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:26.959010 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-39927f9b-7194-4646-9f44-f5429b3d37e6 req-71ac7f8d-b1ee-4e09-b028-8e8ca4a24fa0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:26.959452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-39927f9b-7194-4646-9f44-f5429b3d37e6 req-71ac7f8d-b1ee-4e09-b028-8e8ca4a24fa0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:26.972368 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-39927f9b-7194-4646-9f44-f5429b3d37e6 req-71ac7f8d-b1ee-4e09-b028-8e8ca4a24fa0 service nova] Creating event network-changed:673afa70-c6a7-45ff-8ba0-6d9a0316b758 for instance 95b378d3-5727-40a4-b211-c0dbcdbe4d93 on n-h2-860863-1 Oct 10 18:52:26.977663 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-39927f9b-7194-4646-9f44-f5429b3d37e6 req-71ac7f8d-b1ee-4e09-b028-8e8ca4a24fa0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034082 Oct 10 18:52:26.979130 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 450/776] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:27.057591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-703645761", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "4e9b6228-48e7-47ac-9317-a5a4457ef8ad"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:27.168618 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] validate_networks() for [('4e9b6228-48e7-47ac-9317-a5a4457ef8ad', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:52:27.489217 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-15afc2f1-a150-447a-a3c8-ec407eb8171e tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.169676 Oct 10 18:52:27.493177 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 327/777] 10.222.0.43 () {60 vars in 1170 bytes} [Mon Oct 10 18:52:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:27.496797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2ccafad9-87f6-49e3-b0dc-0610fe59a8f2 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'create', calling method: .version_select at 0x7f318e44b040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-228869958", "description": "tempest-description-1776306673"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:28.107147 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2ccafad9-87f6-49e3-b0dc-0610fe59a8f2 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.614143 Oct 10 18:52:28.108356 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 328/778] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:52:27 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:28.126644 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ebd64f0d-b2d3-4779-91ec-ba59e2f90bcf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:28.127333 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ebd64f0d-b2d3-4779-91ec-ba59e2f90bcf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:28.143602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ebd64f0d-b2d3-4779-91ec-ba59e2f90bcf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:28.144106 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ebd64f0d-b2d3-4779-91ec-ba59e2f90bcf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:28.144567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ebd64f0d-b2d3-4779-91ec-ba59e2f90bcf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:28.145310 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ebd64f0d-b2d3-4779-91ec-ba59e2f90bcf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:28.145761 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ebd64f0d-b2d3-4779-91ec-ba59e2f90bcf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:28.146178 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ebd64f0d-b2d3-4779-91ec-ba59e2f90bcf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:28.429485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:52:28.431341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:52:28.432025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:52:28.432696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:52:28.433292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:52:28.450895 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:28.451777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:28.452667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:28.453840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:28.455192 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:28.455921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:28.493535 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Getting quotas for project 8ca11fe18cc64adfbc06166601106c7c. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:28.500488 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Getting quotas for user 789ef7a66ff042b9abebe36823008f8f and project 8ca11fe18cc64adfbc06166601106c7c. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:28.523777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:52:28.529967 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:52:28.615047 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ebd64f0d-b2d3-4779-91ec-ba59e2f90bcf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:28.629713 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ebd64f0d-b2d3-4779-91ec-ba59e2f90bcf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1464 microversion: 2.1 time: 0.519626 Oct 10 18:52:28.645994 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 329/779] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:28 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1464 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:28.701254 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c5b896a0-bc24-42f1-afa7-1c7d6c91116f tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:28.701254 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c5b896a0-bc24-42f1-afa7-1c7d6c91116f tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:28.712703 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7b49dd42-de0e-4936-a963-4e1ce3d2632a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.732289 Oct 10 18:52:28.719821 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c5b896a0-bc24-42f1-afa7-1c7d6c91116f tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:28.724828 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 451/780] 10.222.0.43 () {62 vars in 1188 bytes} [Mon Oct 10 18:52:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 18:52:28.731140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c5b896a0-bc24-42f1-afa7-1c7d6c91116f tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:28.735521 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c5b896a0-bc24-42f1-afa7-1c7d6c91116f tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:28.735521 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c5b896a0-bc24-42f1-afa7-1c7d6c91116f tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:28.741320 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c5b896a0-bc24-42f1-afa7-1c7d6c91116f tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:28.744288 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c5b896a0-bc24-42f1-afa7-1c7d6c91116f tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:28.751476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9aa5ce1c-d957-4b99-b585-d1df3bb096ef tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:28.753177 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9aa5ce1c-d957-4b99-b585-d1df3bb096ef tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:28.786798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9aa5ce1c-d957-4b99-b585-d1df3bb096ef tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:28.792911 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9aa5ce1c-d957-4b99-b585-d1df3bb096ef tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:28.793615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9aa5ce1c-d957-4b99-b585-d1df3bb096ef tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:28.794582 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9aa5ce1c-d957-4b99-b585-d1df3bb096ef tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:28.795260 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9aa5ce1c-d957-4b99-b585-d1df3bb096ef tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:28.795910 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9aa5ce1c-d957-4b99-b585-d1df3bb096ef tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:28.850152 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9aa5ce1c-d957-4b99-b585-d1df3bb096ef tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:52:29.212898 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9aa5ce1c-d957-4b99-b585-d1df3bb096ef tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 204 len: 0 microversion: 2.1 time: 0.479528 Oct 10 18:52:29.213716 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 452/781] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:52:28 2022] DELETE /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:52:29.220312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b2519b80-151a-428e-866a-9a16e3266bb2 tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] Action: 'create', calling method: .version_select at 0x7f318e4df160>, body: {"pool": null} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:29.582716 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c5b896a0-bc24-42f1-afa7-1c7d6c91116f tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:29.597680 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c5b896a0-bc24-42f1-afa7-1c7d6c91116f tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 200 len: 1318 microversion: 2.1 time: 0.949444 Oct 10 18:52:29.613022 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 330/782] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:28 2022] GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 1318 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:29.636618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-019d9597-9fbc-46f6-8585-77f08b13956b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'create', calling method: .version_select at 0x7f318e1a6a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-881066975", "description": "tempest-description-1882731305"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:30.640190 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-019d9597-9fbc-46f6-8585-77f08b13956b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.025230 Oct 10 18:52:30.641431 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 331/783] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:52:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:30.652351 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9f15c0cc-4910-4077-8f8a-440191f945ad tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:30.658825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9f15c0cc-4910-4077-8f8a-440191f945ad tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:30.680063 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9f15c0cc-4910-4077-8f8a-440191f945ad tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:30.682963 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9f15c0cc-4910-4077-8f8a-440191f945ad tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:30.683457 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9f15c0cc-4910-4077-8f8a-440191f945ad tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:30.684292 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9f15c0cc-4910-4077-8f8a-440191f945ad tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:30.684810 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9f15c0cc-4910-4077-8f8a-440191f945ad tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:30.685449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9f15c0cc-4910-4077-8f8a-440191f945ad tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:30.900388 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9f15c0cc-4910-4077-8f8a-440191f945ad tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:30.912944 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9f15c0cc-4910-4077-8f8a-440191f945ad tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:30.918969 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9f15c0cc-4910-4077-8f8a-440191f945ad tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:30.920803 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9f15c0cc-4910-4077-8f8a-440191f945ad tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1265 microversion: 2.25 time: 0.278408 Oct 10 18:52:30.925067 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 332/784] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:52:30 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:52:30.937460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-516869491", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d3624eba-30d5-486c-8753-86e4277189ff"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:31.047969 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] validate_networks() for None {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:52:31.740486 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:52:31.741647 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:52:31.746877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:52:31.746877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:52:31.746877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:52:31.766823 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:31.766823 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:31.766823 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:31.766823 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:31.767788 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:31.768368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:31.808231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Getting quotas for project b15c92e4a6804ff5ba5d91c342f6c529. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:31.817009 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Getting quotas for user 53de519302254009b38a5324f76a1e92 and project b15c92e4a6804ff5ba5d91c342f6c529. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:31.850516 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:52:31.853105 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:52:31.978020 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-76c28ada-3a90-4ae9-9265-fffbfdcac195 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051415 Oct 10 18:52:31.988025 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 333/785] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:52:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:52:31.996059 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-90ac5106-efd2-4885-849d-e741ade08d58 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:31.996990 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-90ac5106-efd2-4885-849d-e741ade08d58 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:32.042219 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90ac5106-efd2-4885-849d-e741ade08d58 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:32.043525 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90ac5106-efd2-4885-849d-e741ade08d58 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:32.044150 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90ac5106-efd2-4885-849d-e741ade08d58 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:32.045201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90ac5106-efd2-4885-849d-e741ade08d58 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:32.045883 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90ac5106-efd2-4885-849d-e741ade08d58 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:32.048470 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90ac5106-efd2-4885-849d-e741ade08d58 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:32.687126 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-90ac5106-efd2-4885-849d-e741ade08d58 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:32.697570 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-90ac5106-efd2-4885-849d-e741ade08d58 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1715 microversion: 2.1 time: 0.708242 Oct 10 18:52:32.699180 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 334/786] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:31 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1715 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:32.707709 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-670e45dc-eb41-4f35-b432-61cbf9109469 req-3f771ea3-5a52-4c0a-83bd-8b10b75381c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f13450-d68f-4d4a-a1fd-c2da9dfd523f", "name": "network-vif-plugged", "status": "completed", "tag": "3d9104eb-ed91-4902-9529-aba084d49c09"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:32.736354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-670e45dc-eb41-4f35-b432-61cbf9109469 req-3f771ea3-5a52-4c0a-83bd-8b10b75381c8 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:32.736354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-670e45dc-eb41-4f35-b432-61cbf9109469 req-3f771ea3-5a52-4c0a-83bd-8b10b75381c8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:32.737299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-670e45dc-eb41-4f35-b432-61cbf9109469 req-3f771ea3-5a52-4c0a-83bd-8b10b75381c8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:32.767087 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-670e45dc-eb41-4f35-b432-61cbf9109469 req-3f771ea3-5a52-4c0a-83bd-8b10b75381c8 service nova] Creating event network-vif-plugged:3d9104eb-ed91-4902-9529-aba084d49c09 for instance 24f13450-d68f-4d4a-a1fd-c2da9dfd523f on n-h2-860863-1 Oct 10 18:52:32.775128 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-670e45dc-eb41-4f35-b432-61cbf9109469 req-3f771ea3-5a52-4c0a-83bd-8b10b75381c8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074647 Oct 10 18:52:32.776562 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 335/787] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:32.787936 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c3da5360-2bb6-4792-bbc3-235948193bb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:32.787936 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c3da5360-2bb6-4792-bbc3-235948193bb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:32.796610 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c3da5360-2bb6-4792-bbc3-235948193bb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:32.797443 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c3da5360-2bb6-4792-bbc3-235948193bb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:32.798081 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c3da5360-2bb6-4792-bbc3-235948193bb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:32.798994 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c3da5360-2bb6-4792-bbc3-235948193bb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:32.799633 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c3da5360-2bb6-4792-bbc3-235948193bb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:32.800287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c3da5360-2bb6-4792-bbc3-235948193bb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:33.243724 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c3da5360-2bb6-4792-bbc3-235948193bb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:33.256795 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c3da5360-2bb6-4792-bbc3-235948193bb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 200 len: 1318 microversion: 2.1 time: 0.477313 Oct 10 18:52:33.258215 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 336/788] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:32 2022] GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:33.289334 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4b060080-ebef-408c-b118-52f2c45dd0e5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'create', calling method: .version_select at 0x7f318e2a6790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-641546151", "description": "tempest-description-811207106"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:33.371101 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b2519b80-151a-428e-866a-9a16e3266bb2 tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.155745 Oct 10 18:52:33.379205 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 453/789] 10.222.0.43 () {60 vars in 1170 bytes} [Mon Oct 10 18:52:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:33.388389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-57c45f42-9fe3-422e-9821-9d76bfbab35a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:33.391033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-57c45f42-9fe3-422e-9821-9d76bfbab35a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:33.400419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-57c45f42-9fe3-422e-9821-9d76bfbab35a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:33.401741 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-57c45f42-9fe3-422e-9821-9d76bfbab35a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:33.402641 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-57c45f42-9fe3-422e-9821-9d76bfbab35a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:33.403884 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-57c45f42-9fe3-422e-9821-9d76bfbab35a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:33.404581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-57c45f42-9fe3-422e-9821-9d76bfbab35a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:33.406053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-57c45f42-9fe3-422e-9821-9d76bfbab35a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:33.536115 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-57c45f42-9fe3-422e-9821-9d76bfbab35a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:33.555931 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-57c45f42-9fe3-422e-9821-9d76bfbab35a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:33.562405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-57c45f42-9fe3-422e-9821-9d76bfbab35a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:33.568786 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-57c45f42-9fe3-422e-9821-9d76bfbab35a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1319 microversion: 2.25 time: 0.185112 Oct 10 18:52:33.573884 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 454/790] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:52:33 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:52:33.592001 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d5e0f472-ffe3-4bc5-af28-343b19b58977 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:33.599030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d5e0f472-ffe3-4bc5-af28-343b19b58977 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:33.623049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d5e0f472-ffe3-4bc5-af28-343b19b58977 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:33.626382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d5e0f472-ffe3-4bc5-af28-343b19b58977 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:33.626847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d5e0f472-ffe3-4bc5-af28-343b19b58977 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:33.627699 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d5e0f472-ffe3-4bc5-af28-343b19b58977 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:33.628202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d5e0f472-ffe3-4bc5-af28-343b19b58977 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:33.628640 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d5e0f472-ffe3-4bc5-af28-343b19b58977 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:33.755878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d5e0f472-ffe3-4bc5-af28-343b19b58977 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:33.784970 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d5e0f472-ffe3-4bc5-af28-343b19b58977 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1209 microversion: 2.1 time: 0.208133 Oct 10 18:52:33.785770 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 455/791] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:33 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1209 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:33.790809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d446a451-1e07-42c8-a317-2c3ef1b84d5e tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] Calling method '.version_select at 0x7f318e51b040>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:34.024782 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4b060080-ebef-408c-b118-52f2c45dd0e5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.765272 Oct 10 18:52:34.025813 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 337/792] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:52:33 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:34.030938 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-7348e7f8-66e3-4956-bb63-5db184a3c35b req-c296c217-d539-423c-9727-58039b8f46aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6283d5d-8892-4104-8a03-572870613047", "name": "network-vif-deleted", "tag": "034630fa-5e8e-45c4-a128-ff0de6f706b1"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:34.062742 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7348e7f8-66e3-4956-bb63-5db184a3c35b req-c296c217-d539-423c-9727-58039b8f46aa service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:34.068785 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7348e7f8-66e3-4956-bb63-5db184a3c35b req-c296c217-d539-423c-9727-58039b8f46aa service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:34.070736 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7348e7f8-66e3-4956-bb63-5db184a3c35b req-c296c217-d539-423c-9727-58039b8f46aa service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:34.089242 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-7348e7f8-66e3-4956-bb63-5db184a3c35b req-c296c217-d539-423c-9727-58039b8f46aa service nova] Creating event network-vif-deleted:034630fa-5e8e-45c4-a128-ff0de6f706b1 for instance d6283d5d-8892-4104-8a03-572870613047 on n-h1-860863-1 Oct 10 18:52:34.103375 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-7348e7f8-66e3-4956-bb63-5db184a3c35b req-c296c217-d539-423c-9727-58039b8f46aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076252 Oct 10 18:52:34.104954 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 338/793] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:34.128363 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3b7cee14-cc41-41cf-8a41-cde0d36bb5e4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:34.128363 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3b7cee14-cc41-41cf-8a41-cde0d36bb5e4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:34.144423 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b7cee14-cc41-41cf-8a41-cde0d36bb5e4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:34.144985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b7cee14-cc41-41cf-8a41-cde0d36bb5e4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:34.145399 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b7cee14-cc41-41cf-8a41-cde0d36bb5e4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:34.146124 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b7cee14-cc41-41cf-8a41-cde0d36bb5e4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:34.146583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b7cee14-cc41-41cf-8a41-cde0d36bb5e4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:34.147011 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b7cee14-cc41-41cf-8a41-cde0d36bb5e4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:34.219502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b7cee14-cc41-41cf-8a41-cde0d36bb5e4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:34.220007 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b7cee14-cc41-41cf-8a41-cde0d36bb5e4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:34.220456 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b7cee14-cc41-41cf-8a41-cde0d36bb5e4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:34.220969 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-3b7cee14-cc41-41cf-8a41-cde0d36bb5e4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lazy-loading 'fault' on Instance uuid d6283d5d-8892-4104-8a03-572870613047 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:52:34.254989 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d446a451-1e07-42c8-a317-2c3ef1b84d5e tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/b550a0a7-b9a9-4329-af26-b4b03f1d8d71" status: 200 len: 142 microversion: 2.1 time: 0.467920 Oct 10 18:52:34.256286 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 456/794] 10.222.0.43 () {58 vars in 1260 bytes} [Mon Oct 10 18:52:33 2022] GET /compute/v2.1/os-floating-ips/b550a0a7-b9a9-4329-af26-b4b03f1d8d71 => generated 142 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:34.260848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ca6525df-cba0-4913-85bc-d8020cbbb75e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318e9a0790>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:34.359178 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3b7cee14-cc41-41cf-8a41-cde0d36bb5e4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ec15e796424161be9af968e6167528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ec8b0e87fd4e2c8d67076d2b8c797f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:34.366942 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3b7cee14-cc41-41cf-8a41-cde0d36bb5e4 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 200 len: 1368 microversion: 2.1 time: 0.260751 Oct 10 18:52:34.367576 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 339/795] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:34 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:34.378400 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c350de12-5e6d-4237-ab8a-116c66970042 tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] Calling method '.version_select at 0x7f318e2a6700>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:34.821605 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ca6525df-cba0-4913-85bc-d8020cbbb75e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.562559 Oct 10 18:52:34.825304 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 457/796] 10.222.0.43 () {58 vars in 1158 bytes} [Mon Oct 10 18:52:34 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:34.836850 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-13fcea43-d4cf-440c-9e62-7419b9a91f19 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:34.838952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-13fcea43-d4cf-440c-9e62-7419b9a91f19 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:34.849620 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-13fcea43-d4cf-440c-9e62-7419b9a91f19 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:34.850120 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-13fcea43-d4cf-440c-9e62-7419b9a91f19 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:34.850554 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-13fcea43-d4cf-440c-9e62-7419b9a91f19 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:34.851258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-13fcea43-d4cf-440c-9e62-7419b9a91f19 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:34.851710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-13fcea43-d4cf-440c-9e62-7419b9a91f19 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:34.852129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-13fcea43-d4cf-440c-9e62-7419b9a91f19 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:35.228716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-13fcea43-d4cf-440c-9e62-7419b9a91f19 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:35.239820 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-13fcea43-d4cf-440c-9e62-7419b9a91f19 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 200 len: 1318 microversion: 2.1 time: 0.413185 Oct 10 18:52:35.240414 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 458/797] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:34 2022] GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:35.248696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1ff49430-fe00-4ff9-b372-67e685e7a6f4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:35.263501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1ff49430-fe00-4ff9-b372-67e685e7a6f4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:35.273564 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ff49430-fe00-4ff9-b372-67e685e7a6f4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:35.277952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ff49430-fe00-4ff9-b372-67e685e7a6f4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:35.278659 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ff49430-fe00-4ff9-b372-67e685e7a6f4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:35.279617 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ff49430-fe00-4ff9-b372-67e685e7a6f4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:35.283864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ff49430-fe00-4ff9-b372-67e685e7a6f4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:35.285475 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ff49430-fe00-4ff9-b372-67e685e7a6f4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:35.524126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1ff49430-fe00-4ff9-b372-67e685e7a6f4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:35.533632 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1ff49430-fe00-4ff9-b372-67e685e7a6f4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:35.559405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1ff49430-fe00-4ff9-b372-67e685e7a6f4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:35.560642 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1ff49430-fe00-4ff9-b372-67e685e7a6f4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1361 microversion: 2.25 time: 0.316685 Oct 10 18:52:35.561234 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 459/798] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:52:35 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1361 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:52:35.585128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7b92a936-64a5-464b-84c3-b5993920d3ff tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:35.589212 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7b92a936-64a5-464b-84c3-b5993920d3ff tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:35.609396 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b92a936-64a5-464b-84c3-b5993920d3ff tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:35.610651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b92a936-64a5-464b-84c3-b5993920d3ff tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:35.612378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b92a936-64a5-464b-84c3-b5993920d3ff tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:35.613395 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b92a936-64a5-464b-84c3-b5993920d3ff tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:35.616216 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b92a936-64a5-464b-84c3-b5993920d3ff tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:35.618369 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b92a936-64a5-464b-84c3-b5993920d3ff tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:35.787052 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7b92a936-64a5-464b-84c3-b5993920d3ff tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:35.800148 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7b92a936-64a5-464b-84c3-b5993920d3ff tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1271 microversion: 2.1 time: 0.233511 Oct 10 18:52:35.805225 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 460/799] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:35 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:35.821987 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b269bbab-6517-4e8c-8f69-8237da69d8b3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318e329c10>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:36.246422 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b269bbab-6517-4e8c-8f69-8237da69d8b3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/8c05b064-8143-4e71-b66a-a28b12a746ce" status: 202 len: 0 microversion: 2.1 time: 0.439801 Oct 10 18:52:36.250970 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 461/800] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:52:35 2022] DELETE /compute/v2.1/os-security-groups/8c05b064-8143-4e71-b66a-a28b12a746ce => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:52:36.256405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-6a9c02d2-529a-4995-8b10-add3b30daede req-996f6ded-1864-4325-a874-ab649622425d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b378d3-5727-40a4-b211-c0dbcdbe4d93", "name": "network-vif-plugged", "status": "completed", "tag": "673afa70-c6a7-45ff-8ba0-6d9a0316b758"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:36.271216 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6a9c02d2-529a-4995-8b10-add3b30daede req-996f6ded-1864-4325-a874-ab649622425d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:36.272211 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6a9c02d2-529a-4995-8b10-add3b30daede req-996f6ded-1864-4325-a874-ab649622425d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:36.273104 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6a9c02d2-529a-4995-8b10-add3b30daede req-996f6ded-1864-4325-a874-ab649622425d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:36.288335 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-6a9c02d2-529a-4995-8b10-add3b30daede req-996f6ded-1864-4325-a874-ab649622425d service nova] Creating event network-vif-plugged:673afa70-c6a7-45ff-8ba0-6d9a0316b758 for instance 95b378d3-5727-40a4-b211-c0dbcdbe4d93 on n-h2-860863-1 Oct 10 18:52:36.294329 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-6a9c02d2-529a-4995-8b10-add3b30daede req-996f6ded-1864-4325-a874-ab649622425d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041873 Oct 10 18:52:36.298877 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 462/801] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:36.309888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-263c2fd6-3acf-4583-8023-3716df7a0599 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:36.312412 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-263c2fd6-3acf-4583-8023-3716df7a0599 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] [instance: d6283d5d-8892-4104-8a03-572870613047] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:36.321127 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-263c2fd6-3acf-4583-8023-3716df7a0599 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:36.324354 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-263c2fd6-3acf-4583-8023-3716df7a0599 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:36.327060 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-263c2fd6-3acf-4583-8023-3716df7a0599 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:36.328514 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-263c2fd6-3acf-4583-8023-3716df7a0599 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:36.329224 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-263c2fd6-3acf-4583-8023-3716df7a0599 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:36.329899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-263c2fd6-3acf-4583-8023-3716df7a0599 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:36.359176 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-263c2fd6-3acf-4583-8023-3716df7a0599 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] HTTP exception thrown: Instance d6283d5d-8892-4104-8a03-572870613047 could not be found. Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-263c2fd6-3acf-4583-8023-3716df7a0599 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Request method failure captured: Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 HTTP/1.1 Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGmtnd4vs3rCUpFxjb2IHyazLdm50jsmkXMH4diNxk7s3T-PFmV0HAQn_mYk7sm9t36mIXn_fqYRzSl9NAmZfPjRUbwkSaoTmo_tBsiih-t06H4VOPErIWuzqIuyrm4WJP5rdYfB15Gh5vBU373Kgr25QA0M52-MAcL0PzlWhRp-spg Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: f6ec8b0e87fd4e2c8d67076d2b8c797f Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersTestManualDisk-1164995218 Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f6ec8b0e87fd4e2c8d67076d2b8c797f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f6ec8b0e87fd4e2c8d67076d2b8c797f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6ec8b0e87fd4e2c8d67076d2b8c797f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6ec8b0e87fd4e2c8d67076d2b8c797f"}]}] Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersTestManualDisk-1164995218 Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: f6ec8b0e87fd4e2c8d67076d2b8c797f Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersTestManualDisk-1164995218 Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersTestManualDisk-1164995218-project Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: f9ec15e796424161be9af968e6167528 Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersTestManualDisk-1164995218-project Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance d6283d5d-8892-4104-8a03-572870613047 could not be found. Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'd6283d5d-8892-4104-8a03-572870613047'} Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6283d5d-8892-4104-8a03-572870613047 could not be found. Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6283d5d-8892-4104-8a03-572870613047 could not be found. Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:36.361281 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:36.368706 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:36.368706 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:36.368706 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:36.368706 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:36.368706 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:36.368706 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6283d5d-8892-4104-8a03-572870613047 could not be found. Oct 10 18:52:36.368706 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:36.368706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-263c2fd6-3acf-4583-8023-3716df7a0599 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Returning 404 to user: Instance d6283d5d-8892-4104-8a03-572870613047 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:36.368706 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-263c2fd6-3acf-4583-8023-3716df7a0599 tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047" status: 404 len: 111 microversion: 2.1 time: 0.070578 Oct 10 18:52:36.369905 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 463/802] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:36 2022] GET /compute/v2.1/servers/d6283d5d-8892-4104-8a03-572870613047 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:52:36.376784 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-4ce9f522-f714-4a75-a740-71d69d1e2405 req-ad10f6ac-0c27-46c0-ab55-3c39207db4ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fa4cba0-5184-462b-ab0b-c03f2a104ae6", "tag": "aa9423e0-a4d9-48ba-8535-6f8ecab069a0"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:36.389773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4ce9f522-f714-4a75-a740-71d69d1e2405 req-ad10f6ac-0c27-46c0-ab55-3c39207db4ee service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:36.389773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4ce9f522-f714-4a75-a740-71d69d1e2405 req-ad10f6ac-0c27-46c0-ab55-3c39207db4ee service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:36.389773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4ce9f522-f714-4a75-a740-71d69d1e2405 req-ad10f6ac-0c27-46c0-ab55-3c39207db4ee service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:36.407404 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-4ce9f522-f714-4a75-a740-71d69d1e2405 req-ad10f6ac-0c27-46c0-ab55-3c39207db4ee service nova] Creating event network-changed:aa9423e0-a4d9-48ba-8535-6f8ecab069a0 for instance 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 on n-h1-860863-1 Oct 10 18:52:36.413857 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-4ce9f522-f714-4a75-a740-71d69d1e2405 req-ad10f6ac-0c27-46c0-ab55-3c39207db4ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041566 Oct 10 18:52:36.414857 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 464/803] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:36.421174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c39c46f0-33e4-458c-9dbb-824f68cacb4e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318e264c10>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:36.489398 n-d-860863-1 devstack@n-api.service[127288]: DEBUG neutronclient.v2_0.client [None req-c39c46f0-33e4-458c-9dbb-824f68cacb4e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist", "detail": ""}} {{(pid=127288) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:52:36.490001 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.security_group_api [None req-c39c46f0-33e4-458c-9dbb-824f68cacb4e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Neutron security group 8c05b064-8143-4e71-b66a-a28b12a746ce not found {{(pid=127288) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:52:36.490543 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-c39c46f0-33e4-458c-9dbb-824f68cacb4e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist Oct 10 18:52:36.490543 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-50a95abe-b028-49ef-83d7-d77cfbdf0dd8'] Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c39c46f0-33e4-458c-9dbb-824f68cacb4e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-security-groups/8c05b064-8143-4e71-b66a-a28b12a746ce HTTP/1.1 Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: exception: Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-50a95abe-b028-49ef-83d7-d77cfbdf0dd8'] Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '8c05b064-8143-4e71-b66a-a28b12a746ce'} Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:52:36.493310 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50a95abe-b028-49ef-83d7-d77cfbdf0dd8'] Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50a95abe-b028-49ef-83d7-d77cfbdf0dd8'] Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50a95abe-b028-49ef-83d7-d77cfbdf0dd8'] Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50a95abe-b028-49ef-83d7-d77cfbdf0dd8'] Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c39c46f0-33e4-458c-9dbb-824f68cacb4e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 404 to user: Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-50a95abe-b028-49ef-83d7-d77cfbdf0dd8'] {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c39c46f0-33e4-458c-9dbb-824f68cacb4e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/8c05b064-8143-4e71-b66a-a28b12a746ce" status: 404 len: 194 microversion: 2.1 time: 0.079260 Oct 10 18:52:36.502460 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 465/804] 10.222.0.43 () {58 vars in 1269 bytes} [Mon Oct 10 18:52:36 2022] GET /compute/v2.1/os-security-groups/8c05b064-8143-4e71-b66a-a28b12a746ce => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:52:36.505673 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6f368ef8-bdf9-4d44-9484-689523dda9d0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:36.505673 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6f368ef8-bdf9-4d44-9484-689523dda9d0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:36.517126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6f368ef8-bdf9-4d44-9484-689523dda9d0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:36.517640 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6f368ef8-bdf9-4d44-9484-689523dda9d0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:36.518063 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6f368ef8-bdf9-4d44-9484-689523dda9d0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:36.518780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6f368ef8-bdf9-4d44-9484-689523dda9d0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:36.519232 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6f368ef8-bdf9-4d44-9484-689523dda9d0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:36.519665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6f368ef8-bdf9-4d44-9484-689523dda9d0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:36.778424 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6f368ef8-bdf9-4d44-9484-689523dda9d0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:36.793203 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6f368ef8-bdf9-4d44-9484-689523dda9d0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 200 len: 1318 microversion: 2.1 time: 0.292559 Oct 10 18:52:36.794746 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 466/805] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:36 2022] GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:36.800989 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-05aa452a-4a95-4754-a070-4794227ea49a tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] Calling method '.version_select at 0x7f318e2c5ca0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:36.880462 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-05aa452a-4a95-4754-a070-4794227ea49a tempest-ServersTestManualDisk-1164995218 tempest-ServersTestManualDisk-1164995218-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689307306" status: 202 len: 0 microversion: 2.1 time: 0.083663 Oct 10 18:52:36.881428 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 467/806] 10.222.0.43 () {58 vars in 1221 bytes} [Mon Oct 10 18:52:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689307306 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:52:36.886059 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ab7b3dd8-0af3-4cce-8dbc-e902ba6432e2 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318e2b61f0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:37.243346 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ab7b3dd8-0af3-4cce-8dbc-e902ba6432e2 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/630e2d17-25c5-4982-ab5c-ef81dd82e65a" status: 202 len: 0 microversion: 2.1 time: 0.360797 Oct 10 18:52:37.244231 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 468/807] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:52:36 2022] DELETE /compute/v2.1/os-security-groups/630e2d17-25c5-4982-ab5c-ef81dd82e65a => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:52:37.250429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4a4b1ebb-223b-4641-a43b-2e0de4bd513e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:37.251052 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4a4b1ebb-223b-4641-a43b-2e0de4bd513e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:37.256758 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c350de12-5e6d-4237-ab8a-116c66970042 tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/b550a0a7-b9a9-4329-af26-b4b03f1d8d71" status: 202 len: 0 microversion: 2.1 time: 2.888094 Oct 10 18:52:37.266071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a4b1ebb-223b-4641-a43b-2e0de4bd513e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:37.266071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a4b1ebb-223b-4641-a43b-2e0de4bd513e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:37.266071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a4b1ebb-223b-4641-a43b-2e0de4bd513e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:37.266071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a4b1ebb-223b-4641-a43b-2e0de4bd513e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:37.266071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a4b1ebb-223b-4641-a43b-2e0de4bd513e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:37.266071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a4b1ebb-223b-4641-a43b-2e0de4bd513e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:37.271902 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 340/808] 10.222.0.43 () {58 vars in 1263 bytes} [Mon Oct 10 18:52:34 2022] DELETE /compute/v2.1/os-floating-ips/b550a0a7-b9a9-4329-af26-b4b03f1d8d71 => generated 0 bytes in 2901 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:52:37.293288 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-da2bffa1-5878-418a-b40c-08fd41d7b809 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:37.298897 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-da2bffa1-5878-418a-b40c-08fd41d7b809 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:37.310448 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-da2bffa1-5878-418a-b40c-08fd41d7b809 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:37.312900 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-da2bffa1-5878-418a-b40c-08fd41d7b809 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:37.313411 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-da2bffa1-5878-418a-b40c-08fd41d7b809 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:37.314191 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-da2bffa1-5878-418a-b40c-08fd41d7b809 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:37.314795 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-da2bffa1-5878-418a-b40c-08fd41d7b809 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:37.315283 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-da2bffa1-5878-418a-b40c-08fd41d7b809 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:37.432242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-da2bffa1-5878-418a-b40c-08fd41d7b809 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:37.438617 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-da2bffa1-5878-418a-b40c-08fd41d7b809 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1271 microversion: 2.1 time: 0.168829 Oct 10 18:52:37.439676 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 341/809] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:37 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:37.449015 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5764e8ea-24c5-4e13-aa19-a323212e9f2f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318e44be50>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:37.523869 n-d-860863-1 devstack@n-api.service[127289]: DEBUG neutronclient.v2_0.client [None req-5764e8ea-24c5-4e13-aa19-a323212e9f2f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist", "detail": ""}} {{(pid=127289) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:52:37.524010 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.security_group_api [None req-5764e8ea-24c5-4e13-aa19-a323212e9f2f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Neutron security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a not found {{(pid=127289) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:52:37.524629 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-5764e8ea-24c5-4e13-aa19-a323212e9f2f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist Oct 10 18:52:37.524629 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-6f40a672-16ce-430c-b62c-670215623575'] Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5764e8ea-24c5-4e13-aa19-a323212e9f2f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-security-groups/630e2d17-25c5-4982-ab5c-ef81dd82e65a HTTP/1.1 Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: exception: Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-6f40a672-16ce-430c-b62c-670215623575'] Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '630e2d17-25c5-4982-ab5c-ef81dd82e65a'} Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:52:37.528648 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f40a672-16ce-430c-b62c-670215623575'] Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f40a672-16ce-430c-b62c-670215623575'] Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f40a672-16ce-430c-b62c-670215623575'] Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f40a672-16ce-430c-b62c-670215623575'] Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5764e8ea-24c5-4e13-aa19-a323212e9f2f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 404 to user: Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-6f40a672-16ce-430c-b62c-670215623575'] {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:37.533177 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5764e8ea-24c5-4e13-aa19-a323212e9f2f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/630e2d17-25c5-4982-ab5c-ef81dd82e65a" status: 404 len: 194 microversion: 2.1 time: 0.088357 Oct 10 18:52:37.535906 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 342/810] 10.222.0.43 () {58 vars in 1269 bytes} [Mon Oct 10 18:52:37 2022] GET /compute/v2.1/os-security-groups/630e2d17-25c5-4982-ab5c-ef81dd82e65a => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:52:37.538808 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-eb438bf2-115f-4914-9fc2-dd16bfef47bc tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] Calling method '.version_select at 0x7f318e2a6ca0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:37.545735 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4a4b1ebb-223b-4641-a43b-2e0de4bd513e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:37.561088 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4a4b1ebb-223b-4641-a43b-2e0de4bd513e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:37.563418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4a4b1ebb-223b-4641-a43b-2e0de4bd513e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:37.564879 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4a4b1ebb-223b-4641-a43b-2e0de4bd513e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1361 microversion: 2.25 time: 0.319191 Oct 10 18:52:37.565927 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 469/811] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:52:37 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:52:37.572071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cfe609cc-5f7e-4095-9319-4dc29620d6be tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318e933940>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:37.992597 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-eb438bf2-115f-4914-9fc2-dd16bfef47bc tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.457586 Oct 10 18:52:37.993498 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 343/812] 10.222.0.43 () {58 vars in 1164 bytes} [Mon Oct 10 18:52:37 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:52:37.999162 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fc5aff16-af73-4a27-b45e-9197e687dcb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:37.999349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fc5aff16-af73-4a27-b45e-9197e687dcb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:38.012191 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc5aff16-af73-4a27-b45e-9197e687dcb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:38.012719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc5aff16-af73-4a27-b45e-9197e687dcb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:38.013149 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc5aff16-af73-4a27-b45e-9197e687dcb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:38.013868 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc5aff16-af73-4a27-b45e-9197e687dcb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:38.014318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc5aff16-af73-4a27-b45e-9197e687dcb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:38.014740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc5aff16-af73-4a27-b45e-9197e687dcb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:38.189297 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cfe609cc-5f7e-4095-9319-4dc29620d6be tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/4b2e3aa5-8580-453f-a3c0-806900b2dd11" status: 202 len: 0 microversion: 2.1 time: 0.614416 Oct 10 18:52:38.189297 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 470/813] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:52:37 2022] DELETE /compute/v2.1/os-security-groups/4b2e3aa5-8580-453f-a3c0-806900b2dd11 => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:52:38.190326 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e3130ef3-bd86-4612-a621-260dc8431986 tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] Calling method '.version_select at 0x7f318e2b6820>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:38.481256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=6 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:38.513515 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=8 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:38.873547 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fc5aff16-af73-4a27-b45e-9197e687dcb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:38.885459 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fc5aff16-af73-4a27-b45e-9197e687dcb5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 200 len: 1318 microversion: 2.1 time: 0.889558 Oct 10 18:52:38.887164 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 344/814] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:37 2022] GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 1318 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:38.894016 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b8f54838-e338-42c3-ae88-1daa0168caad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318e36fe50>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:38.896723 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e3130ef3-bd86-4612-a621-260dc8431986 tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.710984 Oct 10 18:52:38.897275 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 471/815] 10.222.0.43 () {58 vars in 1149 bytes} [Mon Oct 10 18:52:38 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:38.905872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-464adf14-515e-4c12-b12c-42c2b3f94f35 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:38.906767 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-464adf14-515e-4c12-b12c-42c2b3f94f35 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:38.917873 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-464adf14-515e-4c12-b12c-42c2b3f94f35 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:38.918547 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-464adf14-515e-4c12-b12c-42c2b3f94f35 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:38.919071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-464adf14-515e-4c12-b12c-42c2b3f94f35 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:38.919915 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-464adf14-515e-4c12-b12c-42c2b3f94f35 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:38.920461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-464adf14-515e-4c12-b12c-42c2b3f94f35 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:38.921000 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-464adf14-515e-4c12-b12c-42c2b3f94f35 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:39.031285 n-d-860863-1 devstack@n-api.service[127289]: DEBUG neutronclient.v2_0.client [None req-b8f54838-e338-42c3-ae88-1daa0168caad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist", "detail": ""}} {{(pid=127289) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:52:39.032251 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.security_group_api [None req-b8f54838-e338-42c3-ae88-1daa0168caad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Neutron security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 not found {{(pid=127289) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:52:39.032981 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-b8f54838-e338-42c3-ae88-1daa0168caad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist Oct 10 18:52:39.032981 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-34d0e2c0-892f-473c-bb3f-5f92af7ff860'] Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b8f54838-e338-42c3-ae88-1daa0168caad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-security-groups/4b2e3aa5-8580-453f-a3c0-806900b2dd11 HTTP/1.1 Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: exception: Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-34d0e2c0-892f-473c-bb3f-5f92af7ff860'] Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '4b2e3aa5-8580-453f-a3c0-806900b2dd11'} Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:52:39.035120 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34d0e2c0-892f-473c-bb3f-5f92af7ff860'] Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34d0e2c0-892f-473c-bb3f-5f92af7ff860'] Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34d0e2c0-892f-473c-bb3f-5f92af7ff860'] Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34d0e2c0-892f-473c-bb3f-5f92af7ff860'] Oct 10 18:52:39.039431 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:39.044468 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b8f54838-e338-42c3-ae88-1daa0168caad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 404 to user: Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist Oct 10 18:52:39.044468 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-34d0e2c0-892f-473c-bb3f-5f92af7ff860'] {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:39.045931 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b8f54838-e338-42c3-ae88-1daa0168caad tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/4b2e3aa5-8580-453f-a3c0-806900b2dd11" status: 404 len: 194 microversion: 2.1 time: 0.158045 Oct 10 18:52:39.047203 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 345/816] 10.222.0.43 () {58 vars in 1269 bytes} [Mon Oct 10 18:52:38 2022] GET /compute/v2.1/os-security-groups/4b2e3aa5-8580-453f-a3c0-806900b2dd11 => generated 194 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:52:39.053033 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-53032617-dc2a-4189-a54f-85f9fb3df940 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:39.054308 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-53032617-dc2a-4189-a54f-85f9fb3df940 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:39.062219 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53032617-dc2a-4189-a54f-85f9fb3df940 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:39.063032 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53032617-dc2a-4189-a54f-85f9fb3df940 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:39.064942 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53032617-dc2a-4189-a54f-85f9fb3df940 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:39.065184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53032617-dc2a-4189-a54f-85f9fb3df940 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:39.065845 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53032617-dc2a-4189-a54f-85f9fb3df940 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:39.067347 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53032617-dc2a-4189-a54f-85f9fb3df940 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:39.132373 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-464adf14-515e-4c12-b12c-42c2b3f94f35 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:39.151250 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-464adf14-515e-4c12-b12c-42c2b3f94f35 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1313 microversion: 2.1 time: 0.251670 Oct 10 18:52:39.160811 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 472/817] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:38 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:39.294500 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-27aed254-a37a-41d4-a9af-91cf7369f349 tempest-InstanceUsageAuditLogNegativeTestJSON-548123339 tempest-InstanceUsageAuditLogNegativeTestJSON-548123339-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-27aed254-a37a-41d4-a9af-91cf7369f349 tempest-InstanceUsageAuditLogNegativeTestJSON-548123339 tempest-InstanceUsageAuditLogNegativeTestJSON-548123339-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-27aed254-a37a-41d4-a9af-91cf7369f349 tempest-InstanceUsageAuditLogNegativeTestJSON-548123339 tempest-InstanceUsageAuditLogNegativeTestJSON-548123339-project-admin] Request method failure captured: Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGn2Rk6bUyflyuxIQqKomcH2o8AIeileQSY0EgiS_E7sAHOjf8lzu5rFKElPTfXG5OTLkMTYKTYkRLmhZ4u3DVib43dD92g9yrl63Z1iH7lBE4X06bHdd71vGyOdekrbTkKApwP1cD2VhgFMZPmmBIVsPT5kwGdP__9KgHCwuwj5FDM Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 50174c640923494f9f88ed0c7bee1a33 Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-548123339 Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_50174c640923494f9f88ed0c7bee1a33", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/50174c640923494f9f88ed0c7bee1a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/50174c640923494f9f88ed0c7bee1a33"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/50174c640923494f9f88ed0c7bee1a33"}]}] Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-548123339 Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 50174c640923494f9f88ed0c7bee1a33 Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-548123339 Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-548123339-project-admin Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 0e20c7f6d0d44b95a61b4831dda7ad31 Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-548123339-project-admin Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: exception: Invalid timestamp for date invalid_time Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'invalid_time'} Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:39.305607 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:39.310591 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:39.310591 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:39.310591 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:39.310591 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 10 18:52:39.310591 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:39.310591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-27aed254-a37a-41d4-a9af-91cf7369f349 tempest-InstanceUsageAuditLogNegativeTestJSON-548123339 tempest-InstanceUsageAuditLogNegativeTestJSON-548123339-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:39.310591 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-27aed254-a37a-41d4-a9af-91cf7369f349 tempest-InstanceUsageAuditLogNegativeTestJSON-548123339 tempest-InstanceUsageAuditLogNegativeTestJSON-548123339-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.147232 Oct 10 18:52:39.310591 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 473/818] 10.222.0.43 () {58 vars in 1224 bytes} [Mon Oct 10 18:52:39 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 18:52:39.310591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-aee4426e-5abf-49d6-b5c3-46c92d7f280b tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] Calling method '.version_select at 0x7f318eb03f70>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:39.514218 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-53032617-dc2a-4189-a54f-85f9fb3df940 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:39.523398 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-53032617-dc2a-4189-a54f-85f9fb3df940 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:39.530874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-53032617-dc2a-4189-a54f-85f9fb3df940 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:39.531992 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-53032617-dc2a-4189-a54f-85f9fb3df940 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1361 microversion: 2.25 time: 0.483350 Oct 10 18:52:39.533036 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 346/819] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:52:39 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1361 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:52:39.546435 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-67b3dc5f-4cd9-42ed-8772-573a7459f65f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318e44bc10>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:40.238415 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-aee4426e-5abf-49d6-b5c3-46c92d7f280b tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/d0b3637f-ad0b-4235-8f3b-7cbdf5020e82" status: 202 len: 0 microversion: 2.1 time: 0.933128 Oct 10 18:52:40.239227 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 474/820] 10.222.0.43 () {58 vars in 1263 bytes} [Mon Oct 10 18:52:39 2022] DELETE /compute/v2.1/os-floating-ips/d0b3637f-ad0b-4235-8f3b-7cbdf5020e82 => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:52:40.319775 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-67b3dc5f-4cd9-42ed-8772-573a7459f65f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.783777 Oct 10 18:52:40.324446 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 347/821] 10.222.0.43 () {58 vars in 1158 bytes} [Mon Oct 10 18:52:39 2022] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:40.339764 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-364170f2-ec84-4033-93eb-2f2c52675dfa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:40.340919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-364170f2-ec84-4033-93eb-2f2c52675dfa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:40.349783 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:40.354474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-364170f2-ec84-4033-93eb-2f2c52675dfa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:40.355633 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-364170f2-ec84-4033-93eb-2f2c52675dfa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:40.356980 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-364170f2-ec84-4033-93eb-2f2c52675dfa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:40.359697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-364170f2-ec84-4033-93eb-2f2c52675dfa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:40.367687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ea4ae87d-b8cd-47ec-a8bd-dc8c21945952 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:40.378432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-364170f2-ec84-4033-93eb-2f2c52675dfa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:40.378432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-364170f2-ec84-4033-93eb-2f2c52675dfa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:40.379382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ea4ae87d-b8cd-47ec-a8bd-dc8c21945952 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '04611f4e301b481ea28ec04cd7b00b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4821d35829745ac99d551a46c16939a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ea4ae87d-b8cd-47ec-a8bd-dc8c21945952 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644-project] Request method failure captured: Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGn1TgI0rrFv9mXdQHAD7-2HqZivLeetSHbeYC_NbfhTD63AhDDbNHpEVgGopccHqE0GADjYjgEH8fq_pUD1grBdvZatgoFhkYrRPBTyteJQJQYNzR3yS4KiIlXZqG1ShjVUhXd72G9PgJ2YMaaIWiSKdgF2Tf2lrAiR5Pmy17kfWrk Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: d4821d35829745ac99d551a46c16939a Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4821d35829745ac99d551a46c16939a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4821d35829745ac99d551a46c16939a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4821d35829745ac99d551a46c16939a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4821d35829745ac99d551a46c16939a"}]}] Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: d4821d35829745ac99d551a46c16939a Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644-project Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 04611f4e301b481ea28ec04cd7b00b0e Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644-project Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: action_args: {} Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:40.383612 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:40.388085 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:40.388085 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:40.388085 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:52:40.388085 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:52:40.388085 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 10 18:52:40.388085 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:40.388085 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ea4ae87d-b8cd-47ec-a8bd-dc8c21945952 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:40.390594 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ea4ae87d-b8cd-47ec-a8bd-dc8c21945952 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644-project] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.149945 Oct 10 18:52:40.391258 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 475/822] 10.222.0.43 () {58 vars in 1185 bytes} [Mon Oct 10 18:52:40 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 151 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:52:40.414843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9d2e609c-7668-4bf6-ad5a-3b79a854e39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:40.415485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9d2e609c-7668-4bf6-ad5a-3b79a854e39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:40.424729 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d2e609c-7668-4bf6-ad5a-3b79a854e39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:40.426956 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d2e609c-7668-4bf6-ad5a-3b79a854e39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:40.427410 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d2e609c-7668-4bf6-ad5a-3b79a854e39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:40.428292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d2e609c-7668-4bf6-ad5a-3b79a854e39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:40.435993 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d2e609c-7668-4bf6-ad5a-3b79a854e39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:40.435993 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d2e609c-7668-4bf6-ad5a-3b79a854e39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:40.604503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9d2e609c-7668-4bf6-ad5a-3b79a854e39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:40.614147 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9d2e609c-7668-4bf6-ad5a-3b79a854e39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1313 microversion: 2.1 time: 0.206573 Oct 10 18:52:40.615886 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 476/823] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:40 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:40.621187 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7855f094-fc96-45e2-a17b-9b86eca605b3 tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] Calling method '.version_select at 0x7f318e2be4c0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:40.837639 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-364170f2-ec84-4033-93eb-2f2c52675dfa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:40.841752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:40.847248 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-364170f2-ec84-4033-93eb-2f2c52675dfa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 200 len: 1468 microversion: 2.1 time: 0.525233 Oct 10 18:52:40.857292 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 348/824] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:40 2022] GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 1468 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:40.879453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a946744d-b14b-4252-9eb4-5a7c101604a5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'create', calling method: .version_select at 0x7f318e44bb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1216831282", "description": "tempest-description-1343853262"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:41.790772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:41.831549 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7855f094-fc96-45e2-a17b-9b86eca605b3 tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/48a1357a-af5b-41cc-820a-f0ba93fc43ab" status: 202 len: 0 microversion: 2.1 time: 1.213692 Oct 10 18:52:41.832296 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 477/825] 10.222.0.43 () {58 vars in 1263 bytes} [Mon Oct 10 18:52:40 2022] DELETE /compute/v2.1/os-floating-ips/48a1357a-af5b-41cc-820a-f0ba93fc43ab => generated 0 bytes in 1216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:52:41.838563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=6 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:41.842258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c0588f8b-e333-44f4-9374-f16eaecade24 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:41.842645 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c0588f8b-e333-44f4-9374-f16eaecade24 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '04611f4e301b481ea28ec04cd7b00b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4821d35829745ac99d551a46c16939a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c0588f8b-e333-44f4-9374-f16eaecade24 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644-project] Request method failure captured: Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10%2018:52:40 HTTP/1.1 Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGn1TgI0rrFv9mXdQHAD7-2HqZivLeetSHbeYC_NbfhTD63AhDDbNHpEVgGopccHqE0GADjYjgEH8fq_pUD1grBdvZatgoFhkYrRPBTyteJQJQYNzR3yS4KiIlXZqG1ShjVUhXd72G9PgJ2YMaaIWiSKdgF2Tf2lrAiR5Pmy17kfWrk Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: d4821d35829745ac99d551a46c16939a Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4821d35829745ac99d551a46c16939a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4821d35829745ac99d551a46c16939a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4821d35829745ac99d551a46c16939a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4821d35829745ac99d551a46c16939a"}]}] Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: d4821d35829745ac99d551a46c16939a Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644-project Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 04611f4e301b481ea28ec04cd7b00b0e Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644-project Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '2022-10-10 18:52:40'} Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:41.844380 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:41.849038 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:41.849038 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:41.849038 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:52:41.849038 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:52:41.849038 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 10 18:52:41.849038 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:41.850168 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c0588f8b-e333-44f4-9374-f16eaecade24 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:41.850989 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c0588f8b-e333-44f4-9374-f16eaecade24 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644 tempest-InstanceUsageAuditLogNegativeTestJSON-2079633644-project] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10 18:52:40" status: 403 len: 128 microversion: 2.1 time: 0.017299 Oct 10 18:52:41.851689 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 478/826] 10.222.0.43 () {58 vars in 1251 bytes} [Mon Oct 10 18:52:41 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-10%2018%3A52%3A40 => generated 128 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:52:41.857835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-315f141b-82cd-4927-806f-7aeab40197b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:41.860217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-315f141b-82cd-4927-806f-7aeab40197b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:41.868198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-315f141b-82cd-4927-806f-7aeab40197b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:41.869043 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-315f141b-82cd-4927-806f-7aeab40197b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:41.869676 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-315f141b-82cd-4927-806f-7aeab40197b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:41.870962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-315f141b-82cd-4927-806f-7aeab40197b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:41.871598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-315f141b-82cd-4927-806f-7aeab40197b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:41.872186 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-315f141b-82cd-4927-806f-7aeab40197b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:42.017505 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a946744d-b14b-4252-9eb4-5a7c101604a5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.159065 Oct 10 18:52:42.026375 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 349/827] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:52:40 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:42.026375 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-67e2e839-ae70-4ba5-84b3-f8736d4fb0a2 req-7c1e7110-538b-4aa1-bc51-5780f52f031d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ec3f63-ef69-4151-987f-39dda9024b73", "tag": "e655b402-9cae-4ff9-ac35-3f3160df330a"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:42.051428 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-67e2e839-ae70-4ba5-84b3-f8736d4fb0a2 req-7c1e7110-538b-4aa1-bc51-5780f52f031d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:42.052071 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-67e2e839-ae70-4ba5-84b3-f8736d4fb0a2 req-7c1e7110-538b-4aa1-bc51-5780f52f031d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:42.053805 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-67e2e839-ae70-4ba5-84b3-f8736d4fb0a2 req-7c1e7110-538b-4aa1-bc51-5780f52f031d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:42.079287 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-67e2e839-ae70-4ba5-84b3-f8736d4fb0a2 req-7c1e7110-538b-4aa1-bc51-5780f52f031d service nova] Creating event network-changed:e655b402-9cae-4ff9-ac35-3f3160df330a for instance 99ec3f63-ef69-4151-987f-39dda9024b73 on n-h1-860863-1 Oct 10 18:52:42.090738 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-67e2e839-ae70-4ba5-84b3-f8736d4fb0a2 req-7c1e7110-538b-4aa1-bc51-5780f52f031d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070946 Oct 10 18:52:42.092558 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 350/828] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:42.104492 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-48295ed4-3db8-4951-b970-17014056efcb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:42.113572 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-48295ed4-3db8-4951-b970-17014056efcb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 24f13450-d68f-4d4a-a1fd-c2da9dfd523f] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:42.125921 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-48295ed4-3db8-4951-b970-17014056efcb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:42.128369 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-48295ed4-3db8-4951-b970-17014056efcb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:42.129107 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-48295ed4-3db8-4951-b970-17014056efcb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:42.130064 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-48295ed4-3db8-4951-b970-17014056efcb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:42.133588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-48295ed4-3db8-4951-b970-17014056efcb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:42.134302 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-48295ed4-3db8-4951-b970-17014056efcb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:42.345045 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-315f141b-82cd-4927-806f-7aeab40197b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:42.372826 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-315f141b-82cd-4927-806f-7aeab40197b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:42.375145 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-315f141b-82cd-4927-806f-7aeab40197b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:42.376372 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-315f141b-82cd-4927-806f-7aeab40197b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1361 microversion: 2.25 time: 0.523016 Oct 10 18:52:42.377111 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 479/829] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:52:41 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1361 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:52:42.420224 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-92d68012-e109-4045-a653-94130ed35f7c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:42.421309 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-92d68012-e109-4045-a653-94130ed35f7c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:42.428111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92d68012-e109-4045-a653-94130ed35f7c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:42.428909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92d68012-e109-4045-a653-94130ed35f7c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:42.429551 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92d68012-e109-4045-a653-94130ed35f7c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:42.430354 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92d68012-e109-4045-a653-94130ed35f7c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:42.430982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92d68012-e109-4045-a653-94130ed35f7c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:42.431473 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92d68012-e109-4045-a653-94130ed35f7c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:42.435141 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-48295ed4-3db8-4951-b970-17014056efcb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:42.445092 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-48295ed4-3db8-4951-b970-17014056efcb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f" status: 200 len: 1467 microversion: 2.1 time: 0.351015 Oct 10 18:52:42.446432 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 351/830] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:42 2022] GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f => generated 1467 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:42.460460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cc92fe13-ec60-499e-976c-0144f0f1b09b tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] Calling method '.version_select at 0x7f318e1a6a60>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:42.748639 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-92d68012-e109-4045-a653-94130ed35f7c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:42.762686 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-92d68012-e109-4045-a653-94130ed35f7c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1313 microversion: 2.1 time: 0.351504 Oct 10 18:52:42.764102 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 480/831] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:42 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:42.771827 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cffa9864-c1d5-40ce-b7b2-359a84df6e9d tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'create', calling method: .version_select at 0x7f318e2cc8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-449327477", "description": "tempest-description-1660566479"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:43.232410 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cffa9864-c1d5-40ce-b7b2-359a84df6e9d tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.467007 Oct 10 18:52:43.236310 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 481/832] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:52:42 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:43.238784 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-fd8c8532-aa9f-429d-b4f5-c00abf7ae586 req-52b482c8-ed16-42a2-9261-32a3a78cbae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa4cba0-5184-462b-ab0b-c03f2a104ae6", "name": "network-vif-plugged", "status": "completed", "tag": "aa9423e0-a4d9-48ba-8535-6f8ecab069a0"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:43.252695 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-fd8c8532-aa9f-429d-b4f5-c00abf7ae586 req-52b482c8-ed16-42a2-9261-32a3a78cbae9 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:43.254178 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-fd8c8532-aa9f-429d-b4f5-c00abf7ae586 req-52b482c8-ed16-42a2-9261-32a3a78cbae9 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:43.254704 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-fd8c8532-aa9f-429d-b4f5-c00abf7ae586 req-52b482c8-ed16-42a2-9261-32a3a78cbae9 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:43.269153 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-fd8c8532-aa9f-429d-b4f5-c00abf7ae586 req-52b482c8-ed16-42a2-9261-32a3a78cbae9 service nova] Creating event network-vif-plugged:aa9423e0-a4d9-48ba-8535-6f8ecab069a0 for instance 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 on n-h1-860863-1 Oct 10 18:52:43.274920 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-fd8c8532-aa9f-429d-b4f5-c00abf7ae586 req-52b482c8-ed16-42a2-9261-32a3a78cbae9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040228 Oct 10 18:52:43.276665 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 482/833] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:43.283544 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:43.293015 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:43.294330 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Searching by: {'reservation_id': 'r-xwyul8yn', 'deleted': False, 'project_id': 'f536cb88016b414298031238fb251097'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:52:43.304186 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:43.305028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:43.311013 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:43.311013 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:43.311013 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:43.311013 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:43.413611 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:43.521396 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 18:52:43.651624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:43.664086 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:43.664671 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:43.665118 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:43.942901 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-34271a9c-01b2-46fe-8723-2c82f68efb14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?reservation_id=r-xwyul8yn" status: 200 len: 2928 microversion: 2.1 time: 0.664024 Oct 10 18:52:43.943804 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 483/834] 10.222.0.43 () {58 vars in 1197 bytes} [Mon Oct 10 18:52:43 2022] GET /compute/v2.1/servers/detail?reservation_id=r-xwyul8yn => generated 2928 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:43.961304 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c8d3870d-8f78-466b-ae47-111ea047899a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:43.963412 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c8d3870d-8f78-466b-ae47-111ea047899a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:43.971162 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8d3870d-8f78-466b-ae47-111ea047899a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:43.971898 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8d3870d-8f78-466b-ae47-111ea047899a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:43.984148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8d3870d-8f78-466b-ae47-111ea047899a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:43.984148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8d3870d-8f78-466b-ae47-111ea047899a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:43.984148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8d3870d-8f78-466b-ae47-111ea047899a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:43.984148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8d3870d-8f78-466b-ae47-111ea047899a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:44.252291 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c8d3870d-8f78-466b-ae47-111ea047899a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:44.261528 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c8d3870d-8f78-466b-ae47-111ea047899a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:44.262975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c8d3870d-8f78-466b-ae47-111ea047899a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:44.264091 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c8d3870d-8f78-466b-ae47-111ea047899a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1361 microversion: 2.25 time: 0.318105 Oct 10 18:52:44.265146 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 484/835] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:52:43 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:52:44.269800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1599173834", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "5bd04591-f6d1-4416-be97-f74846413e3e"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:44.342307 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] validate_networks() for [('5bd04591-f6d1-4416-be97-f74846413e3e', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:52:44.898264 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cc92fe13-ec60-499e-976c-0144f0f1b09b tempest-FloatingIPDetailsTestJSON-783278650 tempest-FloatingIPDetailsTestJSON-783278650-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/6124f4a4-be86-4ca3-94fd-96e5763b3425" status: 202 len: 0 microversion: 2.1 time: 2.450604 Oct 10 18:52:44.905391 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 352/836] 10.222.0.43 () {58 vars in 1263 bytes} [Mon Oct 10 18:52:42 2022] DELETE /compute/v2.1/os-floating-ips/6124f4a4-be86-4ca3-94fd-96e5763b3425 => generated 0 bytes in 2458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:52:44.911265 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-11d33c58-bb56-4285-ba69-7c0a13c98afe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:44.911962 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-11d33c58-bb56-4285-ba69-7c0a13c98afe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:44.919769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-11d33c58-bb56-4285-ba69-7c0a13c98afe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:44.920572 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-11d33c58-bb56-4285-ba69-7c0a13c98afe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:44.921172 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-11d33c58-bb56-4285-ba69-7c0a13c98afe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:44.921905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-11d33c58-bb56-4285-ba69-7c0a13c98afe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:44.922508 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-11d33c58-bb56-4285-ba69-7c0a13c98afe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:44.923095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-11d33c58-bb56-4285-ba69-7c0a13c98afe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:44.950164 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:52:44.950589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:52:44.951881 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:52:44.952456 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:52:44.953055 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:52:44.964702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:44.965462 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:44.966191 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:44.967081 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:44.967704 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:44.968299 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:44.989847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Getting quotas for project 8091182527c74871b45587d4ff107e9f. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:44.994795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Getting quotas for user 5ada4cd6646b4ba397f952d939e36814 and project 8091182527c74871b45587d4ff107e9f. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:45.008424 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:52:45.011476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:52:45.168583 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-75c37bae-26c7-46a7-a750-4863245f66fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.902267 Oct 10 18:52:45.169921 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 485/837] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:52:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:52:45.176156 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-65d308da-ee03-4385-9790-d08ece4ae803 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:45.210719 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.compute.server_groups [None req-65d308da-ee03-4385-9790-d08ece4ae803 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Querying cell 1649e55c-2282-4aa8-b943-d6661d4bffa2(cell1) for 2 instances {{(pid=127288) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 10 18:52:45.212571 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65d308da-ee03-4385-9790-d08ece4ae803 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:45.214143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65d308da-ee03-4385-9790-d08ece4ae803 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:45.214811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65d308da-ee03-4385-9790-d08ece4ae803 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:45.251252 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-65d308da-ee03-4385-9790-d08ece4ae803 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/772e753d-bc05-4a67-86bc-fd8f2257d40d" status: 200 len: 266 microversion: 2.1 time: 0.079777 Oct 10 18:52:45.252444 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 486/838] 10.222.0.43 () {58 vars in 1263 bytes} [Mon Oct 10 18:52:45 2022] GET /compute/v2.1/os-server-groups/772e753d-bc05-4a67-86bc-fd8f2257d40d => generated 266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:45.270970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e2706050-086d-4505-aede-4e642e697fc3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:45.270970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e2706050-086d-4505-aede-4e642e697fc3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:45.353765 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-11d33c58-bb56-4285-ba69-7c0a13c98afe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:45.361143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e2706050-086d-4505-aede-4e642e697fc3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:45.362153 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-11d33c58-bb56-4285-ba69-7c0a13c98afe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1313 microversion: 2.1 time: 0.454984 Oct 10 18:52:45.370586 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e2706050-086d-4505-aede-4e642e697fc3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1216 microversion: 2.1 time: 0.114517 Oct 10 18:52:45.372335 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 487/839] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:45 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1216 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:45.379199 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 353/840] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:44 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:45.386179 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7caee24a-8886-486b-bb8e-e819bc6ba188 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:45.387111 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7caee24a-8886-486b-bb8e-e819bc6ba188 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:45.388512 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-df97760c-6672-449f-ae51-4a530657e858 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:45.393339 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-df97760c-6672-449f-ae51-4a530657e858 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] [instance: 24f13450-d68f-4d4a-a1fd-c2da9dfd523f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:45.396555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7caee24a-8886-486b-bb8e-e819bc6ba188 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:45.397340 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7caee24a-8886-486b-bb8e-e819bc6ba188 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:45.397973 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7caee24a-8886-486b-bb8e-e819bc6ba188 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:45.399289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7caee24a-8886-486b-bb8e-e819bc6ba188 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:45.401163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7caee24a-8886-486b-bb8e-e819bc6ba188 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:45.402430 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7caee24a-8886-486b-bb8e-e819bc6ba188 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:45.438748 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:45.450273 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df97760c-6672-449f-ae51-4a530657e858 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:45.450941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df97760c-6672-449f-ae51-4a530657e858 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:45.452165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df97760c-6672-449f-ae51-4a530657e858 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:45.453738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df97760c-6672-449f-ae51-4a530657e858 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:45.455142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df97760c-6672-449f-ae51-4a530657e858 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:45.455907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df97760c-6672-449f-ae51-4a530657e858 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:45.703054 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-df97760c-6672-449f-ae51-4a530657e858 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f" status: 200 len: 1618 microversion: 2.1 time: 0.322423 Oct 10 18:52:45.706995 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 488/841] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:45 2022] GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f => generated 1618 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:45.709389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7caee24a-8886-486b-bb8e-e819bc6ba188 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:45.720269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7caee24a-8886-486b-bb8e-e819bc6ba188 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:45.721790 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7caee24a-8886-486b-bb8e-e819bc6ba188 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:45.727944 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7caee24a-8886-486b-bb8e-e819bc6ba188 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1556 microversion: 2.25 time: 0.347326 Oct 10 18:52:45.728651 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 354/842] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:52:45 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1556 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:52:45.750303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-96e441ee-7b21-4364-a3d2-735a9d0edf5f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:45.751122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-96e441ee-7b21-4364-a3d2-735a9d0edf5f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:45.769111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96e441ee-7b21-4364-a3d2-735a9d0edf5f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:45.769111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96e441ee-7b21-4364-a3d2-735a9d0edf5f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:45.769111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96e441ee-7b21-4364-a3d2-735a9d0edf5f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:45.769111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96e441ee-7b21-4364-a3d2-735a9d0edf5f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:45.769111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96e441ee-7b21-4364-a3d2-735a9d0edf5f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:45.771553 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96e441ee-7b21-4364-a3d2-735a9d0edf5f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:46.014961 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bea805b7-8e9f-4f54-9118-8c5c5c5afaf9 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:46.016309 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bea805b7-8e9f-4f54-9118-8c5c5c5afaf9 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:46.029070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bea805b7-8e9f-4f54-9118-8c5c5c5afaf9 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:46.029836 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bea805b7-8e9f-4f54-9118-8c5c5c5afaf9 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:46.030871 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bea805b7-8e9f-4f54-9118-8c5c5c5afaf9 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:46.032823 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bea805b7-8e9f-4f54-9118-8c5c5c5afaf9 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:46.034482 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bea805b7-8e9f-4f54-9118-8c5c5c5afaf9 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:46.035104 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bea805b7-8e9f-4f54-9118-8c5c5c5afaf9 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:46.395847 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-bea805b7-8e9f-4f54-9118-8c5c5c5afaf9 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:52:46.433535 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bea805b7-8e9f-4f54-9118-8c5c5c5afaf9 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 2048 microversion: 2.25 time: 0.675327 Oct 10 18:52:46.434452 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 355/843] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:52:45 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 2048 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:52:46.439085 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-80bc8665-01c0-4098-a1b0-262337a10026 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:46.439700 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-80bc8665-01c0-4098-a1b0-262337a10026 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:46.458988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80bc8665-01c0-4098-a1b0-262337a10026 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:46.459769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80bc8665-01c0-4098-a1b0-262337a10026 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:46.460203 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80bc8665-01c0-4098-a1b0-262337a10026 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:46.461146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80bc8665-01c0-4098-a1b0-262337a10026 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:46.461770 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80bc8665-01c0-4098-a1b0-262337a10026 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:46.462554 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80bc8665-01c0-4098-a1b0-262337a10026 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:46.645846 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-96e441ee-7b21-4364-a3d2-735a9d0edf5f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 200 len: 1619 microversion: 2.1 time: 0.919817 Oct 10 18:52:46.662703 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 489/844] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:45 2022] GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 1619 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:46.678510 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d0f57235-6a85-4754-a97e-ee2a1ee48370 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:46.679119 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d0f57235-6a85-4754-a97e-ee2a1ee48370 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:46.685906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0f57235-6a85-4754-a97e-ee2a1ee48370 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:46.686622 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0f57235-6a85-4754-a97e-ee2a1ee48370 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:46.687053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0f57235-6a85-4754-a97e-ee2a1ee48370 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:46.687757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0f57235-6a85-4754-a97e-ee2a1ee48370 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:46.688239 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0f57235-6a85-4754-a97e-ee2a1ee48370 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:46.688658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0f57235-6a85-4754-a97e-ee2a1ee48370 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:46.698853 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-80bc8665-01c0-4098-a1b0-262337a10026 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:46.708891 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-80bc8665-01c0-4098-a1b0-262337a10026 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1313 microversion: 2.1 time: 0.273190 Oct 10 18:52:46.725308 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 356/845] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:46 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:46.730432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-933c87e0-f16b-444f-8c9c-1f75e5b7ba35 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:46.734234 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-933c87e0-f16b-444f-8c9c-1f75e5b7ba35 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:46.737924 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-933c87e0-f16b-444f-8c9c-1f75e5b7ba35 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:46.738673 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-933c87e0-f16b-444f-8c9c-1f75e5b7ba35 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:46.739346 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-933c87e0-f16b-444f-8c9c-1f75e5b7ba35 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:46.740457 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-933c87e0-f16b-444f-8c9c-1f75e5b7ba35 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:46.741151 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-933c87e0-f16b-444f-8c9c-1f75e5b7ba35 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:46.741790 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-933c87e0-f16b-444f-8c9c-1f75e5b7ba35 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:46.770428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d0f57235-6a85-4754-a97e-ee2a1ee48370 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:46.782942 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d0f57235-6a85-4754-a97e-ee2a1ee48370 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1220 microversion: 2.1 time: 0.111520 Oct 10 18:52:46.783530 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 490/846] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:46 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:46.800321 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8f1d4286-e8af-4d0b-a8a7-44a74ceec8d6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Action: 'create', calling method: .version_select at 0x7f318eaad0d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1761712051", "policies": ["anti-affinity"]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:46.821362 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-8f1d4286-e8af-4d0b-a8a7-44a74ceec8d6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'server_groups'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:46.829561 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-8f1d4286-e8af-4d0b-a8a7-44a74ceec8d6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'server_groups'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:46.942322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-933c87e0-f16b-444f-8c9c-1f75e5b7ba35 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:52:46.972636 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-933c87e0-f16b-444f-8c9c-1f75e5b7ba35 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 2048 microversion: 2.25 time: 0.240710 Oct 10 18:52:46.981507 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 357/847] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:52:46 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 2048 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:52:47.010718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-56c3003e-0565-4a29-b86b-95b153cebbbe tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:47.014664 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56c3003e-0565-4a29-b86b-95b153cebbbe tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:47.015404 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56c3003e-0565-4a29-b86b-95b153cebbbe tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:47.016519 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56c3003e-0565-4a29-b86b-95b153cebbbe tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:47.017722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56c3003e-0565-4a29-b86b-95b153cebbbe tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:47.018386 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56c3003e-0565-4a29-b86b-95b153cebbbe tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:47.019038 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56c3003e-0565-4a29-b86b-95b153cebbbe tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:47.045761 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-56c3003e-0565-4a29-b86b-95b153cebbbe tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.039558 Oct 10 18:52:47.047031 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 358/848] 10.222.0.43 () {60 vars in 1217 bytes} [Mon Oct 10 18:52:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:52:47.080384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e9b0572e-4912-4392-9a99-94b258fe077d tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860863-1", "block_migration": "auto"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:47.086554 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-8f1d4286-e8af-4d0b-a8a7-44a74ceec8d6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'server_groups'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:47.090212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e9b0572e-4912-4392-9a99-94b258fe077d tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:47.103032 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-8f1d4286-e8af-4d0b-a8a7-44a74ceec8d6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'server_groups'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:47.106338 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e9b0572e-4912-4392-9a99-94b258fe077d tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:47.106835 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e9b0572e-4912-4392-9a99-94b258fe077d tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:47.107269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e9b0572e-4912-4392-9a99-94b258fe077d tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:47.107967 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e9b0572e-4912-4392-9a99-94b258fe077d tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:47.108413 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e9b0572e-4912-4392-9a99-94b258fe077d tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:47.108858 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e9b0572e-4912-4392-9a99-94b258fe077d tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:47.134531 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8f1d4286-e8af-4d0b-a8a7-44a74ceec8d6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.349748 Oct 10 18:52:47.135949 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 491/849] 10.222.0.43 () {60 vars in 1174 bytes} [Mon Oct 10 18:52:46 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:47.295759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-e9b0572e-4912-4392-9a99-94b258fe077d tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'flavor' on Instance uuid 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:52:47.605821 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e9b0572e-4912-4392-9a99-94b258fe077d tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Going to try to live migrate instance to n-h2-860863-1 {{(pid=127289) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 18:52:47.620645 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1637777103", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "e85081cb-1236-4f01-9f84-23bbf81790d0"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:47.694241 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] validate_networks() for None {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:52:48.178406 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:52:48.179069 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:52:48.181161 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:52:48.181624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:52:48.182560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:52:48.223398 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:48.226445 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:48.227274 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:48.231254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:48.232106 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:48.232789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:48.309481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:48.330449 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:48.410727 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Going to run 2 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:52:48.425372 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: d908aa91-59b6-4c75-b6d2-30e97e050a55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:52:48.683831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127288) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 10 18:52:48.777883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:48.787490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:48.962456 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:48.970587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:48.991201 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=d908aa91-59b6-4c75-b6d2-30e97e050a55,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:52:49.184857 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:49.195078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:49.364904 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:49.372128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'server_group_members'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:49.376246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:49.415204 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0f3b06c6-ea07-4cd9-a73e-6d61a41583f1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.799963 Oct 10 18:52:49.419756 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 492/850] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:52:47 2022] POST /compute/v2.1/servers => generated 32 bytes in 1805 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 10 18:52:49.426645 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b152fd2a-79d7-4334-93ec-c050a91e12ab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:49.426645 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b152fd2a-79d7-4334-93ec-c050a91e12ab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:49.432862 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b152fd2a-79d7-4334-93ec-c050a91e12ab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:49.433417 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b152fd2a-79d7-4334-93ec-c050a91e12ab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:49.433905 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b152fd2a-79d7-4334-93ec-c050a91e12ab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:49.435025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b152fd2a-79d7-4334-93ec-c050a91e12ab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:49.435680 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b152fd2a-79d7-4334-93ec-c050a91e12ab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:49.436314 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b152fd2a-79d7-4334-93ec-c050a91e12ab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:50.040882 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b152fd2a-79d7-4334-93ec-c050a91e12ab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:50.051075 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b152fd2a-79d7-4334-93ec-c050a91e12ab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1313 microversion: 2.1 time: 0.630132 Oct 10 18:52:50.053230 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 493/851] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:49 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:50.059036 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c99cf983-b854-412d-96a1-1f0692a5b65e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:50.059942 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c99cf983-b854-412d-96a1-1f0692a5b65e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:50.084176 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c99cf983-b854-412d-96a1-1f0692a5b65e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:50.085089 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c99cf983-b854-412d-96a1-1f0692a5b65e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:50.085636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c99cf983-b854-412d-96a1-1f0692a5b65e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:50.086909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c99cf983-b854-412d-96a1-1f0692a5b65e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:50.087590 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c99cf983-b854-412d-96a1-1f0692a5b65e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:50.089122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c99cf983-b854-412d-96a1-1f0692a5b65e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:50.205820 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c99cf983-b854-412d-96a1-1f0692a5b65e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:50.219217 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c99cf983-b854-412d-96a1-1f0692a5b65e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1274 microversion: 2.1 time: 0.163837 Oct 10 18:52:50.222747 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 494/852] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:50 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:50.235209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-1e8a84a9-5875-4821-b648-8cea30d3ee7d req-fa8d4071-fb6a-403c-98d8-22d90a8490d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ec3f63-ef69-4151-987f-39dda9024b73", "name": "network-vif-plugged", "status": "completed", "tag": "e655b402-9cae-4ff9-ac35-3f3160df330a"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:50.272847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1e8a84a9-5875-4821-b648-8cea30d3ee7d req-fa8d4071-fb6a-403c-98d8-22d90a8490d8 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:50.274952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1e8a84a9-5875-4821-b648-8cea30d3ee7d req-fa8d4071-fb6a-403c-98d8-22d90a8490d8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:50.276113 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1e8a84a9-5875-4821-b648-8cea30d3ee7d req-fa8d4071-fb6a-403c-98d8-22d90a8490d8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:50.295531 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-1e8a84a9-5875-4821-b648-8cea30d3ee7d req-fa8d4071-fb6a-403c-98d8-22d90a8490d8 service nova] Creating event network-vif-plugged:e655b402-9cae-4ff9-ac35-3f3160df330a for instance 99ec3f63-ef69-4151-987f-39dda9024b73 on n-h1-860863-1 Oct 10 18:52:50.302011 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-1e8a84a9-5875-4821-b648-8cea30d3ee7d req-fa8d4071-fb6a-403c-98d8-22d90a8490d8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077765 Oct 10 18:52:50.303051 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 495/853] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:50.308430 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cdc1888a-37a9-47a8-a309-804fd98c5187 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:50.314920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cdc1888a-37a9-47a8-a309-804fd98c5187 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:50.315753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cdc1888a-37a9-47a8-a309-804fd98c5187 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Searching by: {'deleted': False, 'project_id': 'f536cb88016b414298031238fb251097'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:52:50.359371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdc1888a-37a9-47a8-a309-804fd98c5187 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:50.360093 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdc1888a-37a9-47a8-a309-804fd98c5187 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:50.360751 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdc1888a-37a9-47a8-a309-804fd98c5187 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:50.361812 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdc1888a-37a9-47a8-a309-804fd98c5187 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:50.363062 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdc1888a-37a9-47a8-a309-804fd98c5187 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:50.371118 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdc1888a-37a9-47a8-a309-804fd98c5187 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:50.417194 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-cdc1888a-37a9-47a8-a309-804fd98c5187 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 18:52:50.464057 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cdc1888a-37a9-47a8-a309-804fd98c5187 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.159707 Oct 10 18:52:50.465110 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 496/854] 10.222.0.43 () {58 vars in 1125 bytes} [Mon Oct 10 18:52:50 2022] GET /compute/v2.1/servers => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:50.918872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-627661501", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:51.033766 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] validate_networks() for None {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:52:51.603402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:52:51.607145 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:52:51.607860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:52:51.608473 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:52:51.609816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:52:51.633633 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:51.634374 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:51.636004 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:51.637556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:51.640332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:51.642458 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:51.717697 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Getting quotas for project 9fedc5f489634425b4bbae61ab3897bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:52:51.734769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Getting quotas for user 7f32dfaf09884d848804aed1ed5a2be4 and project 9fedc5f489634425b4bbae61ab3897bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:52:51.766439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:52:51.772808 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:52:51.969941 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0b489786-8ccd-40d4-810e-8df34220b64b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.503586 Oct 10 18:52:51.978576 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 497/855] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:52:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:52:51.990806 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2c5b5a62-7a09-40a4-8eae-9c47d7d1f72a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:51.991828 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2c5b5a62-7a09-40a4-8eae-9c47d7d1f72a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:52.000123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a62-7a09-40a4-8eae-9c47d7d1f72a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:52.001039 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a62-7a09-40a4-8eae-9c47d7d1f72a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:52.002377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a62-7a09-40a4-8eae-9c47d7d1f72a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:52.003679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a62-7a09-40a4-8eae-9c47d7d1f72a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:52.004394 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a62-7a09-40a4-8eae-9c47d7d1f72a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:52.005080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a62-7a09-40a4-8eae-9c47d7d1f72a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:52.158204 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2c5b5a62-7a09-40a4-8eae-9c47d7d1f72a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:52.168084 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2c5b5a62-7a09-40a4-8eae-9c47d7d1f72a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 200 len: 1223 microversion: 2.1 time: 0.187523 Oct 10 18:52:52.168805 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 498/856] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:51 2022] GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 1223 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:52.195438 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-be1bfd8e-3665-4903-9d71-f2308a21d5a2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:52.198948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-be1bfd8e-3665-4903-9d71-f2308a21d5a2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:52.214061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-be1bfd8e-3665-4903-9d71-f2308a21d5a2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:52.215120 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-be1bfd8e-3665-4903-9d71-f2308a21d5a2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:52.215782 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-be1bfd8e-3665-4903-9d71-f2308a21d5a2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:52.218164 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-be1bfd8e-3665-4903-9d71-f2308a21d5a2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:52.220482 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-be1bfd8e-3665-4903-9d71-f2308a21d5a2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:52.221173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-be1bfd8e-3665-4903-9d71-f2308a21d5a2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:52.566683 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-be1bfd8e-3665-4903-9d71-f2308a21d5a2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:52.574436 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-be1bfd8e-3665-4903-9d71-f2308a21d5a2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1463 microversion: 2.1 time: 0.387065 Oct 10 18:52:52.578250 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 499/857] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:52 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1463 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:52.598921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d4236f51-6d11-41ea-8846-66d397efa8c3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:52.599862 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d4236f51-6d11-41ea-8846-66d397efa8c3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:52.607230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d4236f51-6d11-41ea-8846-66d397efa8c3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:52.608352 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d4236f51-6d11-41ea-8846-66d397efa8c3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:52.608961 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d4236f51-6d11-41ea-8846-66d397efa8c3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:52.609905 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d4236f51-6d11-41ea-8846-66d397efa8c3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:52.610549 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d4236f51-6d11-41ea-8846-66d397efa8c3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:52.611168 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d4236f51-6d11-41ea-8846-66d397efa8c3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:52.914739 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d4236f51-6d11-41ea-8846-66d397efa8c3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:52.923641 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d4236f51-6d11-41ea-8846-66d397efa8c3 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1316 microversion: 2.1 time: 0.345950 Oct 10 18:52:52.928213 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 500/858] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:52 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:52.941850 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-73f93fd7-02bb-40d6-91f9-d14b83fd55e0 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:52.942483 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-73f93fd7-02bb-40d6-91f9-d14b83fd55e0 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:53.015777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-73f93fd7-02bb-40d6-91f9-d14b83fd55e0 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:53.023686 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-73f93fd7-02bb-40d6-91f9-d14b83fd55e0 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1218 microversion: 2.1 time: 0.094287 Oct 10 18:52:53.024260 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 501/859] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:52 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:53.236633 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e9b0572e-4912-4392-9a99-94b258fe077d tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6/action" status: 202 len: 0 microversion: 2.25 time: 6.180638 Oct 10 18:52:53.240602 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 359/860] 10.222.0.43 () {62 vars in 1319 bytes} [Mon Oct 10 18:52:47 2022] POST /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6/action => generated 0 bytes in 6182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:52:53.407058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1454b935-383e-4302-9d55-bfa6e59540cd tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:53.412245 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1454b935-383e-4302-9d55-bfa6e59540cd tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:53.413269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1454b935-383e-4302-9d55-bfa6e59540cd tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:53.413885 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1454b935-383e-4302-9d55-bfa6e59540cd tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:53.414839 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1454b935-383e-4302-9d55-bfa6e59540cd tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:53.415445 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1454b935-383e-4302-9d55-bfa6e59540cd tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:53.416060 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1454b935-383e-4302-9d55-bfa6e59540cd tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:53.453479 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1454b935-383e-4302-9d55-bfa6e59540cd tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.426416 Oct 10 18:52:53.454802 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 502/861] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:52:53 2022] GET /compute/v2.1/os-services => generated 944 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:53.462781 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-5c0dfdf0-30d9-4a4f-a50f-246b597440f0 req-9e803252-7bb9-490c-bbe5-86bf43149fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1beef1-3d9a-4af8-ac68-048748261c19", "tag": "98401b59-e218-4900-acf6-4ca8bcde0d49"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:53.493824 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5c0dfdf0-30d9-4a4f-a50f-246b597440f0 req-9e803252-7bb9-490c-bbe5-86bf43149fa5 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:53.495110 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5c0dfdf0-30d9-4a4f-a50f-246b597440f0 req-9e803252-7bb9-490c-bbe5-86bf43149fa5 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:53.496628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5c0dfdf0-30d9-4a4f-a50f-246b597440f0 req-9e803252-7bb9-490c-bbe5-86bf43149fa5 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:53.529384 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-5c0dfdf0-30d9-4a4f-a50f-246b597440f0 req-9e803252-7bb9-490c-bbe5-86bf43149fa5 service nova] Creating event network-changed:98401b59-e218-4900-acf6-4ca8bcde0d49 for instance cf1beef1-3d9a-4af8-ac68-048748261c19 on n-h2-860863-1 Oct 10 18:52:53.543050 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-5c0dfdf0-30d9-4a4f-a50f-246b597440f0 req-9e803252-7bb9-490c-bbe5-86bf43149fa5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085835 Oct 10 18:52:53.544275 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 503/862] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:53.555143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1425208e-e1cf-40f2-8e4c-a7beea2ae051 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:53.555878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1425208e-e1cf-40f2-8e4c-a7beea2ae051 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:53.563938 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1425208e-e1cf-40f2-8e4c-a7beea2ae051 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:53.564214 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1425208e-e1cf-40f2-8e4c-a7beea2ae051 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:53.564684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1425208e-e1cf-40f2-8e4c-a7beea2ae051 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:53.565885 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1425208e-e1cf-40f2-8e4c-a7beea2ae051 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:53.566601 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1425208e-e1cf-40f2-8e4c-a7beea2ae051 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:53.567340 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1425208e-e1cf-40f2-8e4c-a7beea2ae051 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:53.738469 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-02edb038-8b44-4259-a661-9815bddc6cf2 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:53.743741 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-02edb038-8b44-4259-a661-9815bddc6cf2 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Searching by: {'deleted': False, 'project_id': 'c95cf57ba7a94eafb03f875b07ebacb9'} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:52:53.778281 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02edb038-8b44-4259-a661-9815bddc6cf2 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:53.778773 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02edb038-8b44-4259-a661-9815bddc6cf2 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:53.780643 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02edb038-8b44-4259-a661-9815bddc6cf2 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:53.784706 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02edb038-8b44-4259-a661-9815bddc6cf2 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:53.788748 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02edb038-8b44-4259-a661-9815bddc6cf2 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:53.789431 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02edb038-8b44-4259-a661-9815bddc6cf2 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:53.905701 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1425208e-e1cf-40f2-8e4c-a7beea2ae051 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:53.915125 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1425208e-e1cf-40f2-8e4c-a7beea2ae051 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 200 len: 1271 microversion: 2.1 time: 0.369419 Oct 10 18:52:53.933511 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 504/863] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:53 2022] GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 1271 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:53.942205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-124ff08b-8b11-4e1f-9d62-ffd5aea0de85 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:53.943080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-124ff08b-8b11-4e1f-9d62-ffd5aea0de85 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:53.950431 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-124ff08b-8b11-4e1f-9d62-ffd5aea0de85 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:53.951143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-124ff08b-8b11-4e1f-9d62-ffd5aea0de85 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:53.951761 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-124ff08b-8b11-4e1f-9d62-ffd5aea0de85 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:53.952713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-124ff08b-8b11-4e1f-9d62-ffd5aea0de85 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:53.953312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-124ff08b-8b11-4e1f-9d62-ffd5aea0de85 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:53.953884 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-124ff08b-8b11-4e1f-9d62-ffd5aea0de85 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:54.021378 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-02edb038-8b44-4259-a661-9815bddc6cf2 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.781888 Oct 10 18:52:54.034104 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 360/864] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:52:53 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:52:54.058610 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-81d89749-ed04-4572-ab2e-16ab5d4071b7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:54.063756 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-81d89749-ed04-4572-ab2e-16ab5d4071b7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:54.063756 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-81d89749-ed04-4572-ab2e-16ab5d4071b7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:54.063756 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-81d89749-ed04-4572-ab2e-16ab5d4071b7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:54.064253 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-81d89749-ed04-4572-ab2e-16ab5d4071b7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:54.064479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-81d89749-ed04-4572-ab2e-16ab5d4071b7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:54.070814 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-81d89749-ed04-4572-ab2e-16ab5d4071b7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:54.120754 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-81d89749-ed04-4572-ab2e-16ab5d4071b7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.083907 Oct 10 18:52:54.121946 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 361/865] 10.222.0.43 () {58 vars in 1170 bytes} [Mon Oct 10 18:52:54 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:54.126862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-044cbc2b-43df-4ba9-ac35-9b5f5d72ebff tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:54.127660 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-044cbc2b-43df-4ba9-ac35-9b5f5d72ebff tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:54.135477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-044cbc2b-43df-4ba9-ac35-9b5f5d72ebff tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:54.136187 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-044cbc2b-43df-4ba9-ac35-9b5f5d72ebff tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:54.136867 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-044cbc2b-43df-4ba9-ac35-9b5f5d72ebff tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:54.137578 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-044cbc2b-43df-4ba9-ac35-9b5f5d72ebff tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:54.138032 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-044cbc2b-43df-4ba9-ac35-9b5f5d72ebff tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:54.138458 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-044cbc2b-43df-4ba9-ac35-9b5f5d72ebff tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:54.356411 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-124ff08b-8b11-4e1f-9d62-ffd5aea0de85 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:54.367192 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-124ff08b-8b11-4e1f-9d62-ffd5aea0de85 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:54.368820 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-124ff08b-8b11-4e1f-9d62-ffd5aea0de85 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:54.371349 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-124ff08b-8b11-4e1f-9d62-ffd5aea0de85 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1566 microversion: 2.25 time: 0.436002 Oct 10 18:52:54.371994 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 505/866] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:52:53 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1566 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:52:54.381718 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b07d2c16-5253-44e7-a563-a62c305c1741 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:54.390024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b07d2c16-5253-44e7-a563-a62c305c1741 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Searching by: {'deleted': False} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:52:54.397382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07d2c16-5253-44e7-a563-a62c305c1741 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:54.398196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07d2c16-5253-44e7-a563-a62c305c1741 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:54.398840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07d2c16-5253-44e7-a563-a62c305c1741 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:54.400009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07d2c16-5253-44e7-a563-a62c305c1741 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:54.401191 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07d2c16-5253-44e7-a563-a62c305c1741 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:54.401808 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07d2c16-5253-44e7-a563-a62c305c1741 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:54.460211 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-044cbc2b-43df-4ba9-ac35-9b5f5d72ebff tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:54.473700 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-044cbc2b-43df-4ba9-ac35-9b5f5d72ebff tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1316 microversion: 2.1 time: 0.350519 Oct 10 18:52:54.477510 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 362/867] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:54 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:54.497557 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-24a4fcd4-b11f-42e6-8688-716adef93525 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:54.499295 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-24a4fcd4-b11f-42e6-8688-716adef93525 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:54.500385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:54.513879 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24a4fcd4-b11f-42e6-8688-716adef93525 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:54.516137 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24a4fcd4-b11f-42e6-8688-716adef93525 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:54.517983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24a4fcd4-b11f-42e6-8688-716adef93525 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:54.518755 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24a4fcd4-b11f-42e6-8688-716adef93525 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:54.520388 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24a4fcd4-b11f-42e6-8688-716adef93525 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:54.523742 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24a4fcd4-b11f-42e6-8688-716adef93525 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:54.576307 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-b07d2c16-5253-44e7-a563-a62c305c1741 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 18:52:54.639726 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-24a4fcd4-b11f-42e6-8688-716adef93525 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:54.665393 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-24a4fcd4-b11f-42e6-8688-716adef93525 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1270 microversion: 2.1 time: 0.172478 Oct 10 18:52:54.665393 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 363/868] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:54 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:54.665393 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bfed8163-a4c5-4596-aa12-a7e39a560291 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:54.668918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bfed8163-a4c5-4596-aa12-a7e39a560291 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:54.672865 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bfed8163-a4c5-4596-aa12-a7e39a560291 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:54.673338 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bfed8163-a4c5-4596-aa12-a7e39a560291 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:54.676274 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bfed8163-a4c5-4596-aa12-a7e39a560291 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:54.676774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bfed8163-a4c5-4596-aa12-a7e39a560291 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:54.677205 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bfed8163-a4c5-4596-aa12-a7e39a560291 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:54.708770 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07d2c16-5253-44e7-a563-a62c305c1741 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:54.709280 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07d2c16-5253-44e7-a563-a62c305c1741 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:54.709719 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07d2c16-5253-44e7-a563-a62c305c1741 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:54.714187 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bfed8163-a4c5-4596-aa12-a7e39a560291 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.059152 Oct 10 18:52:54.714989 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 364/869] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:52:54 2022] GET /compute/v2.1/os-services => generated 944 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:54.850228 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-880c14c7-4eea-4e6b-9ff9-cc5e4907d340 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] 10.222.0.43 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.134201 Oct 10 18:52:54.855625 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 365/870] 10.222.0.43 () {58 vars in 1128 bytes} [Mon Oct 10 18:52:54 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 18:52:54.861008 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-46b04c27-c0bf-4fdc-898b-f475095af92b tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:54.866268 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46b04c27-c0bf-4fdc-898b-f475095af92b tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:54.866970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46b04c27-c0bf-4fdc-898b-f475095af92b tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:54.867479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46b04c27-c0bf-4fdc-898b-f475095af92b tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:54.868364 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46b04c27-c0bf-4fdc-898b-f475095af92b tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:54.869350 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46b04c27-c0bf-4fdc-898b-f475095af92b tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:54.869966 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46b04c27-c0bf-4fdc-898b-f475095af92b tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:54.895952 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-46b04c27-c0bf-4fdc-898b-f475095af92b tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=n-d-860863-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.039141 Oct 10 18:52:54.896940 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 366/871] 10.222.0.43 () {58 vars in 1194 bytes} [Mon Oct 10 18:52:54 2022] GET /compute/v2.1/os-services?host=n-d-860863-1&binary=xxx => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:52:54.910380 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-88fd4523-bb00-45d5-8fbd-80a2024bc5a3 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Calling method '.version_select at 0x7f318e5939d0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:54.978882 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-88fd4523-bb00-45d5-8fbd-80a2024bc5a3 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] HTTP exception thrown: Image not found. Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-88fd4523-bb00-45d5-8fbd-80a2024bc5a3 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Request method failure captured: Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoGnDNyHOgBwywpay9o6u2bAl4OSkdd0i2QitUOshMkFA3NmbvXKv5c5ZZmTlkBZsqSwvbyhQd2RORmGnGSp2WZ9y1djZYVrKhTfI5wsmR9lTzEAuhIF9CtZaAfC9U9DSyjDdVKOzzghyXNBL4Uk_ErLthhuxG0LCyLemL957dvLfc Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 7146527a9b9b490d9ea669ce419903ab Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7146527a9b9b490d9ea669ce419903ab", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7146527a9b9b490d9ea669ce419903ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7146527a9b9b490d9ea669ce419903ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7146527a9b9b490d9ea669ce419903ab"}]}] Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 7146527a9b9b490d9ea669ce419903ab Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ImagesDeleteNegativeTestJSON-2131572815-project Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 7a4437f231e14ceda4ccb3898053f8da Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815-project Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: exception: Image not found. Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '-1'} Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:54.982840 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-88fd4523-bb00-45d5-8fbd-80a2024bc5a3 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Returning 404 to user: Image not found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-88fd4523-bb00-45d5-8fbd-80a2024bc5a3 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] 10.222.0.43 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.090130 Oct 10 18:52:55.002604 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 367/872] 10.222.0.43 () {58 vars in 1134 bytes} [Mon Oct 10 18:52:54 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:52:55.020201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a5cb745a-4ea7-4c47-9ffe-1f5ba551b9e7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:55.031311 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a5cb745a-4ea7-4c47-9ffe-1f5ba551b9e7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:55.033012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a5cb745a-4ea7-4c47-9ffe-1f5ba551b9e7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:55.033012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a5cb745a-4ea7-4c47-9ffe-1f5ba551b9e7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:55.036907 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a5cb745a-4ea7-4c47-9ffe-1f5ba551b9e7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:55.038251 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a5cb745a-4ea7-4c47-9ffe-1f5ba551b9e7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:55.038790 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a5cb745a-4ea7-4c47-9ffe-1f5ba551b9e7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:55.082582 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a5cb745a-4ea7-4c47-9ffe-1f5ba551b9e7 tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.075381 Oct 10 18:52:55.083504 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 368/873] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:52:54 2022] GET /compute/v2.1/os-services => generated 944 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:55.098174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8980836b-a874-45dd-840e-47a91c8f0c30 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:55.099690 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8980836b-a874-45dd-840e-47a91c8f0c30 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:55.112460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8980836b-a874-45dd-840e-47a91c8f0c30 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:55.113142 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8980836b-a874-45dd-840e-47a91c8f0c30 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:55.113861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8980836b-a874-45dd-840e-47a91c8f0c30 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:55.115020 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8980836b-a874-45dd-840e-47a91c8f0c30 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:55.115664 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8980836b-a874-45dd-840e-47a91c8f0c30 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:55.116300 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8980836b-a874-45dd-840e-47a91c8f0c30 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:55.425723 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8980836b-a874-45dd-840e-47a91c8f0c30 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:55.442926 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8980836b-a874-45dd-840e-47a91c8f0c30 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 200 len: 1319 microversion: 2.1 time: 0.358306 Oct 10 18:52:55.445491 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 369/874] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:55 2022] GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:55.452997 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-446410b3-b3bb-4cdb-b428-8cf87529d7c0 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Calling method '.version_select at 0x7f318e781a60>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:55.477558 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-446410b3-b3bb-4cdb-b428-8cf87529d7c0 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] HTTP exception thrown: Image not found. Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-446410b3-b3bb-4cdb-b428-8cf87529d7c0 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Request method failure captured: Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/images/20ad8d63-2cef-401e-9104-000eddb3f18j HTTP/1.1 Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoGnDNyHOgBwywpay9o6u2bAl4OSkdd0i2QitUOshMkFA3NmbvXKv5c5ZZmTlkBZsqSwvbyhQd2RORmGnGSp2WZ9y1djZYVrKhTfI5wsmR9lTzEAuhIF9CtZaAfC9U9DSyjDdVKOzzghyXNBL4Uk_ErLthhuxG0LCyLemL957dvLfc Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 7146527a9b9b490d9ea669ce419903ab Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7146527a9b9b490d9ea669ce419903ab", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7146527a9b9b490d9ea669ce419903ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7146527a9b9b490d9ea669ce419903ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7146527a9b9b490d9ea669ce419903ab"}]}] Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 7146527a9b9b490d9ea669ce419903ab Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ImagesDeleteNegativeTestJSON-2131572815-project Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 7a4437f231e14ceda4ccb3898053f8da Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815-project Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: exception: Image not found. Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '20ad8d63-2cef-401e-9104-000eddb3f18j'} Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 20ad8d63-2cef-401e-9104-000eddb3f18j to delete Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 20ad8d63-2cef-401e-9104-000eddb3f18j could not be found. Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:55.480213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 18:52:55.485664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.488919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-446410b3-b3bb-4cdb-b428-8cf87529d7c0 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Returning 404 to user: Image not found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:55.490009 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-446410b3-b3bb-4cdb-b428-8cf87529d7c0 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] 10.222.0.43 "DELETE /compute/v2.1/images/20ad8d63-2cef-401e-9104-000eddb3f18j" status: 404 len: 62 microversion: 2.1 time: 0.043372 Oct 10 18:52:55.490796 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 370/875] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:55 2022] DELETE /compute/v2.1/images/20ad8d63-2cef-401e-9104-000eddb3f18j => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:52:55.497685 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a658cbcb-2f4d-4d7f-b5ce-8c21e24c32af tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:55.502822 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a658cbcb-2f4d-4d7f-b5ce-8c21e24c32af tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:55.503744 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a658cbcb-2f4d-4d7f-b5ce-8c21e24c32af tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:55.504299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a658cbcb-2f4d-4d7f-b5ce-8c21e24c32af tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:55.506374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a658cbcb-2f4d-4d7f-b5ce-8c21e24c32af tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:55.508163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a658cbcb-2f4d-4d7f-b5ce-8c21e24c32af tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:55.508904 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a658cbcb-2f4d-4d7f-b5ce-8c21e24c32af tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:55.537986 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a658cbcb-2f4d-4d7f-b5ce-8c21e24c32af tempest-ServicesAdminNegativeTestJSON-1057948478 tempest-ServicesAdminNegativeTestJSON-1057948478-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.045371 Oct 10 18:52:55.538865 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 371/876] 10.222.0.43 () {58 vars in 1198 bytes} [Mon Oct 10 18:52:55 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:52:55.544309 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dfa638cd-af03-41a2-8b21-16e1240b8ca7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:55.546327 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-dfa638cd-af03-41a2-8b21-16e1240b8ca7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:55.555142 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dfa638cd-af03-41a2-8b21-16e1240b8ca7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:55.556663 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dfa638cd-af03-41a2-8b21-16e1240b8ca7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:55.557807 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dfa638cd-af03-41a2-8b21-16e1240b8ca7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:55.559062 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dfa638cd-af03-41a2-8b21-16e1240b8ca7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:55.559951 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dfa638cd-af03-41a2-8b21-16e1240b8ca7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:55.560566 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dfa638cd-af03-41a2-8b21-16e1240b8ca7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:55.890789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-dfa638cd-af03-41a2-8b21-16e1240b8ca7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:55.896768 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b07d2c16-5253-44e7-a563-a62c305c1741 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 18805 microversion: 2.1 time: 1.523202 Oct 10 18:52:55.902322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-dfa638cd-af03-41a2-8b21-16e1240b8ca7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:55.904605 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-dfa638cd-af03-41a2-8b21-16e1240b8ca7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:55.906035 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 506/877] 10.222.0.43 () {58 vars in 1171 bytes} [Mon Oct 10 18:52:54 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 18805 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:52:55.906375 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dfa638cd-af03-41a2-8b21-16e1240b8ca7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1566 microversion: 2.25 time: 0.366101 Oct 10 18:52:55.907142 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 372/878] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:52:55 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1566 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:52:55.911802 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1754d2d2-f73e-4de6-8804-c23679e652f1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:55.926634 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cef1f248-b7c4-4f34-a8d2-8fda5ba45cbc tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Calling method '.version_select at 0x7f318e2cc310>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:55.927415 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1754d2d2-f73e-4de6-8804-c23679e652f1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:55.945474 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-cef1f248-b7c4-4f34-a8d2-8fda5ba45cbc tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] HTTP exception thrown: Image not found. Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cef1f248-b7c4-4f34-a8d2-8fda5ba45cbc tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Request method failure captured: Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/images/af5bcae4-a388-4839-b802-498ef7f354181 HTTP/1.1 Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGoGnDNyHOgBwywpay9o6u2bAl4OSkdd0i2QitUOshMkFA3NmbvXKv5c5ZZmTlkBZsqSwvbyhQd2RORmGnGSp2WZ9y1djZYVrKhTfI5wsmR9lTzEAuhIF9CtZaAfC9U9DSyjDdVKOzzghyXNBL4Uk_ErLthhuxG0LCyLemL957dvLfc Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 7146527a9b9b490d9ea669ce419903ab Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7146527a9b9b490d9ea669ce419903ab", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7146527a9b9b490d9ea669ce419903ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7146527a9b9b490d9ea669ce419903ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7146527a9b9b490d9ea669ce419903ab"}]}] Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 7146527a9b9b490d9ea669ce419903ab Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesDeleteNegativeTestJSON-2131572815-project Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 7a4437f231e14ceda4ccb3898053f8da Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815-project Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: exception: Image not found. Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'af5bcae4-a388-4839-b802-498ef7f354181'} Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image af5bcae4-a388-4839-b802-498ef7f354181 to delete Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af5bcae4-a388-4839-b802-498ef7f354181 could not be found. Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:55.947555 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:55.954451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cef1f248-b7c4-4f34-a8d2-8fda5ba45cbc tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Returning 404 to user: Image not found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:55.957807 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1754d2d2-f73e-4de6-8804-c23679e652f1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:55.957911 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cef1f248-b7c4-4f34-a8d2-8fda5ba45cbc tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] 10.222.0.43 "DELETE /compute/v2.1/images/af5bcae4-a388-4839-b802-498ef7f354181" status: 404 len: 62 microversion: 2.1 time: 0.041836 Oct 10 18:52:55.958006 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1754d2d2-f73e-4de6-8804-c23679e652f1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:55.958006 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1754d2d2-f73e-4de6-8804-c23679e652f1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:55.958192 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 507/879] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:52:55 2022] DELETE /compute/v2.1/images/af5bcae4-a388-4839-b802-498ef7f354181 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:52:55.958287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1754d2d2-f73e-4de6-8804-c23679e652f1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:55.958287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1754d2d2-f73e-4de6-8804-c23679e652f1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:55.958287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1754d2d2-f73e-4de6-8804-c23679e652f1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:55.963747 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:52:56.132564 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-31767268-bb0f-49d1-b0b1-ab6e45a28e2a tempest-ServicesAdminNegativeTestJSON-436761609 tempest-ServicesAdminNegativeTestJSON-436761609-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:56.137256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-31767268-bb0f-49d1-b0b1-ab6e45a28e2a tempest-ServicesAdminNegativeTestJSON-436761609 tempest-ServicesAdminNegativeTestJSON-436761609-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'c98d5b79e79f477891c45fe275877045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '356b7e5215cb4cb7828dcddeab164c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-31767268-bb0f-49d1-b0b1-ab6e45a28e2a tempest-ServicesAdminNegativeTestJSON-436761609 tempest-ServicesAdminNegativeTestJSON-436761609-project] Request method failure captured: Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGoBasjsa3eh7cIgtNsrgNZinNyXVAYpA-0bZl6nKqSRp-p5b0lhH9F8KiVCDBnp_lesCYXXFkszIE-PX4cm_azR4_W-GdhUF7DTipoGrTeK3VCvOpcHSPwWSvSdn-mn86waSGxJLwsKuwwwJwQvFMU1RIT1mUCVnIVOPx3aSwwVxm8 Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 356b7e5215cb4cb7828dcddeab164c9d Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-436761609 Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_356b7e5215cb4cb7828dcddeab164c9d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/356b7e5215cb4cb7828dcddeab164c9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/356b7e5215cb4cb7828dcddeab164c9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/356b7e5215cb4cb7828dcddeab164c9d"}]}] Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-436761609 Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 356b7e5215cb4cb7828dcddeab164c9d Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-436761609 Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServicesAdminNegativeTestJSON-436761609-project Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c98d5b79e79f477891c45fe275877045 Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-436761609-project Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: action_args: {} Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise self.value Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 18:52:56.139325 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:56.145779 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:56.145779 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:56.145779 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:56.145779 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:56.145779 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:56.145779 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 10 18:52:56.145779 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 10 18:52:56.145779 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 10 18:52:56.145779 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:56.145779 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-31767268-bb0f-49d1-b0b1-ab6e45a28e2a tempest-ServicesAdminNegativeTestJSON-436761609 tempest-ServicesAdminNegativeTestJSON-436761609-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:56.145779 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-31767268-bb0f-49d1-b0b1-ab6e45a28e2a tempest-ServicesAdminNegativeTestJSON-436761609 tempest-ServicesAdminNegativeTestJSON-436761609-project] 10.222.0.43 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.190038 Oct 10 18:52:56.146886 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 508/880] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:52:55 2022] GET /compute/v2.1/os-services => generated 112 bytes in 195 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:52:56.156268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5c575546-306d-4ad4-9e53-4717c071c18a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:56.159749 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5c575546-306d-4ad4-9e53-4717c071c18a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:56.167537 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5c575546-306d-4ad4-9e53-4717c071c18a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:56.168649 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5c575546-306d-4ad4-9e53-4717c071c18a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:56.169258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5c575546-306d-4ad4-9e53-4717c071c18a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:56.170231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5c575546-306d-4ad4-9e53-4717c071c18a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:56.170931 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5c575546-306d-4ad4-9e53-4717c071c18a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:56.171982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5c575546-306d-4ad4-9e53-4717c071c18a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:56.393786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5c575546-306d-4ad4-9e53-4717c071c18a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:56.408115 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5c575546-306d-4ad4-9e53-4717c071c18a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1270 microversion: 2.1 time: 0.260085 Oct 10 18:52:56.410445 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 509/881] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:56 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1270 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:56.427493 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8595c8a3-3fd6-443f-8f62-96bafb0f8495 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:56.433887 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8595c8a3-3fd6-443f-8f62-96bafb0f8495 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Searching by: {'deleted': False, 'project_id': 'c95cf57ba7a94eafb03f875b07ebacb9'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:52:56.451628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8595c8a3-3fd6-443f-8f62-96bafb0f8495 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:56.452479 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8595c8a3-3fd6-443f-8f62-96bafb0f8495 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:56.453174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8595c8a3-3fd6-443f-8f62-96bafb0f8495 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:56.455615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8595c8a3-3fd6-443f-8f62-96bafb0f8495 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:56.456772 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8595c8a3-3fd6-443f-8f62-96bafb0f8495 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:56.457549 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8595c8a3-3fd6-443f-8f62-96bafb0f8495 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:56.513138 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1754d2d2-f73e-4de6-8804-c23679e652f1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:56.515461 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8595c8a3-3fd6-443f-8f62-96bafb0f8495 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?tenant_id=b15c92e4a6804ff5ba5d91c342f6c529" status: 200 len: 15 microversion: 2.1 time: 0.103709 Oct 10 18:52:56.521647 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 510/882] 10.222.0.43 () {58 vars in 1231 bytes} [Mon Oct 10 18:52:56 2022] GET /compute/v2.1/servers/detail?tenant_id=b15c92e4a6804ff5ba5d91c342f6c529 => generated 15 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:52:56.537240 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1754d2d2-f73e-4de6-8804-c23679e652f1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1316 microversion: 2.1 time: 0.621361 Oct 10 18:52:56.537240 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 373/883] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:55 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:56.556714 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-41546b03-2fc2-4fff-9c90-6543d08873b9 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Calling method '.version_select at 0x7f318e2b6820>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:56.567043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cece469a-f635-4a9e-9142-16c5aef8048d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:56.621590 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cece469a-f635-4a9e-9142-16c5aef8048d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:56.622378 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-41546b03-2fc2-4fff-9c90-6543d08873b9 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] HTTP exception thrown: Image not found. Oct 10 18:52:56.622467 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cece469a-f635-4a9e-9142-16c5aef8048d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:56.622467 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cece469a-f635-4a9e-9142-16c5aef8048d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:56.622467 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cece469a-f635-4a9e-9142-16c5aef8048d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:56.622467 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cece469a-f635-4a9e-9142-16c5aef8048d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-41546b03-2fc2-4fff-9c90-6543d08873b9 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Request method failure captured: Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/images/tempest-invalid-1205814411 HTTP/1.1 Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGoGnDNyHOgBwywpay9o6u2bAl4OSkdd0i2QitUOshMkFA3NmbvXKv5c5ZZmTlkBZsqSwvbyhQd2RORmGnGSp2WZ9y1djZYVrKhTfI5wsmR9lTzEAuhIF9CtZaAfC9U9DSyjDdVKOzzghyXNBL4Uk_ErLthhuxG0LCyLemL957dvLfc Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 7146527a9b9b490d9ea669ce419903ab Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7146527a9b9b490d9ea669ce419903ab", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7146527a9b9b490d9ea669ce419903ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7146527a9b9b490d9ea669ce419903ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7146527a9b9b490d9ea669ce419903ab"}]}] Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 7146527a9b9b490d9ea669ce419903ab Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesDeleteNegativeTestJSON-2131572815-project Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 7a4437f231e14ceda4ccb3898053f8da Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815-project Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: exception: Image not found. Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'tempest-invalid-1205814411'} Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1205814411 to delete Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1205814411 could not be found. Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:56.622762 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 18:52:56.629356 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:52:56.631030 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cece469a-f635-4a9e-9142-16c5aef8048d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:56.631133 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-41546b03-2fc2-4fff-9c90-6543d08873b9 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Returning 404 to user: Image not found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:56.631133 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-41546b03-2fc2-4fff-9c90-6543d08873b9 tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] 10.222.0.43 "DELETE /compute/v2.1/images/tempest-invalid-1205814411" status: 404 len: 62 microversion: 2.1 time: 0.071300 Oct 10 18:52:56.631133 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 511/884] 10.222.0.43 () {58 vars in 1206 bytes} [Mon Oct 10 18:52:56 2022] DELETE /compute/v2.1/images/tempest-invalid-1205814411 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:52:56.631922 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cece469a-f635-4a9e-9142-16c5aef8048d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:56.632041 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d43030e5-22a8-4265-a90f-d87eccfacf83 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:56.632041 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d43030e5-22a8-4265-a90f-d87eccfacf83 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Searching by: {'tenant_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'deleted': False} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:52:56.632041 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d43030e5-22a8-4265-a90f-d87eccfacf83 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:56.632041 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d43030e5-22a8-4265-a90f-d87eccfacf83 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:56.636573 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d43030e5-22a8-4265-a90f-d87eccfacf83 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:56.636573 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d43030e5-22a8-4265-a90f-d87eccfacf83 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:56.636573 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d43030e5-22a8-4265-a90f-d87eccfacf83 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:56.636573 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d43030e5-22a8-4265-a90f-d87eccfacf83 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:56.683504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-d43030e5-22a8-4265-a90f-d87eccfacf83 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 18:52:56.737746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d43030e5-22a8-4265-a90f-d87eccfacf83 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:56.738370 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d43030e5-22a8-4265-a90f-d87eccfacf83 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:56.738876 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d43030e5-22a8-4265-a90f-d87eccfacf83 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:56.992488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cece469a-f635-4a9e-9142-16c5aef8048d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:57.002148 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cece469a-f635-4a9e-9142-16c5aef8048d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 200 len: 1319 microversion: 2.1 time: 0.464037 Oct 10 18:52:57.006534 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 374/885] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:56 2022] GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:57.012190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-64eb4fa7-e696-49e3-bd6b-5f897df1d8ba tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Calling method '.version_select at 0x7f318eac8af0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:57.037645 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-64eb4fa7-e696-49e3-bd6b-5f897df1d8ba tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] HTTP exception thrown: Image not found. Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-64eb4fa7-e696-49e3-bd6b-5f897df1d8ba tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Request method failure captured: Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/images/3504e5e5-e039-4c3d-9782-b341740b69d7 HTTP/1.1 Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoGnDNyHOgBwywpay9o6u2bAl4OSkdd0i2QitUOshMkFA3NmbvXKv5c5ZZmTlkBZsqSwvbyhQd2RORmGnGSp2WZ9y1djZYVrKhTfI5wsmR9lTzEAuhIF9CtZaAfC9U9DSyjDdVKOzzghyXNBL4Uk_ErLthhuxG0LCyLemL957dvLfc Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 7146527a9b9b490d9ea669ce419903ab Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7146527a9b9b490d9ea669ce419903ab", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7146527a9b9b490d9ea669ce419903ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7146527a9b9b490d9ea669ce419903ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7146527a9b9b490d9ea669ce419903ab"}]}] Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 7146527a9b9b490d9ea669ce419903ab Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815 Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ImagesDeleteNegativeTestJSON-2131572815-project Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 7a4437f231e14ceda4ccb3898053f8da Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2131572815-project Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: exception: Image not found. Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '3504e5e5-e039-4c3d-9782-b341740b69d7'} Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3504e5e5-e039-4c3d-9782-b341740b69d7 to delete Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3504e5e5-e039-4c3d-9782-b341740b69d7 could not be found. Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:57.040236 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 18:52:57.045911 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:52:57.049828 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-64eb4fa7-e696-49e3-bd6b-5f897df1d8ba tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] Returning 404 to user: Image not found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:52:57.051029 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-64eb4fa7-e696-49e3-bd6b-5f897df1d8ba tempest-ImagesDeleteNegativeTestJSON-2131572815 tempest-ImagesDeleteNegativeTestJSON-2131572815-project] 10.222.0.43 "DELETE /compute/v2.1/images/3504e5e5-e039-4c3d-9782-b341740b69d7" status: 404 len: 62 microversion: 2.1 time: 0.043027 Oct 10 18:52:57.058650 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 375/886] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:57 2022] DELETE /compute/v2.1/images/3504e5e5-e039-4c3d-9782-b341740b69d7 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:52:57.072496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d0f7d62d-dff4-4fab-8e44-062579acfbd8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:57.075481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d0f7d62d-dff4-4fab-8e44-062579acfbd8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:57.099046 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0f7d62d-dff4-4fab-8e44-062579acfbd8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:57.099046 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0f7d62d-dff4-4fab-8e44-062579acfbd8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:57.099046 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0f7d62d-dff4-4fab-8e44-062579acfbd8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:57.101374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0f7d62d-dff4-4fab-8e44-062579acfbd8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:57.101956 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0f7d62d-dff4-4fab-8e44-062579acfbd8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:57.102408 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0f7d62d-dff4-4fab-8e44-062579acfbd8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:57.499524 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d43030e5-22a8-4265-a90f-d87eccfacf83 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b15c92e4a6804ff5ba5d91c342f6c529" status: 200 len: 4826 microversion: 2.1 time: 0.901164 Oct 10 18:52:57.501415 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 512/887] 10.222.0.43 () {58 vars in 1257 bytes} [Mon Oct 10 18:52:56 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b15c92e4a6804ff5ba5d91c342f6c529 => generated 4826 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:57.520814 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f71e6b8f-367a-4431-b4e8-e2078d75534b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:57.521627 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f71e6b8f-367a-4431-b4e8-e2078d75534b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:57.539227 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f71e6b8f-367a-4431-b4e8-e2078d75534b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:57.560307 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f71e6b8f-367a-4431-b4e8-e2078d75534b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:57.560922 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f71e6b8f-367a-4431-b4e8-e2078d75534b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:57.564152 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f71e6b8f-367a-4431-b4e8-e2078d75534b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:57.564658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f71e6b8f-367a-4431-b4e8-e2078d75534b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:57.565294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f71e6b8f-367a-4431-b4e8-e2078d75534b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:57.680085 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f71e6b8f-367a-4431-b4e8-e2078d75534b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:57.691636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d0f7d62d-dff4-4fab-8e44-062579acfbd8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:57.694539 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f71e6b8f-367a-4431-b4e8-e2078d75534b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1276 microversion: 2.1 time: 0.191899 Oct 10 18:52:57.695614 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 513/888] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:57 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:57.701666 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b0831677-0d1f-469d-995e-c37565d08f91 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:57.709067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b0831677-0d1f-469d-995e-c37565d08f91 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Searching by: {'tenant_id': 'c95cf57ba7a94eafb03f875b07ebacb9', 'deleted': False} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:52:57.709681 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d0f7d62d-dff4-4fab-8e44-062579acfbd8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:57.716529 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d0f7d62d-dff4-4fab-8e44-062579acfbd8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:57.720303 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d0f7d62d-dff4-4fab-8e44-062579acfbd8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1566 microversion: 2.25 time: 0.659004 Oct 10 18:52:57.720437 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0831677-0d1f-469d-995e-c37565d08f91 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:57.720613 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 376/889] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:52:57 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1566 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:52:57.720738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0831677-0d1f-469d-995e-c37565d08f91 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:57.722743 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0831677-0d1f-469d-995e-c37565d08f91 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:57.723570 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0831677-0d1f-469d-995e-c37565d08f91 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:57.724040 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0831677-0d1f-469d-995e-c37565d08f91 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:57.724469 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0831677-0d1f-469d-995e-c37565d08f91 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:57.744195 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9e9b7299-4aff-40d3-a4b1-ce0271c5a702 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:57.748733 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9e9b7299-4aff-40d3-a4b1-ce0271c5a702 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:57.754757 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e9b7299-4aff-40d3-a4b1-ce0271c5a702 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:57.755968 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e9b7299-4aff-40d3-a4b1-ce0271c5a702 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:57.756648 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e9b7299-4aff-40d3-a4b1-ce0271c5a702 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:57.758394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e9b7299-4aff-40d3-a4b1-ce0271c5a702 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:57.759359 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e9b7299-4aff-40d3-a4b1-ce0271c5a702 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:57.760587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e9b7299-4aff-40d3-a4b1-ce0271c5a702 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:57.781271 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b0831677-0d1f-469d-995e-c37565d08f91 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c95cf57ba7a94eafb03f875b07ebacb9" status: 200 len: 15 microversion: 2.1 time: 0.084215 Oct 10 18:52:57.782130 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 514/890] 10.222.0.43 () {58 vars in 1257 bytes} [Mon Oct 10 18:52:57 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c95cf57ba7a94eafb03f875b07ebacb9 => generated 15 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:52:57.810210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-34e75fdd-f396-49e1-b15b-9d535cebd581 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:57.819357 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-34e75fdd-f396-49e1-b15b-9d535cebd581 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.013634 Oct 10 18:52:57.822067 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 515/891] 10.222.0.43 () {58 vars in 1189 bytes} [Mon Oct 10 18:52:57 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 18:52:57.852034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ad90a009-538d-425a-a2ba-ed7f7cdf1d4d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:57.854673 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ad90a009-538d-425a-a2ba-ed7f7cdf1d4d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:57.862349 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ad90a009-538d-425a-a2ba-ed7f7cdf1d4d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:57.863334 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ad90a009-538d-425a-a2ba-ed7f7cdf1d4d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:57.864099 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ad90a009-538d-425a-a2ba-ed7f7cdf1d4d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:57.866114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ad90a009-538d-425a-a2ba-ed7f7cdf1d4d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:57.866939 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ad90a009-538d-425a-a2ba-ed7f7cdf1d4d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:57.868127 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ad90a009-538d-425a-a2ba-ed7f7cdf1d4d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:58.200143 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ad90a009-538d-425a-a2ba-ed7f7cdf1d4d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff/action" status: 202 len: 0 microversion: 2.1 time: 0.356372 Oct 10 18:52:58.205298 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 516/892] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:52:57 2022] POST /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:52:58.213503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0a024744-4516-4109-a21d-567ebe03dfc0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:58.215077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0a024744-4516-4109-a21d-567ebe03dfc0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:58.260737 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0a024744-4516-4109-a21d-567ebe03dfc0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:58.262118 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0a024744-4516-4109-a21d-567ebe03dfc0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:58.263101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0a024744-4516-4109-a21d-567ebe03dfc0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:58.266257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0a024744-4516-4109-a21d-567ebe03dfc0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:58.269234 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0a024744-4516-4109-a21d-567ebe03dfc0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:58.270290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0a024744-4516-4109-a21d-567ebe03dfc0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:58.534357 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9e9b7299-4aff-40d3-a4b1-ce0271c5a702 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:58.560775 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9e9b7299-4aff-40d3-a4b1-ce0271c5a702 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1316 microversion: 2.1 time: 0.828321 Oct 10 18:52:58.562581 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 377/893] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:57 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1316 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:58.579105 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6f200c7d-fc11-469b-b387-df856a6f19a6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:58.584402 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6f200c7d-fc11-469b-b387-df856a6f19a6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:58.585178 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6f200c7d-fc11-469b-b387-df856a6f19a6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529'} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:52:58.608192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f200c7d-fc11-469b-b387-df856a6f19a6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:58.608855 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f200c7d-fc11-469b-b387-df856a6f19a6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:58.609394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f200c7d-fc11-469b-b387-df856a6f19a6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:58.610210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f200c7d-fc11-469b-b387-df856a6f19a6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:58.610912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f200c7d-fc11-469b-b387-df856a6f19a6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:58.611554 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f200c7d-fc11-469b-b387-df856a6f19a6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:58.714283 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.multi_cell_list [None req-6f200c7d-fc11-469b-b387-df856a6f19a6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127289) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 18:52:58.795973 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6f200c7d-fc11-469b-b387-df856a6f19a6 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.230529 Oct 10 18:52:58.797424 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 378/894] 10.222.0.43 () {58 vars in 1150 bytes} [Mon Oct 10 18:52:58 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:58.803589 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-363dbbdf-2bf0-4d37-82d0-6da277c8e9bd tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:58.803843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0a024744-4516-4109-a21d-567ebe03dfc0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:58.805600 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-363dbbdf-2bf0-4d37-82d0-6da277c8e9bd tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:58.813253 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0a024744-4516-4109-a21d-567ebe03dfc0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 200 len: 1319 microversion: 2.1 time: 0.606651 Oct 10 18:52:58.813957 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 517/895] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:58 2022] GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 1319 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:58.814475 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-363dbbdf-2bf0-4d37-82d0-6da277c8e9bd tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:58.815633 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-363dbbdf-2bf0-4d37-82d0-6da277c8e9bd tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:58.816448 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-363dbbdf-2bf0-4d37-82d0-6da277c8e9bd tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:58.817444 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-363dbbdf-2bf0-4d37-82d0-6da277c8e9bd tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:58.818063 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-363dbbdf-2bf0-4d37-82d0-6da277c8e9bd tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:58.818663 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-363dbbdf-2bf0-4d37-82d0-6da277c8e9bd tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:58.840882 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6f1a3ce7-4dde-4317-8d01-4d96f3958d1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:58.842243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6f1a3ce7-4dde-4317-8d01-4d96f3958d1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:58.848921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6f1a3ce7-4dde-4317-8d01-4d96f3958d1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:58.849404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6f1a3ce7-4dde-4317-8d01-4d96f3958d1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:58.849827 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6f1a3ce7-4dde-4317-8d01-4d96f3958d1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:58.850531 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6f1a3ce7-4dde-4317-8d01-4d96f3958d1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:58.850978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6f1a3ce7-4dde-4317-8d01-4d96f3958d1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:58.851393 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6f1a3ce7-4dde-4317-8d01-4d96f3958d1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:59.110463 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-363dbbdf-2bf0-4d37-82d0-6da277c8e9bd tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:59.122331 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-363dbbdf-2bf0-4d37-82d0-6da277c8e9bd tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1276 microversion: 2.1 time: 0.323636 Oct 10 18:52:59.130152 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 379/896] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:58 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1276 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:52:59.134424 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2a8561c4-1a23-4afd-bad2-ffddf545aa40 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:59.138234 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2a8561c4-1a23-4afd-bad2-ffddf545aa40 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:59.147626 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2a8561c4-1a23-4afd-bad2-ffddf545aa40 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:59.148214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2a8561c4-1a23-4afd-bad2-ffddf545aa40 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:59.148809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2a8561c4-1a23-4afd-bad2-ffddf545aa40 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:59.149660 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2a8561c4-1a23-4afd-bad2-ffddf545aa40 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:59.150245 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2a8561c4-1a23-4afd-bad2-ffddf545aa40 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:59.151290 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2a8561c4-1a23-4afd-bad2-ffddf545aa40 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:59.298564 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6f1a3ce7-4dde-4317-8d01-4d96f3958d1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:59.308114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6f1a3ce7-4dde-4317-8d01-4d96f3958d1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:59.309609 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6f1a3ce7-4dde-4317-8d01-4d96f3958d1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:52:59.311210 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6f1a3ce7-4dde-4317-8d01-4d96f3958d1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1566 microversion: 2.25 time: 0.495951 Oct 10 18:52:59.311837 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 518/897] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:52:58 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1566 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:52:59.316813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-68d88e9c-ad7f-47c8-b5d7-3d56ac12328f req-b6bef78e-671c-4efe-88a3-a543556e801d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1beef1-3d9a-4af8-ac68-048748261c19", "name": "network-vif-plugged", "status": "completed", "tag": "98401b59-e218-4900-acf6-4ca8bcde0d49"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:59.328196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-68d88e9c-ad7f-47c8-b5d7-3d56ac12328f req-b6bef78e-671c-4efe-88a3-a543556e801d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:59.328992 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-68d88e9c-ad7f-47c8-b5d7-3d56ac12328f req-b6bef78e-671c-4efe-88a3-a543556e801d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:59.329749 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-68d88e9c-ad7f-47c8-b5d7-3d56ac12328f req-b6bef78e-671c-4efe-88a3-a543556e801d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:59.347476 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-68d88e9c-ad7f-47c8-b5d7-3d56ac12328f req-b6bef78e-671c-4efe-88a3-a543556e801d service nova] Creating event network-vif-plugged:98401b59-e218-4900-acf6-4ca8bcde0d49 for instance cf1beef1-3d9a-4af8-ac68-048748261c19 on n-h2-860863-1 Oct 10 18:52:59.357516 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-68d88e9c-ad7f-47c8-b5d7-3d56ac12328f req-b6bef78e-671c-4efe-88a3-a543556e801d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040408 Oct 10 18:52:59.357516 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 519/898] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:59.362459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-30c9265c-6148-46b6-8418-855ab62bcc30 req-78b2e0d7-3603-41dc-bd5d-a62efe6fb207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa4cba0-5184-462b-ab0b-c03f2a104ae6", "name": "network-vif-unplugged", "status": "completed", "tag": "aa9423e0-a4d9-48ba-8535-6f8ecab069a0"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:52:59.390877 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-30c9265c-6148-46b6-8418-855ab62bcc30 req-78b2e0d7-3603-41dc-bd5d-a62efe6fb207 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:59.392033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-30c9265c-6148-46b6-8418-855ab62bcc30 req-78b2e0d7-3603-41dc-bd5d-a62efe6fb207 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:59.392907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-30c9265c-6148-46b6-8418-855ab62bcc30 req-78b2e0d7-3603-41dc-bd5d-a62efe6fb207 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:59.421147 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-30c9265c-6148-46b6-8418-855ab62bcc30 req-78b2e0d7-3603-41dc-bd5d-a62efe6fb207 service nova] Creating event network-vif-unplugged:aa9423e0-a4d9-48ba-8535-6f8ecab069a0 for instance 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 on n-h1-860863-1 Oct 10 18:52:59.430266 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-30c9265c-6148-46b6-8418-855ab62bcc30 req-78b2e0d7-3603-41dc-bd5d-a62efe6fb207 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073389 Oct 10 18:52:59.435375 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 520/899] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:52:59.605749 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d7d5ee6a-db38-47e6-9d94-0a6c10e69b85 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:59.607867 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2a8561c4-1a23-4afd-bad2-ffddf545aa40 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff/action" status: 202 len: 0 microversion: 2.1 time: 0.479909 Oct 10 18:52:59.608008 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d7d5ee6a-db38-47e6-9d94-0a6c10e69b85 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:59.608114 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 380/900] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:52:59 2022] POST /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:52:59.618707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-61fcff11-0723-4613-b4f5-f810b27fbdd4 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:52:59.618707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-61fcff11-0723-4613-b4f5-f810b27fbdd4 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:52:59.635292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d7d5ee6a-db38-47e6-9d94-0a6c10e69b85 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:59.636898 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d7d5ee6a-db38-47e6-9d94-0a6c10e69b85 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:59.637335 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d7d5ee6a-db38-47e6-9d94-0a6c10e69b85 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:59.638060 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d7d5ee6a-db38-47e6-9d94-0a6c10e69b85 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:59.638506 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d7d5ee6a-db38-47e6-9d94-0a6c10e69b85 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:59.648335 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d7d5ee6a-db38-47e6-9d94-0a6c10e69b85 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:59.654555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-61fcff11-0723-4613-b4f5-f810b27fbdd4 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:59.655517 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-61fcff11-0723-4613-b4f5-f810b27fbdd4 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:59.656172 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-61fcff11-0723-4613-b4f5-f810b27fbdd4 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:52:59.657675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-61fcff11-0723-4613-b4f5-f810b27fbdd4 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:52:59.658399 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-61fcff11-0723-4613-b4f5-f810b27fbdd4 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:52:59.660528 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-61fcff11-0723-4613-b4f5-f810b27fbdd4 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:00.035316 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d7d5ee6a-db38-47e6-9d94-0a6c10e69b85 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:00.044679 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d7d5ee6a-db38-47e6-9d94-0a6c10e69b85 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1316 microversion: 2.1 time: 0.443708 Oct 10 18:53:00.045696 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 521/901] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:59 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:00.050439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-8d4554b7-db52-47b7-82de-b5bc1ab12157 req-ccd7e1b3-d9e9-43b4-973a-9c4aa1604ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d908aa91-59b6-4c75-b6d2-30e97e050a55", "tag": "b0f98a85-8566-4775-a260-badc6b8f6997"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:00.062396 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8d4554b7-db52-47b7-82de-b5bc1ab12157 req-ccd7e1b3-d9e9-43b4-973a-9c4aa1604ec4 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:00.062967 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8d4554b7-db52-47b7-82de-b5bc1ab12157 req-ccd7e1b3-d9e9-43b4-973a-9c4aa1604ec4 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:00.063465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8d4554b7-db52-47b7-82de-b5bc1ab12157 req-ccd7e1b3-d9e9-43b4-973a-9c4aa1604ec4 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:00.074964 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-8d4554b7-db52-47b7-82de-b5bc1ab12157 req-ccd7e1b3-d9e9-43b4-973a-9c4aa1604ec4 service nova] Creating event network-changed:b0f98a85-8566-4775-a260-badc6b8f6997 for instance d908aa91-59b6-4c75-b6d2-30e97e050a55 on n-h2-860863-1 Oct 10 18:53:00.079692 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-8d4554b7-db52-47b7-82de-b5bc1ab12157 req-ccd7e1b3-d9e9-43b4-973a-9c4aa1604ec4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032628 Oct 10 18:53:00.080368 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 522/902] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:00.085815 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fe4b6e35-6cda-46f2-b842-e23ac3516cd4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:00.086423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fe4b6e35-6cda-46f2-b842-e23ac3516cd4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:00.093248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fe4b6e35-6cda-46f2-b842-e23ac3516cd4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:00.093733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fe4b6e35-6cda-46f2-b842-e23ac3516cd4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:00.094164 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fe4b6e35-6cda-46f2-b842-e23ac3516cd4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:00.094951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fe4b6e35-6cda-46f2-b842-e23ac3516cd4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:00.095359 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fe4b6e35-6cda-46f2-b842-e23ac3516cd4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:00.095768 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fe4b6e35-6cda-46f2-b842-e23ac3516cd4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:00.199461 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-61fcff11-0723-4613-b4f5-f810b27fbdd4 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1615 microversion: 2.1 time: 0.585768 Oct 10 18:53:00.220646 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 381/903] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:52:59 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1615 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:00.247843 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a5ae523c-72b6-42be-a832-3f2d83165a16 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:00.248463 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a5ae523c-72b6-42be-a832-3f2d83165a16 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:00.258548 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a5ae523c-72b6-42be-a832-3f2d83165a16 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:00.259033 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a5ae523c-72b6-42be-a832-3f2d83165a16 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:00.259463 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a5ae523c-72b6-42be-a832-3f2d83165a16 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:00.260736 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a5ae523c-72b6-42be-a832-3f2d83165a16 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:00.261267 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a5ae523c-72b6-42be-a832-3f2d83165a16 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:00.264267 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a5ae523c-72b6-42be-a832-3f2d83165a16 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:00.409873 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a5ae523c-72b6-42be-a832-3f2d83165a16 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:00.422012 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a5ae523c-72b6-42be-a832-3f2d83165a16 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1276 microversion: 2.1 time: 0.180298 Oct 10 18:53:00.422795 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 382/904] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:00 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:00.448065 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0e96635f-47bf-4eac-8395-95f0a5c33fab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:00.448766 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0e96635f-47bf-4eac-8395-95f0a5c33fab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:00.454955 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e96635f-47bf-4eac-8395-95f0a5c33fab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:00.455452 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e96635f-47bf-4eac-8395-95f0a5c33fab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:00.455888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e96635f-47bf-4eac-8395-95f0a5c33fab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:00.456624 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e96635f-47bf-4eac-8395-95f0a5c33fab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:00.457084 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e96635f-47bf-4eac-8395-95f0a5c33fab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:00.457504 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0e96635f-47bf-4eac-8395-95f0a5c33fab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:00.522161 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fe4b6e35-6cda-46f2-b842-e23ac3516cd4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:00.532564 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fe4b6e35-6cda-46f2-b842-e23ac3516cd4 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 200 len: 1319 microversion: 2.1 time: 0.450864 Oct 10 18:53:00.537633 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 523/905] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:00 2022] GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:00.568228 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a6c95306-6fdd-429f-94a6-13b28870ce95 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:00.571109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a6c95306-6fdd-429f-94a6-13b28870ce95 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:00.582773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6c95306-6fdd-429f-94a6-13b28870ce95 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:00.582773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6c95306-6fdd-429f-94a6-13b28870ce95 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:00.582773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6c95306-6fdd-429f-94a6-13b28870ce95 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:00.582773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6c95306-6fdd-429f-94a6-13b28870ce95 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:00.583302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6c95306-6fdd-429f-94a6-13b28870ce95 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:00.583905 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6c95306-6fdd-429f-94a6-13b28870ce95 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:01.174825 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0e96635f-47bf-4eac-8395-95f0a5c33fab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1615 microversion: 2.1 time: 0.730607 Oct 10 18:53:01.196049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a6c95306-6fdd-429f-94a6-13b28870ce95 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:01.199809 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 383/906] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:00 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1615 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:01.205360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-39b94fdd-3eaf-49ec-85ca-1f98849f4b3a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:01.212014 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-39b94fdd-3eaf-49ec-85ca-1f98849f4b3a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:01.224250 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39b94fdd-3eaf-49ec-85ca-1f98849f4b3a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:01.227277 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a6c95306-6fdd-429f-94a6-13b28870ce95 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:01.227448 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39b94fdd-3eaf-49ec-85ca-1f98849f4b3a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:01.234099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39b94fdd-3eaf-49ec-85ca-1f98849f4b3a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:01.234099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39b94fdd-3eaf-49ec-85ca-1f98849f4b3a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:01.234099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39b94fdd-3eaf-49ec-85ca-1f98849f4b3a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:01.234099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39b94fdd-3eaf-49ec-85ca-1f98849f4b3a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:01.242091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a6c95306-6fdd-429f-94a6-13b28870ce95 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:01.249648 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a6c95306-6fdd-429f-94a6-13b28870ce95 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1566 microversion: 2.25 time: 0.708692 Oct 10 18:53:01.250635 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 524/907] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:00 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1566 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:01.276140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bf5993c7-c021-4035-9c2e-401261e54a5d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:01.306218 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bf5993c7-c021-4035-9c2e-401261e54a5d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Searching by: {'host': 'n-h1-860863-1', 'deleted': False} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:53:01.318966 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bf5993c7-c021-4035-9c2e-401261e54a5d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:01.319685 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bf5993c7-c021-4035-9c2e-401261e54a5d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:01.320288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bf5993c7-c021-4035-9c2e-401261e54a5d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:01.321230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bf5993c7-c021-4035-9c2e-401261e54a5d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:01.321843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bf5993c7-c021-4035-9c2e-401261e54a5d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:01.323025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bf5993c7-c021-4035-9c2e-401261e54a5d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:01.427606 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-bf5993c7-c021-4035-9c2e-401261e54a5d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 18:53:01.506933 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bf5993c7-c021-4035-9c2e-401261e54a5d tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "GET /compute/v2.1/servers?host=n-h1-860863-1&all_tenants=1" status: 200 len: 1656 microversion: 2.1 time: 0.249938 Oct 10 18:53:01.511038 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 525/908] 10.222.0.43 () {58 vars in 1190 bytes} [Mon Oct 10 18:53:01 2022] GET /compute/v2.1/servers?host=n-h1-860863-1&all_tenants=1 => generated 1656 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:01.517455 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-39b94fdd-3eaf-49ec-85ca-1f98849f4b3a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:01.528652 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-39b94fdd-3eaf-49ec-85ca-1f98849f4b3a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1316 microversion: 2.1 time: 0.327101 Oct 10 18:53:01.529196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b664fc2e-cf93-4ab2-80e9-2db4532cdaf3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:01.529944 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 384/909] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:01 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:01.532841 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b664fc2e-cf93-4ab2-80e9-2db4532cdaf3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:01.545059 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b664fc2e-cf93-4ab2-80e9-2db4532cdaf3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:01.545752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-d1fa114e-bc89-4783-bb95-6354c576f548 req-2260eb7b-c854-4346-a956-19eb807932a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f72bf2-33cf-49a6-9b20-7fafcee472cd", "tag": "34c30487-9b21-45bd-8ec6-5e68a0c5a60f"}, {"name": "network-changed", "server_uuid": "7fa4cba0-5184-462b-ab0b-c03f2a104ae6", "tag": "aa9423e0-a4d9-48ba-8535-6f8ecab069a0"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:01.551522 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b664fc2e-cf93-4ab2-80e9-2db4532cdaf3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:01.551971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b664fc2e-cf93-4ab2-80e9-2db4532cdaf3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:01.552741 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b664fc2e-cf93-4ab2-80e9-2db4532cdaf3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:01.553197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b664fc2e-cf93-4ab2-80e9-2db4532cdaf3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:01.553622 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b664fc2e-cf93-4ab2-80e9-2db4532cdaf3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:01.566120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d1fa114e-bc89-4783-bb95-6354c576f548 req-2260eb7b-c854-4346-a956-19eb807932a4 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:01.568084 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d1fa114e-bc89-4783-bb95-6354c576f548 req-2260eb7b-c854-4346-a956-19eb807932a4 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:01.568084 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d1fa114e-bc89-4783-bb95-6354c576f548 req-2260eb7b-c854-4346-a956-19eb807932a4 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:01.597117 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-d1fa114e-bc89-4783-bb95-6354c576f548 req-2260eb7b-c854-4346-a956-19eb807932a4 service nova] Creating event network-changed:34c30487-9b21-45bd-8ec6-5e68a0c5a60f for instance b2f72bf2-33cf-49a6-9b20-7fafcee472cd on n-h1-860863-1 Oct 10 18:53:01.597117 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-d1fa114e-bc89-4783-bb95-6354c576f548 req-2260eb7b-c854-4346-a956-19eb807932a4 service nova] Creating event network-changed:aa9423e0-a4d9-48ba-8535-6f8ecab069a0 for instance 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 on n-h1-860863-1 Oct 10 18:53:01.608326 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-d1fa114e-bc89-4783-bb95-6354c576f548 req-2260eb7b-c854-4346-a956-19eb807932a4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.076330 Oct 10 18:53:01.612243 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 385/910] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:01.617497 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-491db42a-5ead-4f5f-8c58-7f771eb14cfb tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:01.629473 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-491db42a-5ead-4f5f-8c58-7f771eb14cfb tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:53:01.637351 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-491db42a-5ead-4f5f-8c58-7f771eb14cfb tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:01.638047 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-491db42a-5ead-4f5f-8c58-7f771eb14cfb tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:01.638647 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-491db42a-5ead-4f5f-8c58-7f771eb14cfb tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:01.639649 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-491db42a-5ead-4f5f-8c58-7f771eb14cfb tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:01.640530 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-491db42a-5ead-4f5f-8c58-7f771eb14cfb tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:01.641334 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-491db42a-5ead-4f5f-8c58-7f771eb14cfb tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:01.764039 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-491db42a-5ead-4f5f-8c58-7f771eb14cfb tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.150342 Oct 10 18:53:01.764783 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 386/911] 10.222.0.43 () {58 vars in 1196 bytes} [Mon Oct 10 18:53:01 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:53:01.769802 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b81f7143-792f-47db-9feb-5523fa129e41 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:01.771863 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b81f7143-792f-47db-9feb-5523fa129e41 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:01.778031 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b81f7143-792f-47db-9feb-5523fa129e41 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:01.778698 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b81f7143-792f-47db-9feb-5523fa129e41 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:01.779235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b81f7143-792f-47db-9feb-5523fa129e41 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:01.780132 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b81f7143-792f-47db-9feb-5523fa129e41 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:01.780744 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b81f7143-792f-47db-9feb-5523fa129e41 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:01.781392 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b81f7143-792f-47db-9feb-5523fa129e41 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:01.940383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b664fc2e-cf93-4ab2-80e9-2db4532cdaf3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:01.943972 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:01.948670 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b664fc2e-cf93-4ab2-80e9-2db4532cdaf3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1318 microversion: 2.1 time: 0.436407 Oct 10 18:53:01.965025 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 526/912] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:01 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:01.965025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bca82f77-d81d-4e39-9ed4-d95267ac9eab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:01.965025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bca82f77-d81d-4e39-9ed4-d95267ac9eab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:01.980108 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bca82f77-d81d-4e39-9ed4-d95267ac9eab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:01.980621 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bca82f77-d81d-4e39-9ed4-d95267ac9eab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:01.981057 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bca82f77-d81d-4e39-9ed4-d95267ac9eab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:01.981764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bca82f77-d81d-4e39-9ed4-d95267ac9eab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:01.982216 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bca82f77-d81d-4e39-9ed4-d95267ac9eab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:01.982638 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bca82f77-d81d-4e39-9ed4-d95267ac9eab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:02.055904 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b81f7143-792f-47db-9feb-5523fa129e41 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:02.063918 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b81f7143-792f-47db-9feb-5523fa129e41 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 200 len: 1319 microversion: 2.1 time: 0.297957 Oct 10 18:53:02.066654 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 387/913] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:01 2022] GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:02.254862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-58fe7399-de9c-466b-92f6-0d14fd564e62 tempest-ListImageFiltersNegativeTestJSON-1022843162 tempest-ListImageFiltersNegativeTestJSON-1022843162-project] Calling method '.version_select at 0x7f318e2a6160>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:02.284683 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-58fe7399-de9c-466b-92f6-0d14fd564e62 tempest-ListImageFiltersNegativeTestJSON-1022843162 tempest-ListImageFiltersNegativeTestJSON-1022843162-project] HTTP exception thrown: Image not found. Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-58fe7399-de9c-466b-92f6-0d14fd564e62 tempest-ListImageFiltersNegativeTestJSON-1022843162 tempest-ListImageFiltersNegativeTestJSON-1022843162-project] Request method failure captured: Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/images/18a7ae48-0a06-4274-a54b-9890a87bf6f3 HTTP/1.1 Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoNV48mV-VgBpWvBAr7jS1MdaCpYNmmfEu8YIOoRm9xxm4mcQNoasmY9DDtpt30SHMCbJQ0aTXX0uSj4OIjkYVi8Qg_tkbtj_XBS_BEQPopOEbOvL6CrK9Vhss5aaYVAfFAsAv6-lNQCVhMFEH4h5m5bqo0G8qLFKEdPKdAfQMEGJI Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 2a871901973f4eeab015224ecaa47976 Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1022843162 Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2a871901973f4eeab015224ecaa47976", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2a871901973f4eeab015224ecaa47976"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2a871901973f4eeab015224ecaa47976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2a871901973f4eeab015224ecaa47976"}]}] Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1022843162 Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 2a871901973f4eeab015224ecaa47976 Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1022843162 Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ListImageFiltersNegativeTestJSON-1022843162-project Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 5c6f1209a78d46ffbda6780b85dfbd1b Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1022843162-project Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: exception: Image not found. Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '18a7ae48-0a06-4274-a54b-9890a87bf6f3'} Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 18a7ae48-0a06-4274-a54b-9890a87bf6f3 Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 18:53:02.287547 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 18a7ae48-0a06-4274-a54b-9890a87bf6f3 could not be found. Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-58fe7399-de9c-466b-92f6-0d14fd564e62 tempest-ListImageFiltersNegativeTestJSON-1022843162 tempest-ListImageFiltersNegativeTestJSON-1022843162-project] Returning 404 to user: Image not found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-58fe7399-de9c-466b-92f6-0d14fd564e62 tempest-ListImageFiltersNegativeTestJSON-1022843162 tempest-ListImageFiltersNegativeTestJSON-1022843162-project] 10.222.0.43 "GET /compute/v2.1/images/18a7ae48-0a06-4274-a54b-9890a87bf6f3" status: 404 len: 62 microversion: 2.1 time: 0.220588 Oct 10 18:53:02.291910 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 388/914] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:53:02 2022] GET /compute/v2.1/images/18a7ae48-0a06-4274-a54b-9890a87bf6f3 => generated 62 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:53:02.298739 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d058c4e9-e6cb-419f-be84-3c519edd2566 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:02.299537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d058c4e9-e6cb-419f-be84-3c519edd2566 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:02.315726 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d058c4e9-e6cb-419f-be84-3c519edd2566 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:02.317161 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d058c4e9-e6cb-419f-be84-3c519edd2566 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:02.318428 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d058c4e9-e6cb-419f-be84-3c519edd2566 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:02.319773 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d058c4e9-e6cb-419f-be84-3c519edd2566 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:02.320885 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d058c4e9-e6cb-419f-be84-3c519edd2566 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:02.321724 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d058c4e9-e6cb-419f-be84-3c519edd2566 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:02.381836 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bca82f77-d81d-4e39-9ed4-d95267ac9eab tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff/action" status: 202 len: 0 microversion: 2.1 time: 0.431498 Oct 10 18:53:02.389623 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 527/915] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:53:01 2022] POST /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:02.394138 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:02.397582 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:02.405393 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:02.405885 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:02.406540 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:02.407396 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:02.408275 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:02.412983 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:02.521523 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:53:02.524458 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:53:02.524458 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:53:02.524458 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:53:02.524458 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:53:02.661194 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d058c4e9-e6cb-419f-be84-3c519edd2566 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:02.669477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d058c4e9-e6cb-419f-be84-3c519edd2566 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:02.671031 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d058c4e9-e6cb-419f-be84-3c519edd2566 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:02.672134 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d058c4e9-e6cb-419f-be84-3c519edd2566 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1566 microversion: 2.25 time: 0.381739 Oct 10 18:53:02.684609 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 389/916] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:02 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1566 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:02.684609 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2179b1c5-581c-4870-96c8-546896392cbe tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:02.684609 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2179b1c5-581c-4870-96c8-546896392cbe tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:02.692847 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2179b1c5-581c-4870-96c8-546896392cbe tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:02.693383 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2179b1c5-581c-4870-96c8-546896392cbe tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:02.712387 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2179b1c5-581c-4870-96c8-546896392cbe tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:02.712387 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2179b1c5-581c-4870-96c8-546896392cbe tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:02.712387 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2179b1c5-581c-4870-96c8-546896392cbe tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:02.712387 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2179b1c5-581c-4870-96c8-546896392cbe tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:02.813514 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:02.833643 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:02.836831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:02.837498 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:02.838943 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:02.840981 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:02.841579 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:02.925176 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c1d2289a-ca9f-4879-8717-19a6adbc55e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "POST /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff/action" status: 202 len: 1068 microversion: 2.1 time: 0.537418 Oct 10 18:53:02.928065 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 528/917] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:53:02 2022] POST /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff/action => generated 1068 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 10 18:53:02.948979 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8d24f46c-821c-4e27-84ee-c2121b837cb3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:02.958338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8d24f46c-821c-4e27-84ee-c2121b837cb3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:02.967652 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d24f46c-821c-4e27-84ee-c2121b837cb3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:02.972267 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d24f46c-821c-4e27-84ee-c2121b837cb3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:02.974391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d24f46c-821c-4e27-84ee-c2121b837cb3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:02.976957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d24f46c-821c-4e27-84ee-c2121b837cb3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:02.977672 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d24f46c-821c-4e27-84ee-c2121b837cb3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:02.981569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d24f46c-821c-4e27-84ee-c2121b837cb3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:03.417246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2179b1c5-581c-4870-96c8-546896392cbe tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:03.430003 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2179b1c5-581c-4870-96c8-546896392cbe tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1504 microversion: 2.1 time: 0.755858 Oct 10 18:53:03.432754 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 390/918] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:02 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1504 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:03.439483 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-be7e25d3-7476-4dac-b143-ffb3624f24d8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:03.440190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-be7e25d3-7476-4dac-b143-ffb3624f24d8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:03.464560 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be7e25d3-7476-4dac-b143-ffb3624f24d8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:03.465212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be7e25d3-7476-4dac-b143-ffb3624f24d8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:03.477168 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be7e25d3-7476-4dac-b143-ffb3624f24d8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:03.478068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be7e25d3-7476-4dac-b143-ffb3624f24d8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:03.479196 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be7e25d3-7476-4dac-b143-ffb3624f24d8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:03.479642 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be7e25d3-7476-4dac-b143-ffb3624f24d8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:03.500721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:03.575602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8d24f46c-821c-4e27-84ee-c2121b837cb3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:03.595528 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8d24f46c-821c-4e27-84ee-c2121b837cb3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1472 microversion: 2.1 time: 0.652194 Oct 10 18:53:03.596804 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 529/919] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:02 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1472 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:03.604258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-656cec72-567e-4d4d-990a-6524536a7576 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:03.608495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-656cec72-567e-4d4d-990a-6524536a7576 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:03.616888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:03.630175 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-656cec72-567e-4d4d-990a-6524536a7576 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:03.632088 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-656cec72-567e-4d4d-990a-6524536a7576 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:03.634865 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-656cec72-567e-4d4d-990a-6524536a7576 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:03.634865 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-656cec72-567e-4d4d-990a-6524536a7576 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:03.634865 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-656cec72-567e-4d4d-990a-6524536a7576 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:03.634865 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-656cec72-567e-4d4d-990a-6524536a7576 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:03.904318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-be7e25d3-7476-4dac-b143-ffb3624f24d8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:03.914579 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-be7e25d3-7476-4dac-b143-ffb3624f24d8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1318 microversion: 2.1 time: 0.480562 Oct 10 18:53:03.915084 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 391/920] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:03 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:03.920150 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f9f82e3b-e0a6-41e6-a48a-71a9d0102d6b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1216831282"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:03.920901 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f9f82e3b-e0a6-41e6-a48a-71a9d0102d6b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:03.928073 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9f82e3b-e0a6-41e6-a48a-71a9d0102d6b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:03.931754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9f82e3b-e0a6-41e6-a48a-71a9d0102d6b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:03.931754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9f82e3b-e0a6-41e6-a48a-71a9d0102d6b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:03.931754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9f82e3b-e0a6-41e6-a48a-71a9d0102d6b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:03.931754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9f82e3b-e0a6-41e6-a48a-71a9d0102d6b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:03.931754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f9f82e3b-e0a6-41e6-a48a-71a9d0102d6b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:04.117064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-656cec72-567e-4d4d-990a-6524536a7576 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:04.127986 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-656cec72-567e-4d4d-990a-6524536a7576 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 200 len: 1319 microversion: 2.1 time: 0.529667 Oct 10 18:53:04.129239 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 530/921] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:03 2022] GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:04.140577 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-cc3c067a-f64e-445f-8a5f-f9fbec9eb592 req-afe616cf-34e7-4c95-a99f-e9b778f7c831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed92d033-c393-4d15-9e85-dd766e282c93", "tag": "c0c929a1-c74e-4013-8143-77bc81c7d571"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:04.161528 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-cc3c067a-f64e-445f-8a5f-f9fbec9eb592 req-afe616cf-34e7-4c95-a99f-e9b778f7c831 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:04.169616 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-cc3c067a-f64e-445f-8a5f-f9fbec9eb592 req-afe616cf-34e7-4c95-a99f-e9b778f7c831 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:04.169616 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-cc3c067a-f64e-445f-8a5f-f9fbec9eb592 req-afe616cf-34e7-4c95-a99f-e9b778f7c831 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:04.185637 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-cc3c067a-f64e-445f-8a5f-f9fbec9eb592 req-afe616cf-34e7-4c95-a99f-e9b778f7c831 service nova] Creating event network-changed:c0c929a1-c74e-4013-8143-77bc81c7d571 for instance ed92d033-c393-4d15-9e85-dd766e282c93 on n-h2-860863-1 Oct 10 18:53:04.190852 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-cc3c067a-f64e-445f-8a5f-f9fbec9eb592 req-afe616cf-34e7-4c95-a99f-e9b778f7c831 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058111 Oct 10 18:53:04.192422 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 531/922] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:04.203651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6b600247-82e5-4a42-88ae-0cb85d6cbfd9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:04.204778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6b600247-82e5-4a42-88ae-0cb85d6cbfd9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:04.211965 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b600247-82e5-4a42-88ae-0cb85d6cbfd9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:04.212831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b600247-82e5-4a42-88ae-0cb85d6cbfd9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:04.213477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b600247-82e5-4a42-88ae-0cb85d6cbfd9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:04.214564 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b600247-82e5-4a42-88ae-0cb85d6cbfd9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:04.215475 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b600247-82e5-4a42-88ae-0cb85d6cbfd9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:04.216189 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b600247-82e5-4a42-88ae-0cb85d6cbfd9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:04.304596 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.network.security_group_api [None req-f9f82e3b-e0a6-41e6-a48a-71a9d0102d6b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Adding security group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 to port 98401b59-e218-4900-acf6-4ca8bcde0d49 Oct 10 18:53:04.772291 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6b600247-82e5-4a42-88ae-0cb85d6cbfd9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:04.806433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6b600247-82e5-4a42-88ae-0cb85d6cbfd9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:04.815331 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6b600247-82e5-4a42-88ae-0cb85d6cbfd9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:04.819040 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6b600247-82e5-4a42-88ae-0cb85d6cbfd9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1566 microversion: 2.25 time: 0.625261 Oct 10 18:53:04.822342 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 532/923] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:04 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1566 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:04.843006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3381a445-7da3-47bb-b94d-ceacd7f7e0a4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:04.844085 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3381a445-7da3-47bb-b94d-ceacd7f7e0a4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:04.856965 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3381a445-7da3-47bb-b94d-ceacd7f7e0a4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:04.857778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3381a445-7da3-47bb-b94d-ceacd7f7e0a4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:04.858395 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3381a445-7da3-47bb-b94d-ceacd7f7e0a4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:04.859436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3381a445-7da3-47bb-b94d-ceacd7f7e0a4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:04.860292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3381a445-7da3-47bb-b94d-ceacd7f7e0a4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:04.862290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3381a445-7da3-47bb-b94d-ceacd7f7e0a4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:05.308485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3381a445-7da3-47bb-b94d-ceacd7f7e0a4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:05.330215 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3381a445-7da3-47bb-b94d-ceacd7f7e0a4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1472 microversion: 2.1 time: 0.504920 Oct 10 18:53:05.331899 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 533/924] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:04 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1472 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:05.369033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d51dbffc-48a7-4cd2-8ae1-32966f7d57b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:05.369794 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d51dbffc-48a7-4cd2-8ae1-32966f7d57b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:05.387450 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d51dbffc-48a7-4cd2-8ae1-32966f7d57b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:05.387951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d51dbffc-48a7-4cd2-8ae1-32966f7d57b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:05.388394 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d51dbffc-48a7-4cd2-8ae1-32966f7d57b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:05.389352 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d51dbffc-48a7-4cd2-8ae1-32966f7d57b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:05.389809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d51dbffc-48a7-4cd2-8ae1-32966f7d57b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:05.390311 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d51dbffc-48a7-4cd2-8ae1-32966f7d57b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:05.713106 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d51dbffc-48a7-4cd2-8ae1-32966f7d57b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:05.722077 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d51dbffc-48a7-4cd2-8ae1-32966f7d57b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1318 microversion: 2.1 time: 0.373487 Oct 10 18:53:05.739247 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 534/925] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:05 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:05.746132 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-92cab2a9-50c3-4818-9cdd-b8cc12b87c05 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:05.746816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-92cab2a9-50c3-4818-9cdd-b8cc12b87c05 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:05.754270 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92cab2a9-50c3-4818-9cdd-b8cc12b87c05 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:05.754933 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92cab2a9-50c3-4818-9cdd-b8cc12b87c05 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:05.755613 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92cab2a9-50c3-4818-9cdd-b8cc12b87c05 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:05.756622 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92cab2a9-50c3-4818-9cdd-b8cc12b87c05 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:05.757279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92cab2a9-50c3-4818-9cdd-b8cc12b87c05 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:05.757860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92cab2a9-50c3-4818-9cdd-b8cc12b87c05 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:06.013250 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-92cab2a9-50c3-4818-9cdd-b8cc12b87c05 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:06.044212 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-92cab2a9-50c3-4818-9cdd-b8cc12b87c05 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 200 len: 1319 microversion: 2.1 time: 0.295093 Oct 10 18:53:06.044212 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 535/926] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:05 2022] GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:06.049041 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a672e43e-d463-4acc-9d4f-82413ff731e4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:06.049649 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a672e43e-d463-4acc-9d4f-82413ff731e4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:06.060205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a672e43e-d463-4acc-9d4f-82413ff731e4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:06.060741 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a672e43e-d463-4acc-9d4f-82413ff731e4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:06.061171 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a672e43e-d463-4acc-9d4f-82413ff731e4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:06.061863 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a672e43e-d463-4acc-9d4f-82413ff731e4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:06.062309 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a672e43e-d463-4acc-9d4f-82413ff731e4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:06.062726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a672e43e-d463-4acc-9d4f-82413ff731e4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:06.109927 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f9f82e3b-e0a6-41e6-a48a-71a9d0102d6b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19/action" status: 202 len: 0 microversion: 2.1 time: 2.193578 Oct 10 18:53:06.111315 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 392/927] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:53:03 2022] POST /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19/action => generated 0 bytes in 2195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:06.274771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a672e43e-d463-4acc-9d4f-82413ff731e4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:06.287127 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a672e43e-d463-4acc-9d4f-82413ff731e4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:06.291553 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a672e43e-d463-4acc-9d4f-82413ff731e4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:06.294074 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a672e43e-d463-4acc-9d4f-82413ff731e4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1566 microversion: 2.25 time: 0.250701 Oct 10 18:53:06.295608 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 536/928] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:06 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1566 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:06.312451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-034efdff-0ed9-4db8-863d-bc67ab9fc49a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318df919d0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:06.410152 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1530314152", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "737898c7-94e7-46dc-b9d9-724fb5cc9d52"}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:06.501139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG neutronclient.v2_0.client [None req-034efdff-0ed9-4db8-863d-bc67ab9fc49a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 in use.", "detail": ""}} {{(pid=127288) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-034efdff-0ed9-4db8-863d-bc67ab9fc49a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Security Group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 in use. Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-75f24f2e-c571-49bf-8e89-35e1dd8de487'] Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-034efdff-0ed9-4db8-863d-bc67ab9fc49a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/os-security-groups/cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 HTTP/1.1 Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: exception: Security Group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 in use. Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-75f24f2e-c571-49bf-8e89-35e1dd8de487'] Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58'} Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:53:06.505907 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 in use. Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75f24f2e-c571-49bf-8e89-35e1dd8de487'] Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 in use. Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75f24f2e-c571-49bf-8e89-35e1dd8de487'] Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 in use. Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75f24f2e-c571-49bf-8e89-35e1dd8de487'] Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 in use. Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75f24f2e-c571-49bf-8e89-35e1dd8de487'] Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-034efdff-0ed9-4db8-863d-bc67ab9fc49a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 400 to user: Security Group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 in use. Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-75f24f2e-c571-49bf-8e89-35e1dd8de487'] {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-034efdff-0ed9-4db8-863d-bc67ab9fc49a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58" status: 400 len: 185 microversion: 2.1 time: 0.210176 Oct 10 18:53:06.510269 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 537/929] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:06 2022] DELETE /compute/v2.1/os-security-groups/cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 => generated 185 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:53:06.544144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] validate_networks() for [('737898c7-94e7-46dc-b9d9-724fb5cc9d52', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:53:06.544567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-cbf3e5bb-c2ac-4607-be38-6b687376e0e9 req-c74e6d96-5b3e-4089-9cf6-c28062ffd90f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1beef1-3d9a-4af8-ac68-048748261c19", "tag": "98401b59-e218-4900-acf6-4ca8bcde0d49"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:06.569631 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-cbf3e5bb-c2ac-4607-be38-6b687376e0e9 req-c74e6d96-5b3e-4089-9cf6-c28062ffd90f service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:06.570118 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-cbf3e5bb-c2ac-4607-be38-6b687376e0e9 req-c74e6d96-5b3e-4089-9cf6-c28062ffd90f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:06.570751 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-cbf3e5bb-c2ac-4607-be38-6b687376e0e9 req-c74e6d96-5b3e-4089-9cf6-c28062ffd90f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:06.594304 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-cbf3e5bb-c2ac-4607-be38-6b687376e0e9 req-c74e6d96-5b3e-4089-9cf6-c28062ffd90f service nova] Creating event network-changed:98401b59-e218-4900-acf6-4ca8bcde0d49 for instance cf1beef1-3d9a-4af8-ac68-048748261c19 on n-h2-860863-1 Oct 10 18:53:06.612412 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-cbf3e5bb-c2ac-4607-be38-6b687376e0e9 req-c74e6d96-5b3e-4089-9cf6-c28062ffd90f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095868 Oct 10 18:53:06.613986 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 538/930] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:06.627843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-320aa547-ebf2-4277-be06-87c48247d529 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:06.630499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-320aa547-ebf2-4277-be06-87c48247d529 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:06.642828 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-320aa547-ebf2-4277-be06-87c48247d529 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:06.643723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-320aa547-ebf2-4277-be06-87c48247d529 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:06.645087 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-320aa547-ebf2-4277-be06-87c48247d529 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:06.646416 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-320aa547-ebf2-4277-be06-87c48247d529 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:06.647583 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-320aa547-ebf2-4277-be06-87c48247d529 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:06.652306 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-320aa547-ebf2-4277-be06-87c48247d529 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:06.727568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=52 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:06.925744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-320aa547-ebf2-4277-be06-87c48247d529 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:06.937850 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-320aa547-ebf2-4277-be06-87c48247d529 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1472 microversion: 2.1 time: 0.321227 Oct 10 18:53:06.939282 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 539/931] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:06 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1472 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:06.947007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-747c4827-de30-426b-9e0b-1f50762fd1d0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:06.952148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-747c4827-de30-426b-9e0b-1f50762fd1d0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:06.960955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-747c4827-de30-426b-9e0b-1f50762fd1d0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:06.961833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-747c4827-de30-426b-9e0b-1f50762fd1d0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:06.962482 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-747c4827-de30-426b-9e0b-1f50762fd1d0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:06.964219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-747c4827-de30-426b-9e0b-1f50762fd1d0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:06.965528 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-747c4827-de30-426b-9e0b-1f50762fd1d0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:06.966188 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-747c4827-de30-426b-9e0b-1f50762fd1d0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:07.192431 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:53:07.193078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:53:07.193552 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:53:07.193860 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:53:07.194361 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:53:07.208271 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-747c4827-de30-426b-9e0b-1f50762fd1d0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19/action" status: 202 len: 0 microversion: 2.1 time: 0.267343 Oct 10 18:53:07.211762 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:07.212249 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:07.214776 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:07.215791 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:07.217112 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:07.219857 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:07.227143 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 540/932] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:53:06 2022] POST /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:07.300251 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Getting quotas for project c5d5fb01be0c409d98c222551a2c0e2e. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:07.310528 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Getting quotas for user afedfd9cc5b241ad97e27f6e911244a1 and project c5d5fb01be0c409d98c222551a2c0e2e. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:07.316963 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:07.336254 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:53:07.339536 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:53:07.480009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-930acc5b-873a-4b76-a7a8-bb9005c558dc tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Action: 'create', calling method: .version_select at 0x7f318eaad9d0>, body: {"keypair": {"name": "tempest-keypair-266971143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCluvyK+HGHeY8xNM2mgnCxmulzt1CFiKrd8xZ1NjymAw2bLAHx1uD6cV2DvLnfY9ch56CbxvN0Ptpo/QgFszaNoKmXAuoobmSdJJTmwH1Oah6qtmFV6wOxpwcnpybFJQ=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:07.501086 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-930acc5b-873a-4b76-a7a8-bb9005c558dc tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Getting quotas for project 3a67e5b139af4fceb04c1ad51e84d930. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:07.506968 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-930acc5b-873a-4b76-a7a8-bb9005c558dc tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Getting quotas for user 792f78842163418980f9104ddc24f2dd and project 3a67e5b139af4fceb04c1ad51e84d930. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:07.512884 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-141e0b2f-f249-4346-8da0-e24b4070d348 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400000 Oct 10 18:53:07.515864 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 393/933] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:53:07.538025 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bbea125f-176d-4ac3-8c1e-ecd3d9c32c90 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:07.539170 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bbea125f-176d-4ac3-8c1e-ecd3d9c32c90 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:07.560084 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbea125f-176d-4ac3-8c1e-ecd3d9c32c90 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:07.560479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbea125f-176d-4ac3-8c1e-ecd3d9c32c90 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:07.561038 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbea125f-176d-4ac3-8c1e-ecd3d9c32c90 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:07.562308 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbea125f-176d-4ac3-8c1e-ecd3d9c32c90 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:07.562769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbea125f-176d-4ac3-8c1e-ecd3d9c32c90 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:07.563193 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbea125f-176d-4ac3-8c1e-ecd3d9c32c90 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:07.614977 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-930acc5b-873a-4b76-a7a8-bb9005c558dc tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.385180 Oct 10 18:53:07.624825 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 541/934] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:53:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:07.633845 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-f13ad5d8-d83a-4aca-8fb5-3cdcb072ff5b req-863aa009-9c1c-431e-ae05-24c69f06274d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f72bf2-33cf-49a6-9b20-7fafcee472cd", "name": "network-vif-plugged", "status": "completed", "tag": "34c30487-9b21-45bd-8ec6-5e68a0c5a60f"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:07.652005 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f13ad5d8-d83a-4aca-8fb5-3cdcb072ff5b req-863aa009-9c1c-431e-ae05-24c69f06274d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:07.652816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f13ad5d8-d83a-4aca-8fb5-3cdcb072ff5b req-863aa009-9c1c-431e-ae05-24c69f06274d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:07.653837 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f13ad5d8-d83a-4aca-8fb5-3cdcb072ff5b req-863aa009-9c1c-431e-ae05-24c69f06274d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:07.672333 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-f13ad5d8-d83a-4aca-8fb5-3cdcb072ff5b req-863aa009-9c1c-431e-ae05-24c69f06274d service nova] Creating event network-vif-plugged:34c30487-9b21-45bd-8ec6-5e68a0c5a60f for instance b2f72bf2-33cf-49a6-9b20-7fafcee472cd on n-h1-860863-1 Oct 10 18:53:07.684920 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-f13ad5d8-d83a-4aca-8fb5-3cdcb072ff5b req-863aa009-9c1c-431e-ae05-24c69f06274d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058415 Oct 10 18:53:07.686138 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 542/935] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:07.694513 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c88dad9e-9b20-42cc-ac73-191b0aa3ad25 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:07.699970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c88dad9e-9b20-42cc-ac73-191b0aa3ad25 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:07.716090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c88dad9e-9b20-42cc-ac73-191b0aa3ad25 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:07.718401 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c88dad9e-9b20-42cc-ac73-191b0aa3ad25 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:07.721171 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c88dad9e-9b20-42cc-ac73-191b0aa3ad25 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:07.722055 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c88dad9e-9b20-42cc-ac73-191b0aa3ad25 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:07.722635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c88dad9e-9b20-42cc-ac73-191b0aa3ad25 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:07.723878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c88dad9e-9b20-42cc-ac73-191b0aa3ad25 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:07.731201 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:08.053922 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bbea125f-176d-4ac3-8c1e-ecd3d9c32c90 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:08.070659 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bbea125f-176d-4ac3-8c1e-ecd3d9c32c90 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1318 microversion: 2.1 time: 0.553077 Oct 10 18:53:08.072014 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 394/936] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:07 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1318 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:08.089034 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-765c33cb-ae79-4fc9-bfcb-653657933266 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:08.089643 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-765c33cb-ae79-4fc9-bfcb-653657933266 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:08.098553 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765c33cb-ae79-4fc9-bfcb-653657933266 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:08.099041 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765c33cb-ae79-4fc9-bfcb-653657933266 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:08.099472 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765c33cb-ae79-4fc9-bfcb-653657933266 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:08.100172 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765c33cb-ae79-4fc9-bfcb-653657933266 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:08.110524 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765c33cb-ae79-4fc9-bfcb-653657933266 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:08.113262 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765c33cb-ae79-4fc9-bfcb-653657933266 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:08.206461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c88dad9e-9b20-42cc-ac73-191b0aa3ad25 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:08.216078 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c88dad9e-9b20-42cc-ac73-191b0aa3ad25 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 200 len: 1319 microversion: 2.1 time: 0.528535 Oct 10 18:53:08.216802 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 543/937] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:07 2022] GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 1319 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:08.237425 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-eae0cd61-740b-4ba1-a811-9db9b538afed tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:08.238158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-eae0cd61-740b-4ba1-a811-9db9b538afed tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:08.245433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eae0cd61-740b-4ba1-a811-9db9b538afed tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:08.246296 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eae0cd61-740b-4ba1-a811-9db9b538afed tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:08.246954 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eae0cd61-740b-4ba1-a811-9db9b538afed tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:08.248027 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eae0cd61-740b-4ba1-a811-9db9b538afed tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:08.248741 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eae0cd61-740b-4ba1-a811-9db9b538afed tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:08.249412 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eae0cd61-740b-4ba1-a811-9db9b538afed tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:08.367346 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-765c33cb-ae79-4fc9-bfcb-653657933266 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:08.379666 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-765c33cb-ae79-4fc9-bfcb-653657933266 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1575 microversion: 2.1 time: 0.306083 Oct 10 18:53:08.380574 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 395/938] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:08 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1575 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:08.386037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bf7d86ed-87ef-491e-b473-c9967a1c3f37 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:08.386864 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bf7d86ed-87ef-491e-b473-c9967a1c3f37 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:08.456202 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bf7d86ed-87ef-491e-b473-c9967a1c3f37 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:08.464213 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bf7d86ed-87ef-491e-b473-c9967a1c3f37 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1215 microversion: 2.1 time: 0.082375 Oct 10 18:53:08.465162 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 396/939] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:08 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:08.470286 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3d118cc4-3183-4cfa-8d92-63bfc92b49ee tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Calling method '.version_select at 0x7f318df6e1f0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:08.479682 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3d118cc4-3183-4cfa-8d92-63bfc92b49ee tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-266971143" status: 200 len: 496 microversion: 2.1 time: 0.013316 Oct 10 18:53:08.480950 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 397/940] 10.222.0.43 () {58 vars in 1215 bytes} [Mon Oct 10 18:53:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-266971143 => generated 496 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:08.485729 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2ea7a35b-cd13-48da-898b-004d8e0050ca tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:08.486559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2ea7a35b-cd13-48da-898b-004d8e0050ca tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:08.496476 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ea7a35b-cd13-48da-898b-004d8e0050ca tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:08.497617 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ea7a35b-cd13-48da-898b-004d8e0050ca tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:08.498228 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ea7a35b-cd13-48da-898b-004d8e0050ca tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:08.499184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ea7a35b-cd13-48da-898b-004d8e0050ca tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:08.499802 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ea7a35b-cd13-48da-898b-004d8e0050ca tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:08.500393 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ea7a35b-cd13-48da-898b-004d8e0050ca tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:08.675866 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-eae0cd61-740b-4ba1-a811-9db9b538afed tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:08.692186 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-eae0cd61-740b-4ba1-a811-9db9b538afed tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:08.700270 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-eae0cd61-740b-4ba1-a811-9db9b538afed tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:08.701496 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-eae0cd61-740b-4ba1-a811-9db9b538afed tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1566 microversion: 2.25 time: 0.479851 Oct 10 18:53:08.719667 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 544/941] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:08 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1566 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:08.733894 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bbb1d25b-fcdc-4763-a28e-e8b75030b54c tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Calling method '.version_select at 0x7f318dd975e0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:08.808841 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2ea7a35b-cd13-48da-898b-004d8e0050ca tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:08.817354 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2ea7a35b-cd13-48da-898b-004d8e0050ca tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1472 microversion: 2.1 time: 0.335170 Oct 10 18:53:08.820280 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 398/942] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:08 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1472 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:08.830010 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bbb1d25b-fcdc-4763-a28e-e8b75030b54c tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266971143" status: 202 len: 0 microversion: 2.1 time: 0.106187 Oct 10 18:53:08.831211 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 545/943] 10.222.0.43 () {58 vars in 1218 bytes} [Mon Oct 10 18:53:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266971143 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:08.851534 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9fa2cdc6-f7fc-4fff-8bd3-9feae9339960 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Action: 'create', calling method: .version_select at 0x7f318dff0040>, body: {"keypair": {"name": "tempest-keypair-49473799", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6RIItWzbMFHZm87RCz0Hhqh6cRe3vOKaim+Lh/e07ApliwDH1doB09Ur4j40l3TLq7e4PubupiW9ArA1Ow91BjYWr2Rp1ITcIxSFdUncxjgVL+wLVg1Dce0/xPPh9+gg=="}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:08.883936 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-9fa2cdc6-f7fc-4fff-8bd3-9feae9339960 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Getting quotas for project 3a67e5b139af4fceb04c1ad51e84d930. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:08.890364 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-9fa2cdc6-f7fc-4fff-8bd3-9feae9339960 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Getting quotas for user 792f78842163418980f9104ddc24f2dd and project 3a67e5b139af4fceb04c1ad51e84d930. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:08.989481 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9fa2cdc6-f7fc-4fff-8bd3-9feae9339960 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.144798 Oct 10 18:53:08.999257 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 399/944] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:53:08 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:09.002880 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-66f294f0-286d-4e21-ae4f-b2a13a43efdd tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Calling method '.version_select at 0x7f318df77a60>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:09.100497 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-66f294f0-286d-4e21-ae4f-b2a13a43efdd tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-49473799" status: 202 len: 0 microversion: 2.1 time: 0.102756 Oct 10 18:53:09.101799 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-29f9c51e-6900-4876-a451-04a948983191 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:09.101996 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-29f9c51e-6900-4876-a451-04a948983191 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:09.108955 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 546/945] 10.222.0.43 () {58 vars in 1215 bytes} [Mon Oct 10 18:53:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-49473799 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:09.113917 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29f9c51e-6900-4876-a451-04a948983191 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:09.114422 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29f9c51e-6900-4876-a451-04a948983191 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:09.115280 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29f9c51e-6900-4876-a451-04a948983191 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:09.116046 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29f9c51e-6900-4876-a451-04a948983191 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:09.116481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29f9c51e-6900-4876-a451-04a948983191 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:09.116975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29f9c51e-6900-4876-a451-04a948983191 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:09.119265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2982fb8b-ed66-4d0c-8ab4-55383a99b0df tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Action: 'create', calling method: .version_select at 0x7f318ddbd9d0>, body: {"keypair": {"name": "tempest-keypair-1795928067", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:09.142477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-2982fb8b-ed66-4d0c-8ab4-55383a99b0df tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Getting quotas for project 3a67e5b139af4fceb04c1ad51e84d930. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:09.148341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-2982fb8b-ed66-4d0c-8ab4-55383a99b0df tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Getting quotas for user 792f78842163418980f9104ddc24f2dd and project 3a67e5b139af4fceb04c1ad51e84d930. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:09.299263 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2982fb8b-ed66-4d0c-8ab4-55383a99b0df tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.188140 Oct 10 18:53:09.326305 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 547/946] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:53:09 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:09.336827 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a3bf745c-e7a8-4e89-b569-56600f25d62a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:09.339258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a3bf745c-e7a8-4e89-b569-56600f25d62a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:09.352977 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3bf745c-e7a8-4e89-b569-56600f25d62a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:09.353868 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3bf745c-e7a8-4e89-b569-56600f25d62a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:09.360332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3bf745c-e7a8-4e89-b569-56600f25d62a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:09.360332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3bf745c-e7a8-4e89-b569-56600f25d62a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:09.360332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3bf745c-e7a8-4e89-b569-56600f25d62a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:09.360332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3bf745c-e7a8-4e89-b569-56600f25d62a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:09.465646 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-29f9c51e-6900-4876-a451-04a948983191 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:09.475141 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-29f9c51e-6900-4876-a451-04a948983191 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1318 microversion: 2.1 time: 0.381219 Oct 10 18:53:09.478362 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 400/947] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:09 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:09.497824 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f6770396-49db-4093-aeeb-492105cb7345 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Calling method '.version_select at 0x7f318e7efdc0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:09.584174 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f6770396-49db-4093-aeeb-492105cb7345 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795928067" status: 202 len: 0 microversion: 2.1 time: 0.104422 Oct 10 18:53:09.586889 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 401/948] 10.222.0.43 () {58 vars in 1221 bytes} [Mon Oct 10 18:53:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795928067 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:09.591899 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0847e532-687c-4bf2-b55e-cfcd3c8af6d5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:09.592756 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0847e532-687c-4bf2-b55e-cfcd3c8af6d5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:09.615592 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0847e532-687c-4bf2-b55e-cfcd3c8af6d5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:09.616738 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0847e532-687c-4bf2-b55e-cfcd3c8af6d5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:09.621696 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0847e532-687c-4bf2-b55e-cfcd3c8af6d5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:09.621696 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0847e532-687c-4bf2-b55e-cfcd3c8af6d5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:09.621696 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0847e532-687c-4bf2-b55e-cfcd3c8af6d5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:09.621696 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0847e532-687c-4bf2-b55e-cfcd3c8af6d5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:09.841438 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0847e532-687c-4bf2-b55e-cfcd3c8af6d5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:09.852380 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0847e532-687c-4bf2-b55e-cfcd3c8af6d5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1575 microversion: 2.1 time: 0.263782 Oct 10 18:53:09.853137 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 402/949] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:09 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1575 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:09.874246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2ed1731e-bb2e-4926-bd34-8f09d7662b97 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:09.875040 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2ed1731e-bb2e-4926-bd34-8f09d7662b97 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:09.884859 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ed1731e-bb2e-4926-bd34-8f09d7662b97 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:09.885490 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ed1731e-bb2e-4926-bd34-8f09d7662b97 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:09.886166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ed1731e-bb2e-4926-bd34-8f09d7662b97 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:09.887275 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ed1731e-bb2e-4926-bd34-8f09d7662b97 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:09.887972 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ed1731e-bb2e-4926-bd34-8f09d7662b97 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:09.888651 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ed1731e-bb2e-4926-bd34-8f09d7662b97 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:09.984359 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2ed1731e-bb2e-4926-bd34-8f09d7662b97 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:10.009526 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2ed1731e-bb2e-4926-bd34-8f09d7662b97 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1211 microversion: 2.1 time: 0.129569 Oct 10 18:53:10.013207 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 403/950] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:09 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1211 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:10.021475 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a9836a00-b923-4833-97cf-b10442b66772 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Action: 'create', calling method: .version_select at 0x7f318df76ca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2057404807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjbzzhkq838ZhP/ZlhkM4WBkoHzI6dVdQF1calKSZbXXhe2vxHeOgMgW8xarKPiuwSG6JfMZk4fNFdF0oeXsB8ZhySK1lFVR8nCeFoxhk8Y+21goK/IFSDzcEBQQcscNQ=="}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:10.063526 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-a9836a00-b923-4833-97cf-b10442b66772 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Getting quotas for project 3a67e5b139af4fceb04c1ad51e84d930. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:10.076470 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-a9836a00-b923-4833-97cf-b10442b66772 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Getting quotas for user 792f78842163418980f9104ddc24f2dd and project 3a67e5b139af4fceb04c1ad51e84d930. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:10.190171 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a9836a00-b923-4833-97cf-b10442b66772 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.175473 Oct 10 18:53:10.190869 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 404/951] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:53:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:10.198329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-6eb2a1ed-a20c-486d-bbdc-02fed11dd2be req-0da87fd7-e600-434c-9b5a-63131f05ac44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d908aa91-59b6-4c75-b6d2-30e97e050a55", "name": "network-vif-plugged", "status": "completed", "tag": "b0f98a85-8566-4775-a260-badc6b8f6997"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:10.226142 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6eb2a1ed-a20c-486d-bbdc-02fed11dd2be req-0da87fd7-e600-434c-9b5a-63131f05ac44 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:10.226530 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a3bf745c-e7a8-4e89-b569-56600f25d62a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:10.240010 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6eb2a1ed-a20c-486d-bbdc-02fed11dd2be req-0da87fd7-e600-434c-9b5a-63131f05ac44 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:10.240830 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6eb2a1ed-a20c-486d-bbdc-02fed11dd2be req-0da87fd7-e600-434c-9b5a-63131f05ac44 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:10.242083 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a3bf745c-e7a8-4e89-b569-56600f25d62a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 200 len: 1319 microversion: 2.1 time: 0.914081 Oct 10 18:53:10.244356 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 548/952] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:09 2022] GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 1319 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:10.249319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b0186991-eb45-4022-94eb-420a91dd3351 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:10.249879 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b0186991-eb45-4022-94eb-420a91dd3351 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:10.256176 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0186991-eb45-4022-94eb-420a91dd3351 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:10.256945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0186991-eb45-4022-94eb-420a91dd3351 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:10.257583 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0186991-eb45-4022-94eb-420a91dd3351 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:10.258472 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0186991-eb45-4022-94eb-420a91dd3351 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:10.259160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0186991-eb45-4022-94eb-420a91dd3351 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:10.259896 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0186991-eb45-4022-94eb-420a91dd3351 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:10.277259 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-6eb2a1ed-a20c-486d-bbdc-02fed11dd2be req-0da87fd7-e600-434c-9b5a-63131f05ac44 service nova] Creating event network-vif-plugged:b0f98a85-8566-4775-a260-badc6b8f6997 for instance d908aa91-59b6-4c75-b6d2-30e97e050a55 on n-h2-860863-1 Oct 10 18:53:10.302479 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-6eb2a1ed-a20c-486d-bbdc-02fed11dd2be req-0da87fd7-e600-434c-9b5a-63131f05ac44 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100707 Oct 10 18:53:10.302479 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 405/953] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:10.319264 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6768e046-4310-462a-bd87-24af41c82236 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:10.319973 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6768e046-4310-462a-bd87-24af41c82236 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:10.360647 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6768e046-4310-462a-bd87-24af41c82236 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:10.361159 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6768e046-4310-462a-bd87-24af41c82236 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:10.361666 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6768e046-4310-462a-bd87-24af41c82236 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:10.362331 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6768e046-4310-462a-bd87-24af41c82236 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:10.368034 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6768e046-4310-462a-bd87-24af41c82236 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:10.370828 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6768e046-4310-462a-bd87-24af41c82236 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:10.730478 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6768e046-4310-462a-bd87-24af41c82236 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:10.752379 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6768e046-4310-462a-bd87-24af41c82236 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1472 microversion: 2.1 time: 0.450085 Oct 10 18:53:10.761094 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 406/954] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:10 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1472 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:10.766894 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6902c7d2-6b07-43e6-9bb4-c965a7e23bbe tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Action: 'create', calling method: .version_select at 0x7f318e781dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-531859296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmEYZt3K9B7KFOfywrQT4L/CCHrl/OlvBU/XBwHyQD2m3/yZWlQ1T2kztGby3uYG22PUHwbzhA1LL7hzQsp4VSbxFH8IOr0pmRMuHRHHsvspwlz+gNU6tXj5MjCtQtsDw=="}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:10.789610 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-6902c7d2-6b07-43e6-9bb4-c965a7e23bbe tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Getting quotas for project 3a67e5b139af4fceb04c1ad51e84d930. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:10.795501 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-6902c7d2-6b07-43e6-9bb4-c965a7e23bbe tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Getting quotas for user 792f78842163418980f9104ddc24f2dd and project 3a67e5b139af4fceb04c1ad51e84d930. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:10.831786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b0186991-eb45-4022-94eb-420a91dd3351 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:10.841733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b0186991-eb45-4022-94eb-420a91dd3351 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:10.843871 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b0186991-eb45-4022-94eb-420a91dd3351 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:10.845690 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b0186991-eb45-4022-94eb-420a91dd3351 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1556 microversion: 2.25 time: 0.599841 Oct 10 18:53:10.846782 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 549/955] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:10 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1556 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:10.858570 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7b85b49a-641d-493f-b7f1-73f903e4b549 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:10.860315 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7b85b49a-641d-493f-b7f1-73f903e4b549 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:10.875810 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6902c7d2-6b07-43e6-9bb4-c965a7e23bbe tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.113325 Oct 10 18:53:10.877226 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 407/956] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:53:10 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:10.886993 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-936deba8-2ba3-4e07-b45f-11f56cd213ce tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '.version_select at 0x7f318dff0310>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:10.890753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b85b49a-641d-493f-b7f1-73f903e4b549 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:10.890753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b85b49a-641d-493f-b7f1-73f903e4b549 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:10.890753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b85b49a-641d-493f-b7f1-73f903e4b549 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:10.894166 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b85b49a-641d-493f-b7f1-73f903e4b549 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:10.898318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-936deba8-2ba3-4e07-b45f-11f56cd213ce tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:10.898725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b85b49a-641d-493f-b7f1-73f903e4b549 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:10.899515 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7b85b49a-641d-493f-b7f1-73f903e4b549 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:10.902610 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-936deba8-2ba3-4e07-b45f-11f56cd213ce tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:10.907992 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-936deba8-2ba3-4e07-b45f-11f56cd213ce tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:10.943331 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-936deba8-2ba3-4e07-b45f-11f56cd213ce tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.064617 Oct 10 18:53:10.944626 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 408/957] 10.222.0.43 () {60 vars in 1184 bytes} [Mon Oct 10 18:53:10 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:53:10.956732 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ef59d24c-9624-4a4c-bfca-a82f0d353c00 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:10.957659 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ef59d24c-9624-4a4c-bfca-a82f0d353c00 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:10.965098 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ef59d24c-9624-4a4c-bfca-a82f0d353c00 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:10.971269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ef59d24c-9624-4a4c-bfca-a82f0d353c00 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:10.971269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ef59d24c-9624-4a4c-bfca-a82f0d353c00 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:10.971269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ef59d24c-9624-4a4c-bfca-a82f0d353c00 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:10.971269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ef59d24c-9624-4a4c-bfca-a82f0d353c00 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:10.971269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ef59d24c-9624-4a4c-bfca-a82f0d353c00 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:11.188089 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ef59d24c-9624-4a4c-bfca-a82f0d353c00 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:11.198316 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ef59d24c-9624-4a4c-bfca-a82f0d353c00 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1575 microversion: 2.1 time: 0.245296 Oct 10 18:53:11.202449 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 409/958] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:10 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1575 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:11.217322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-80841a76-62f2-414e-82cf-a46c5df763c5 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Action: 'create', calling method: .version_select at 0x7f318df8d4c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-735574939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI4M8KmEvH5u50wYLQ4B6kl+BjaONodM04dxGQ7yjLV+tnUFRiBydRbh0mziSHI7HEqa+KjfGSO3512K1eSwZL9zR7abeQG+tS18GYoABw+QBSp5IL0ny8DJ1hcmMF+Yg=="}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:11.235827 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-80841a76-62f2-414e-82cf-a46c5df763c5 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Getting quotas for project 3a67e5b139af4fceb04c1ad51e84d930. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:11.259455 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-80841a76-62f2-414e-82cf-a46c5df763c5 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Getting quotas for user 792f78842163418980f9104ddc24f2dd and project 3a67e5b139af4fceb04c1ad51e84d930. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:11.370546 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=22 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:11.391783 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-80841a76-62f2-414e-82cf-a46c5df763c5 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.188293 Oct 10 18:53:11.392405 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 410/959] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:53:11 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:11.397410 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-35fdd25e-fbd1-40f7-be9e-01fe2a7d2f61 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:11.401207 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-35fdd25e-fbd1-40f7-be9e-01fe2a7d2f61 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:11.416368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-35fdd25e-fbd1-40f7-be9e-01fe2a7d2f61 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:11.417261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-35fdd25e-fbd1-40f7-be9e-01fe2a7d2f61 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:11.417879 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-35fdd25e-fbd1-40f7-be9e-01fe2a7d2f61 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:11.418772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-35fdd25e-fbd1-40f7-be9e-01fe2a7d2f61 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:11.420435 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-35fdd25e-fbd1-40f7-be9e-01fe2a7d2f61 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:11.421861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-35fdd25e-fbd1-40f7-be9e-01fe2a7d2f61 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:11.529091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7b85b49a-641d-493f-b7f1-73f903e4b549 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:11.584578 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7b85b49a-641d-493f-b7f1-73f903e4b549 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1318 microversion: 2.1 time: 0.736151 Oct 10 18:53:11.601461 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 550/960] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:10 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1318 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:11.620772 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5caba11d-4d17-4add-b952-b2f64660c842 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:11.621836 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5caba11d-4d17-4add-b952-b2f64660c842 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:11.649958 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5caba11d-4d17-4add-b952-b2f64660c842 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:11.652696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5caba11d-4d17-4add-b952-b2f64660c842 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:11.653783 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5caba11d-4d17-4add-b952-b2f64660c842 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:11.655776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5caba11d-4d17-4add-b952-b2f64660c842 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:11.657674 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5caba11d-4d17-4add-b952-b2f64660c842 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:11.660969 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5caba11d-4d17-4add-b952-b2f64660c842 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:11.797210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-35fdd25e-fbd1-40f7-be9e-01fe2a7d2f61 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:53:11.823706 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-35fdd25e-fbd1-40f7-be9e-01fe2a7d2f61 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 2048 microversion: 2.25 time: 0.428770 Oct 10 18:53:11.825142 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 411/961] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:11 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 2048 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:11.826347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5caba11d-4d17-4add-b952-b2f64660c842 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:11.836889 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-abf5a8fd-3694-48e0-a027-2e9869e11e54 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:11.838779 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-abf5a8fd-3694-48e0-a027-2e9869e11e54 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:11.850722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-abf5a8fd-3694-48e0-a027-2e9869e11e54 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:11.851574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-abf5a8fd-3694-48e0-a027-2e9869e11e54 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:11.852373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-abf5a8fd-3694-48e0-a027-2e9869e11e54 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:11.853962 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-abf5a8fd-3694-48e0-a027-2e9869e11e54 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:11.855035 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-abf5a8fd-3694-48e0-a027-2e9869e11e54 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:11.855770 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-abf5a8fd-3694-48e0-a027-2e9869e11e54 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:11.857277 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5caba11d-4d17-4add-b952-b2f64660c842 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1285 microversion: 2.1 time: 0.249074 Oct 10 18:53:11.866088 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 551/962] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:11 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1285 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:11.881399 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-44ab6a98-e531-4326-8e1e-ef394c3ae245 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Calling method '.version_select at 0x7f318ddbc310>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:11.888111 n-d-860863-1 devstack@n-api.service[127288]: WARNING oslo_db.sqlalchemy.utils [None req-44ab6a98-e531-4326-8e1e-ef394c3ae245 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 18:53:11.896165 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-44ab6a98-e531-4326-8e1e-ef394c3ae245 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.028874 Oct 10 18:53:11.897083 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 552/963] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:53:11 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:11.912832 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-da46f503-fbbd-41ae-8366-82c3b9476e06 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:11.913662 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-da46f503-fbbd-41ae-8366-82c3b9476e06 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:11.922690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da46f503-fbbd-41ae-8366-82c3b9476e06 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:11.923344 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da46f503-fbbd-41ae-8366-82c3b9476e06 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:11.923938 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da46f503-fbbd-41ae-8366-82c3b9476e06 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:11.924847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da46f503-fbbd-41ae-8366-82c3b9476e06 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:11.925630 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da46f503-fbbd-41ae-8366-82c3b9476e06 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:11.926213 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da46f503-fbbd-41ae-8366-82c3b9476e06 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:12.157019 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-abf5a8fd-3694-48e0-a027-2e9869e11e54 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:12.168220 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-abf5a8fd-3694-48e0-a027-2e9869e11e54 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 200 len: 1469 microversion: 2.1 time: 0.341988 Oct 10 18:53:12.170264 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 412/964] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:11 2022] GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 1469 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:12.176915 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-001c81ff-5818-410d-bc64-6fb144fe3731 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Calling method '.version_select at 0x7f318df8da60>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:12.281819 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-da46f503-fbbd-41ae-8366-82c3b9476e06 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:12.288649 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-001c81ff-5818-410d-bc64-6fb144fe3731 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-735574939" status: 202 len: 0 microversion: 2.1 time: 0.117032 Oct 10 18:53:12.293046 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 413/965] 10.222.0.43 () {58 vars in 1275 bytes} [Mon Oct 10 18:53:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-735574939 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:12.298467 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-66b53d2d-b1e3-49f2-a725-e69dfa72f6e2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:12.304187 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-66b53d2d-b1e3-49f2-a725-e69dfa72f6e2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: d908aa91-59b6-4c75-b6d2-30e97e050a55] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:12.309502 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-da46f503-fbbd-41ae-8366-82c3b9476e06 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1472 microversion: 2.1 time: 0.397326 Oct 10 18:53:12.310641 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 553/966] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:11 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1472 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:12.330553 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-66b53d2d-b1e3-49f2-a725-e69dfa72f6e2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:12.333147 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1440441723", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "4e9b6228-48e7-47ac-9317-a5a4457ef8ad"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:12.344861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-66b53d2d-b1e3-49f2-a725-e69dfa72f6e2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:12.345729 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-66b53d2d-b1e3-49f2-a725-e69dfa72f6e2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:12.347058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-66b53d2d-b1e3-49f2-a725-e69dfa72f6e2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:12.347732 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-66b53d2d-b1e3-49f2-a725-e69dfa72f6e2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:12.349356 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-66b53d2d-b1e3-49f2-a725-e69dfa72f6e2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:12.439080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] validate_networks() for [('4e9b6228-48e7-47ac-9317-a5a4457ef8ad', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:53:12.593566 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-66b53d2d-b1e3-49f2-a725-e69dfa72f6e2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:12.601147 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-66b53d2d-b1e3-49f2-a725-e69dfa72f6e2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55" status: 200 len: 1468 microversion: 2.1 time: 0.306470 Oct 10 18:53:12.602930 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 414/967] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:12 2022] GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55 => generated 1468 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:12.609706 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-29d5d200-acf0-4434-a5be-47a1b36d5815 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:12.610331 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-29d5d200-acf0-4434-a5be-47a1b36d5815 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:12.616805 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29d5d200-acf0-4434-a5be-47a1b36d5815 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:12.617295 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29d5d200-acf0-4434-a5be-47a1b36d5815 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:12.617734 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29d5d200-acf0-4434-a5be-47a1b36d5815 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:12.618442 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29d5d200-acf0-4434-a5be-47a1b36d5815 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:12.618901 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29d5d200-acf0-4434-a5be-47a1b36d5815 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:12.619360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29d5d200-acf0-4434-a5be-47a1b36d5815 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:12.798231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-29d5d200-acf0-4434-a5be-47a1b36d5815 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:12.808251 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-29d5d200-acf0-4434-a5be-47a1b36d5815 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1573 microversion: 2.1 time: 0.204344 Oct 10 18:53:12.809073 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 415/968] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:12 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1573 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:12.814128 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d7e4b0d3-b7f4-4a3c-9636-83fcd56d7487 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Calling method '.version_select at 0x7f318dfe23a0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:12.897745 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d7e4b0d3-b7f4-4a3c-9636-83fcd56d7487 tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-531859296" status: 202 len: 0 microversion: 2.1 time: 0.087198 Oct 10 18:53:12.899254 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 416/969] 10.222.0.43 () {58 vars in 1275 bytes} [Mon Oct 10 18:53:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-531859296 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:12.907019 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-2618da92-d836-41e4-8739-5942d5eb694b req-b16cd4cc-8942-4420-97dd-5cc0cf81b32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed92d033-c393-4d15-9e85-dd766e282c93", "name": "network-vif-plugged", "status": "completed", "tag": "c0c929a1-c74e-4013-8143-77bc81c7d571"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:12.913797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:12.919027 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-2618da92-d836-41e4-8739-5942d5eb694b req-b16cd4cc-8942-4420-97dd-5cc0cf81b32a service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:12.919630 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-2618da92-d836-41e4-8739-5942d5eb694b req-b16cd4cc-8942-4420-97dd-5cc0cf81b32a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:12.928730 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-2618da92-d836-41e4-8739-5942d5eb694b req-b16cd4cc-8942-4420-97dd-5cc0cf81b32a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:12.931227 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-2618da92-d836-41e4-8739-5942d5eb694b req-b16cd4cc-8942-4420-97dd-5cc0cf81b32a service nova] Creating event network-vif-plugged:c0c929a1-c74e-4013-8143-77bc81c7d571 for instance ed92d033-c393-4d15-9e85-dd766e282c93 on n-h2-860863-1 Oct 10 18:53:12.936441 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-2618da92-d836-41e4-8739-5942d5eb694b req-b16cd4cc-8942-4420-97dd-5cc0cf81b32a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035589 Oct 10 18:53:12.937149 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 417/970] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:12.942455 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-21c86c69-2984-46d6-84e6-45e2ba9c72c1 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:12.943144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-21c86c69-2984-46d6-84e6-45e2ba9c72c1 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:12.952477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-21c86c69-2984-46d6-84e6-45e2ba9c72c1 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:12.954115 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-21c86c69-2984-46d6-84e6-45e2ba9c72c1 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:12.954892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-21c86c69-2984-46d6-84e6-45e2ba9c72c1 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:12.958240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-21c86c69-2984-46d6-84e6-45e2ba9c72c1 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:12.958240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-21c86c69-2984-46d6-84e6-45e2ba9c72c1 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:12.958240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-21c86c69-2984-46d6-84e6-45e2ba9c72c1 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:13.127591 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-21c86c69-2984-46d6-84e6-45e2ba9c72c1 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:13.138274 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-21c86c69-2984-46d6-84e6-45e2ba9c72c1 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1318 microversion: 2.1 time: 0.199769 Oct 10 18:53:13.138861 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 418/971] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:12 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:13.144125 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:13.151748 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:13.152665 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Searching by: {'reservation_id': 'r-10bvoj1r', 'deleted': False, 'project_id': 'f536cb88016b414298031238fb251097'} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:53:13.161136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:13.161938 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:13.162523 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:13.163418 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:13.164073 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:13.164759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:13.212786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=21 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:13.275767 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.multi_cell_list [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127289) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 18:53:13.294863 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:13.359971 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:13.370127 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:13.373249 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:13.373973 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:13.481092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:53:13.481092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:53:13.481092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:53:13.482361 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:53:13.482997 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:53:13.497430 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:13.498381 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:13.498817 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:13.500123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:13.500123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:13.500453 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:13.519819 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Getting quotas for project 8ca11fe18cc64adfbc06166601106c7c. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:13.528346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Getting quotas for user 789ef7a66ff042b9abebe36823008f8f and project 8ca11fe18cc64adfbc06166601106c7c. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:13.543355 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:53:13.543548 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-765e1d3f-456f-4bac-9104-7ea09b0aa746 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?reservation_id=r-10bvoj1r" status: 200 len: 2930 microversion: 2.1 time: 0.403282 Oct 10 18:53:13.544156 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 419/972] 10.222.0.43 () {58 vars in 1197 bytes} [Mon Oct 10 18:53:13 2022] GET /compute/v2.1/servers/detail?reservation_id=r-10bvoj1r => generated 2930 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:13.546714 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:53:13.549024 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5e700873-eacb-4738-b645-5c6f0ee045ee tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-449327477"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:13.553077 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5e700873-eacb-4738-b645-5c6f0ee045ee tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:13.568092 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e700873-eacb-4738-b645-5c6f0ee045ee tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:13.568600 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e700873-eacb-4738-b645-5c6f0ee045ee tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:13.569029 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e700873-eacb-4738-b645-5c6f0ee045ee tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:13.569729 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e700873-eacb-4738-b645-5c6f0ee045ee tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:13.570171 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e700873-eacb-4738-b645-5c6f0ee045ee tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:13.570588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e700873-eacb-4738-b645-5c6f0ee045ee tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:13.675442 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-330508b9-f56a-4201-aed2-227965d6485b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.362380 Oct 10 18:53:13.679565 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 554/973] 10.222.0.43 () {62 vars in 1188 bytes} [Mon Oct 10 18:53:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1367 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 18:53:13.697799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e07aa635-2a3c-404e-85c4-16482190c622 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:13.698796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e07aa635-2a3c-404e-85c4-16482190c622 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:13.707316 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e07aa635-2a3c-404e-85c4-16482190c622 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:13.710787 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e07aa635-2a3c-404e-85c4-16482190c622 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:13.710787 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e07aa635-2a3c-404e-85c4-16482190c622 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:13.710787 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e07aa635-2a3c-404e-85c4-16482190c622 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:13.710787 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e07aa635-2a3c-404e-85c4-16482190c622 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:13.710787 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e07aa635-2a3c-404e-85c4-16482190c622 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:13.773089 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.network.security_group_api [None req-5e700873-eacb-4738-b645-5c6f0ee045ee tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Adding security group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 to port 98401b59-e218-4900-acf6-4ca8bcde0d49 Oct 10 18:53:14.195928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e07aa635-2a3c-404e-85c4-16482190c622 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:14.204714 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e07aa635-2a3c-404e-85c4-16482190c622 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1315 microversion: 2.1 time: 0.523707 Oct 10 18:53:14.205868 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 555/974] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:13 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:14.211502 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e56d4257-2ed9-4500-874c-de2085551cbb tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] Calling method '.version_select at 0x7f318df91b80>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:14.256402 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5e700873-eacb-4738-b645-5c6f0ee045ee tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19/action" status: 202 len: 0 microversion: 2.1 time: 0.706544 Oct 10 18:53:14.258959 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 420/975] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:53:13 2022] POST /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19/action => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:14.273998 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1ff06b99-1002-4963-b98c-4a21460895cf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:14.274657 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1ff06b99-1002-4963-b98c-4a21460895cf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:14.292186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1ff06b99-1002-4963-b98c-4a21460895cf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:14.292802 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1ff06b99-1002-4963-b98c-4a21460895cf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:14.296530 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1ff06b99-1002-4963-b98c-4a21460895cf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:14.296530 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1ff06b99-1002-4963-b98c-4a21460895cf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:14.296530 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1ff06b99-1002-4963-b98c-4a21460895cf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:14.296530 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1ff06b99-1002-4963-b98c-4a21460895cf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:14.339371 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e56d4257-2ed9-4500-874c-de2085551cbb tempest-KeyPairsV2TestJSON-609063420 tempest-KeyPairsV2TestJSON-609063420-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2057404807" status: 202 len: 0 microversion: 2.1 time: 0.131840 Oct 10 18:53:14.340264 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 556/976] 10.222.0.43 () {58 vars in 1278 bytes} [Mon Oct 10 18:53:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2057404807 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:14.353953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6132ed7d-f59c-4059-837f-80bcb95d4ae7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:14.383811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.compute.server_groups [None req-6132ed7d-f59c-4059-837f-80bcb95d4ae7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Querying cell 1649e55c-2282-4aa8-b943-d6661d4bffa2(cell1) for 2 instances {{(pid=127288) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 10 18:53:14.385867 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6132ed7d-f59c-4059-837f-80bcb95d4ae7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:14.387298 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6132ed7d-f59c-4059-837f-80bcb95d4ae7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:14.389995 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6132ed7d-f59c-4059-837f-80bcb95d4ae7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:14.424759 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6132ed7d-f59c-4059-837f-80bcb95d4ae7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/e85081cb-1236-4f01-9f84-23bbf81790d0" status: 200 len: 271 microversion: 2.1 time: 0.076113 Oct 10 18:53:14.425359 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 557/977] 10.222.0.43 () {58 vars in 1263 bytes} [Mon Oct 10 18:53:14 2022] GET /compute/v2.1/os-server-groups/e85081cb-1236-4f01-9f84-23bbf81790d0 => generated 271 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:14.431120 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-36247191-7bb8-4885-b491-67acc2f4817f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:14.431690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-36247191-7bb8-4885-b491-67acc2f4817f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:14.563554 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-36247191-7bb8-4885-b491-67acc2f4817f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:14.576113 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-36247191-7bb8-4885-b491-67acc2f4817f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:14.580516 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-36247191-7bb8-4885-b491-67acc2f4817f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:14.585364 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-36247191-7bb8-4885-b491-67acc2f4817f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1262 microversion: 2.25 time: 0.158941 Oct 10 18:53:14.585947 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 558/978] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:14 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1262 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:14.599741 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-add5683d-eac0-49bf-8758-675d61eb45ba tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:14.600927 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-add5683d-eac0-49bf-8758-675d61eb45ba tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:14.606102 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:14.616239 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-add5683d-eac0-49bf-8758-675d61eb45ba tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:14.618807 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-add5683d-eac0-49bf-8758-675d61eb45ba tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:14.621798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-add5683d-eac0-49bf-8758-675d61eb45ba tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:14.628054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-add5683d-eac0-49bf-8758-675d61eb45ba tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:14.628574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-add5683d-eac0-49bf-8758-675d61eb45ba tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:14.629025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-add5683d-eac0-49bf-8758-675d61eb45ba tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:15.068656 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-add5683d-eac0-49bf-8758-675d61eb45ba tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:15.081457 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-add5683d-eac0-49bf-8758-675d61eb45ba tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1318 microversion: 2.1 time: 0.491693 Oct 10 18:53:15.097404 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 559/979] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:14 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:15.108799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-d8aeddce-aa08-44d0-af44-f34a5a1043a9 req-8388da98-0aa0-40e2-bffa-156b569716f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1beef1-3d9a-4af8-ac68-048748261c19", "tag": "98401b59-e218-4900-acf6-4ca8bcde0d49"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:15.122161 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d8aeddce-aa08-44d0-af44-f34a5a1043a9 req-8388da98-0aa0-40e2-bffa-156b569716f1 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:15.124864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d8aeddce-aa08-44d0-af44-f34a5a1043a9 req-8388da98-0aa0-40e2-bffa-156b569716f1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:15.124864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d8aeddce-aa08-44d0-af44-f34a5a1043a9 req-8388da98-0aa0-40e2-bffa-156b569716f1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:15.136984 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-d8aeddce-aa08-44d0-af44-f34a5a1043a9 req-8388da98-0aa0-40e2-bffa-156b569716f1 service nova] Creating event network-changed:98401b59-e218-4900-acf6-4ca8bcde0d49 for instance cf1beef1-3d9a-4af8-ac68-048748261c19 on n-h2-860863-1 Oct 10 18:53:15.146806 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-d8aeddce-aa08-44d0-af44-f34a5a1043a9 req-8388da98-0aa0-40e2-bffa-156b569716f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047292 Oct 10 18:53:15.151060 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 560/980] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:15.171014 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2310f889-cb8c-40c0-9d6a-647b37a91f39 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318df91670>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:15.171153 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1ff06b99-1002-4963-b98c-4a21460895cf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:15.188203 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1ff06b99-1002-4963-b98c-4a21460895cf tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1472 microversion: 2.1 time: 0.925262 Oct 10 18:53:15.190687 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 421/981] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:14 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1472 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:15.197896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fe77dce3-1424-4287-9ac6-8679cca16b22 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:15.199561 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fe77dce3-1424-4287-9ac6-8679cca16b22 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:15.221063 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe77dce3-1424-4287-9ac6-8679cca16b22 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:15.233445 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe77dce3-1424-4287-9ac6-8679cca16b22 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:15.233445 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe77dce3-1424-4287-9ac6-8679cca16b22 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:15.233445 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe77dce3-1424-4287-9ac6-8679cca16b22 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:15.236971 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe77dce3-1424-4287-9ac6-8679cca16b22 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:15.238247 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe77dce3-1424-4287-9ac6-8679cca16b22 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:15.404786 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fe77dce3-1424-4287-9ac6-8679cca16b22 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 200 len: 1620 microversion: 2.1 time: 0.210410 Oct 10 18:53:15.408892 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 422/982] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:15 2022] GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 1620 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:15.414028 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cc6f8483-553c-47eb-b845-d8c5f68ca5bb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:15.415071 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cc6f8483-553c-47eb-b845-d8c5f68ca5bb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:15.424454 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc6f8483-553c-47eb-b845-d8c5f68ca5bb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:15.425307 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc6f8483-553c-47eb-b845-d8c5f68ca5bb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:15.430999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc6f8483-553c-47eb-b845-d8c5f68ca5bb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:15.430999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc6f8483-553c-47eb-b845-d8c5f68ca5bb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:15.430999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc6f8483-553c-47eb-b845-d8c5f68ca5bb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:15.430999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc6f8483-553c-47eb-b845-d8c5f68ca5bb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:15.631751 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cc6f8483-553c-47eb-b845-d8c5f68ca5bb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:15.646692 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cc6f8483-553c-47eb-b845-d8c5f68ca5bb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1315 microversion: 2.1 time: 0.236204 Oct 10 18:53:15.667886 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 423/983] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:15 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:15.679615 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-647c39ac-6ff9-4724-a02c-90cba206b7b4 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:15.680232 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-647c39ac-6ff9-4724-a02c-90cba206b7b4 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] [instance: d908aa91-59b6-4c75-b6d2-30e97e050a55] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:15.686427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-647c39ac-6ff9-4724-a02c-90cba206b7b4 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:15.686948 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-647c39ac-6ff9-4724-a02c-90cba206b7b4 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:15.687533 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-647c39ac-6ff9-4724-a02c-90cba206b7b4 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:15.689322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-647c39ac-6ff9-4724-a02c-90cba206b7b4 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:15.690098 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-647c39ac-6ff9-4724-a02c-90cba206b7b4 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:15.690209 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-647c39ac-6ff9-4724-a02c-90cba206b7b4 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:15.890163 n-d-860863-1 devstack@n-api.service[127288]: DEBUG neutronclient.v2_0.client [None req-2310f889-cb8c-40c0-9d6a-647b37a91f39 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 in use.", "detail": ""}} {{(pid=127288) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:53:15.891303 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-2310f889-cb8c-40c0-9d6a-647b37a91f39 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Security Group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 in use. Oct 10 18:53:15.891303 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-9b8f1e90-06b9-4f54-9f75-a4805b0119fe'] Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2310f889-cb8c-40c0-9d6a-647b37a91f39 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/os-security-groups/2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 HTTP/1.1 Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: exception: Security Group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 in use. Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-9b8f1e90-06b9-4f54-9f75-a4805b0119fe'] Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '2b3fd4ec-9f5d-45b8-ab70-702fa0280d18'} Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:53:15.894035 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 in use. Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b8f1e90-06b9-4f54-9f75-a4805b0119fe'] Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 in use. Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b8f1e90-06b9-4f54-9f75-a4805b0119fe'] Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 in use. Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b8f1e90-06b9-4f54-9f75-a4805b0119fe'] Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 in use. Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b8f1e90-06b9-4f54-9f75-a4805b0119fe'] Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2310f889-cb8c-40c0-9d6a-647b37a91f39 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 400 to user: Security Group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 in use. Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-9b8f1e90-06b9-4f54-9f75-a4805b0119fe'] {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2310f889-cb8c-40c0-9d6a-647b37a91f39 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/2b3fd4ec-9f5d-45b8-ab70-702fa0280d18" status: 400 len: 185 microversion: 2.1 time: 0.742933 Oct 10 18:53:15.906171 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 561/984] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:15 2022] DELETE /compute/v2.1/os-security-groups/2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 => generated 185 bytes in 745 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:53:15.911607 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-647c39ac-6ff9-4724-a02c-90cba206b7b4 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55" status: 200 len: 1619 microversion: 2.1 time: 0.240179 Oct 10 18:53:15.917370 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-95150643-fb8c-4343-86b2-fe17d01b9d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:15.918746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-95150643-fb8c-4343-86b2-fe17d01b9d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:15.932268 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 424/985] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:15 2022] GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55 => generated 1619 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:15.937373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3d85d574-2902-4391-a4ff-ea5f040eb7c9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:15.938131 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-95150643-fb8c-4343-86b2-fe17d01b9d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:15.938853 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-95150643-fb8c-4343-86b2-fe17d01b9d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:15.940273 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-95150643-fb8c-4343-86b2-fe17d01b9d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:15.940719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3d85d574-2902-4391-a4ff-ea5f040eb7c9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:15.947055 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3d85d574-2902-4391-a4ff-ea5f040eb7c9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:15.948083 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3d85d574-2902-4391-a4ff-ea5f040eb7c9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:15.948724 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3d85d574-2902-4391-a4ff-ea5f040eb7c9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:15.949449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3d85d574-2902-4391-a4ff-ea5f040eb7c9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:15.950132 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3d85d574-2902-4391-a4ff-ea5f040eb7c9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:15.950933 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3d85d574-2902-4391-a4ff-ea5f040eb7c9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:15.955418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-95150643-fb8c-4343-86b2-fe17d01b9d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:15.957050 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-95150643-fb8c-4343-86b2-fe17d01b9d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:15.957738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-95150643-fb8c-4343-86b2-fe17d01b9d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:15.991447 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3d85d574-2902-4391-a4ff-ea5f040eb7c9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:53:16.114599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-95150643-fb8c-4343-86b2-fe17d01b9d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:16.123664 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-95150643-fb8c-4343-86b2-fe17d01b9d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:16.125175 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-95150643-fb8c-4343-86b2-fe17d01b9d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:16.126520 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-95150643-fb8c-4343-86b2-fe17d01b9d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1314 microversion: 2.25 time: 0.228340 Oct 10 18:53:16.150130 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 562/986] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:15 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:16.158199 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-314547518", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "1bbc9663-3d8f-4bdf-a8a3-9398530d7415"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:16.269073 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] validate_networks() for None {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:53:16.373273 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3d85d574-2902-4391-a4ff-ea5f040eb7c9 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 204 len: 0 microversion: 2.1 time: 0.439445 Oct 10 18:53:16.379897 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 425/987] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:53:15 2022] DELETE /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:16.403024 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0d2b556b-3f25-401f-9435-5d91b52b4046 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:16.403024 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0d2b556b-3f25-401f-9435-5d91b52b4046 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:16.419421 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d2b556b-3f25-401f-9435-5d91b52b4046 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:16.426193 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d2b556b-3f25-401f-9435-5d91b52b4046 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:16.428007 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d2b556b-3f25-401f-9435-5d91b52b4046 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:16.432567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d2b556b-3f25-401f-9435-5d91b52b4046 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:16.433266 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d2b556b-3f25-401f-9435-5d91b52b4046 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:16.435189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d2b556b-3f25-401f-9435-5d91b52b4046 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:16.778893 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0d2b556b-3f25-401f-9435-5d91b52b4046 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:16.792343 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0d2b556b-3f25-401f-9435-5d91b52b4046 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1467 microversion: 2.1 time: 0.405510 Oct 10 18:53:16.795438 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 426/988] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:16 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1467 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:16.808604 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8db483c1-0184-4e55-a1f9-695726659858 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:16.809548 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8db483c1-0184-4e55-a1f9-695726659858 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:16.823503 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8db483c1-0184-4e55-a1f9-695726659858 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:16.828226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8db483c1-0184-4e55-a1f9-695726659858 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:16.828802 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8db483c1-0184-4e55-a1f9-695726659858 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:16.829624 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8db483c1-0184-4e55-a1f9-695726659858 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:16.830152 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8db483c1-0184-4e55-a1f9-695726659858 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:16.843242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8db483c1-0184-4e55-a1f9-695726659858 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:17.057888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8db483c1-0184-4e55-a1f9-695726659858 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:17.066121 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8db483c1-0184-4e55-a1f9-695726659858 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1472 microversion: 2.1 time: 0.268448 Oct 10 18:53:17.067487 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 427/989] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:16 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1472 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:17.072952 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0dd52db3-8850-4c22-b263-09231ceafde5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:17.073879 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0dd52db3-8850-4c22-b263-09231ceafde5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:17.080531 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0dd52db3-8850-4c22-b263-09231ceafde5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:17.081308 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0dd52db3-8850-4c22-b263-09231ceafde5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:17.088822 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0dd52db3-8850-4c22-b263-09231ceafde5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:17.088822 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0dd52db3-8850-4c22-b263-09231ceafde5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:17.088822 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0dd52db3-8850-4c22-b263-09231ceafde5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:17.088822 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0dd52db3-8850-4c22-b263-09231ceafde5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:17.161143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:53:17.161708 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:53:17.162008 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:53:17.162608 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:53:17.163022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:53:17.182503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:17.185329 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:17.185900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:17.187920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:17.191026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:17.191026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:17.223823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:17.233868 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:17.257162 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:53:17.261656 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:53:17.364201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0dd52db3-8850-4c22-b263-09231ceafde5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:17.373578 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0dd52db3-8850-4c22-b263-09231ceafde5 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1647 microversion: 2.1 time: 0.304925 Oct 10 18:53:17.374380 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 428/990] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:17 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1647 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:17.379436 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-7b322300-acd5-45ad-abf6-63b0ad22791a req-92b80b3e-6f84-483f-b7eb-b52d0b726d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06dba6c-63b1-4f22-a1b1-d8be963d59d8", "tag": "64f101a7-8976-4073-913a-cafa0149f458"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:17.420165 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-54a2f7fa-b9c2-4b57-af68-a663388a7c15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.268225 Oct 10 18:53:17.420847 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 563/991] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:53:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:53:17.424520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7b322300-acd5-45ad-abf6-63b0ad22791a req-92b80b3e-6f84-483f-b7eb-b52d0b726d90 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:17.427339 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7b322300-acd5-45ad-abf6-63b0ad22791a req-92b80b3e-6f84-483f-b7eb-b52d0b726d90 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:17.427800 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7b322300-acd5-45ad-abf6-63b0ad22791a req-92b80b3e-6f84-483f-b7eb-b52d0b726d90 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:17.452313 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e85c2026-047e-4923-9053-e6898f9bc4bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:17.462178 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e85c2026-047e-4923-9053-e6898f9bc4bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:17.484246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e85c2026-047e-4923-9053-e6898f9bc4bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:17.485061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e85c2026-047e-4923-9053-e6898f9bc4bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:17.486228 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e85c2026-047e-4923-9053-e6898f9bc4bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:17.487335 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-7b322300-acd5-45ad-abf6-63b0ad22791a req-92b80b3e-6f84-483f-b7eb-b52d0b726d90 service nova] Creating event network-changed:64f101a7-8976-4073-913a-cafa0149f458 for instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 on n-h1-860863-1 Oct 10 18:53:17.488956 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e85c2026-047e-4923-9053-e6898f9bc4bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:17.489432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e85c2026-047e-4923-9053-e6898f9bc4bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:17.489869 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e85c2026-047e-4923-9053-e6898f9bc4bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:17.501036 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-7b322300-acd5-45ad-abf6-63b0ad22791a req-92b80b3e-6f84-483f-b7eb-b52d0b726d90 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125039 Oct 10 18:53:17.502134 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 429/992] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:17.768460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b50b6b66-fd42-4193-a745-0ab5038f3252 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-656677927", "block_migration": true, "disk_over_commit": false}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:17.771226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b50b6b66-fd42-4193-a745-0ab5038f3252 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:17.777874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b50b6b66-fd42-4193-a745-0ab5038f3252 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:17.778630 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b50b6b66-fd42-4193-a745-0ab5038f3252 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:17.779058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b50b6b66-fd42-4193-a745-0ab5038f3252 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:17.780162 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b50b6b66-fd42-4193-a745-0ab5038f3252 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:17.780639 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b50b6b66-fd42-4193-a745-0ab5038f3252 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:17.781058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b50b6b66-fd42-4193-a745-0ab5038f3252 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:17.811546 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-b50b6b66-fd42-4193-a745-0ab5038f3252 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lazy-loading 'flavor' on Instance uuid ed92d033-c393-4d15-9e85-dd766e282c93 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:53:17.843157 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b50b6b66-fd42-4193-a745-0ab5038f3252 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Going to try to live migrate instance to tempest-host-656677927 {{(pid=127289) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 18:53:17.852475 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-b50b6b66-fd42-4193-a745-0ab5038f3252 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] HTTP exception thrown: Compute host tempest-host-656677927 could not be found. Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b50b6b66-fd42-4193-a745-0ab5038f3252 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Request method failure captured: Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93/action HTTP/1.1 Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 106 Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoB1TRO6mlUvq00RMSvv8vTTwTbvSHdS7U4cnIMfEz6Ns87oENgSLjNr1bfYqS7AiUhVfr0GrO43toEPyCrQHCCl6Hxk8qyToD3qzw5hZFRB7L4QbwXAYzNGdg3gDjlg0-2jZx67lbj313s98Tnhadlg6OPoObHeZKunF0WeXqGdtc Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 9305118634e94837a22f67a3dc69b1bf Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-LiveMigrationNegativeTest-1036194896 Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9305118634e94837a22f67a3dc69b1bf", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9305118634e94837a22f67a3dc69b1bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9305118634e94837a22f67a3dc69b1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9305118634e94837a22f67a3dc69b1bf"}]}] Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-LiveMigrationNegativeTest-1036194896 Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 9305118634e94837a22f67a3dc69b1bf Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1036194896 Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-LiveMigrationNegativeTest-1036194896-project-admin Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: d38d678d8e23415ea09e3eed3c616e08 Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-LiveMigrationNegativeTest-1036194896-project-admin Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: {"os-migrateLive": {"host": "tempest-host-656677927", "block_migration": true, "disk_over_commit": false}} Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: exception: Compute host tempest-host-656677927 could not be found. Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'ed92d033-c393-4d15-9e85-dd766e282c93', 'body': {'os-migrateLive': {'host': 'tempest-host-656677927', 'block_migration': True, 'disk_over_commit': False}}} Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 10 18:53:17.859016 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-656677927 could not be found. Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-656677927 could not be found. Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-656677927 could not be found. Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b50b6b66-fd42-4193-a745-0ab5038f3252 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Returning 400 to user: Compute host tempest-host-656677927 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b50b6b66-fd42-4193-a745-0ab5038f3252 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93/action" status: 400 len: 99 microversion: 2.1 time: 0.355594 Oct 10 18:53:17.863621 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 430/993] 10.222.0.43 () {60 vars in 1279 bytes} [Mon Oct 10 18:53:17 2022] POST /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93/action => generated 99 bytes in 357 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 18:53:17.870877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cea081a3-62f3-437e-81e2-5918aa8de2fb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:17.871715 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cea081a3-62f3-437e-81e2-5918aa8de2fb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:17.879181 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cea081a3-62f3-437e-81e2-5918aa8de2fb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:17.879678 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cea081a3-62f3-437e-81e2-5918aa8de2fb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:17.880112 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cea081a3-62f3-437e-81e2-5918aa8de2fb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:17.880849 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cea081a3-62f3-437e-81e2-5918aa8de2fb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:17.881296 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cea081a3-62f3-437e-81e2-5918aa8de2fb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:17.881717 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cea081a3-62f3-437e-81e2-5918aa8de2fb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:18.135984 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cea081a3-62f3-437e-81e2-5918aa8de2fb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:18.154308 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cea081a3-62f3-437e-81e2-5918aa8de2fb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:18.158865 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cea081a3-62f3-437e-81e2-5918aa8de2fb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:18.160645 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cea081a3-62f3-437e-81e2-5918aa8de2fb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1362 microversion: 2.25 time: 0.299448 Oct 10 18:53:18.162408 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 431/994] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:17 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:18.187524 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e85c2026-047e-4923-9053-e6898f9bc4bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:18.198568 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e85c2026-047e-4923-9053-e6898f9bc4bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1315 microversion: 2.1 time: 0.766618 Oct 10 18:53:18.209299 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 564/995] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:17 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:18.221421 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-52e80f0b-f089-4dab-bfe4-ecb9156b9d39 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:18.221421 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-52e80f0b-f089-4dab-bfe4-ecb9156b9d39 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:18.334935 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-00e1dccf-cc25-40ac-b19c-93dc68b0809b tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Action: 'create', calling method: .version_select at 0x7f318dda4700>, body: {"keypair": {"name": "tempest-keypair-1012094872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyxZvhD0Z+k/Kxk0JwC9KdjvvDDl/VQuJXBehyat2bod9CkYzZ0gkcceqSlshEj+YbDOKNM6L0cSsaRw6rPN9w4Ep/JVSPL72UoErLZ6XLFInkpeiTAYKD9NDXIYcwqyw=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:18.361068 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-00e1dccf-cc25-40ac-b19c-93dc68b0809b tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:18.378004 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-00e1dccf-cc25-40ac-b19c-93dc68b0809b tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for user debe332142b1498ab8a0f43a0959f1f2 and project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:18.407234 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-52e80f0b-f089-4dab-bfe4-ecb9156b9d39 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:18.419309 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-52e80f0b-f089-4dab-bfe4-ecb9156b9d39 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1216 microversion: 2.1 time: 0.254833 Oct 10 18:53:18.419907 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 432/996] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:18 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1216 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:18.437762 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8c1a97a6-775e-4fc5-8e73-cf61b2e7e161 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:18.439143 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8c1a97a6-775e-4fc5-8e73-cf61b2e7e161 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:18.445502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c1a97a6-775e-4fc5-8e73-cf61b2e7e161 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:18.446297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c1a97a6-775e-4fc5-8e73-cf61b2e7e161 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:18.446936 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c1a97a6-775e-4fc5-8e73-cf61b2e7e161 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:18.447877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c1a97a6-775e-4fc5-8e73-cf61b2e7e161 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:18.448564 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c1a97a6-775e-4fc5-8e73-cf61b2e7e161 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:18.449177 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c1a97a6-775e-4fc5-8e73-cf61b2e7e161 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:18.557407 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-00e1dccf-cc25-40ac-b19c-93dc68b0809b tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.346428 Oct 10 18:53:18.558127 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 565/997] 10.222.0.43 () {62 vars in 1199 bytes} [Mon Oct 10 18:53:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 348 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 18:53:18.564048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b32775fc-57f5-4834-a6a7-d3be71fdb036 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:18.565987 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b32775fc-57f5-4834-a6a7-d3be71fdb036 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:18.586134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b32775fc-57f5-4834-a6a7-d3be71fdb036 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:18.586134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b32775fc-57f5-4834-a6a7-d3be71fdb036 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:18.586134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b32775fc-57f5-4834-a6a7-d3be71fdb036 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:18.586134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b32775fc-57f5-4834-a6a7-d3be71fdb036 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:18.586134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b32775fc-57f5-4834-a6a7-d3be71fdb036 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:18.586134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b32775fc-57f5-4834-a6a7-d3be71fdb036 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:18.839479 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b32775fc-57f5-4834-a6a7-d3be71fdb036 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:18.856274 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b32775fc-57f5-4834-a6a7-d3be71fdb036 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1472 microversion: 2.1 time: 0.296962 Oct 10 18:53:18.867525 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 566/998] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:18 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:18.867525 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-296e42ed-813c-4881-a201-65bf1c855d66 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:18.867525 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-296e42ed-813c-4881-a201-65bf1c855d66 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:18.871939 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-296e42ed-813c-4881-a201-65bf1c855d66 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:18.872733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-296e42ed-813c-4881-a201-65bf1c855d66 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:18.873316 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-296e42ed-813c-4881-a201-65bf1c855d66 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:18.874171 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-296e42ed-813c-4881-a201-65bf1c855d66 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:18.874771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-296e42ed-813c-4881-a201-65bf1c855d66 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:18.875681 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-296e42ed-813c-4881-a201-65bf1c855d66 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:18.884162 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8c1a97a6-775e-4fc5-8e73-cf61b2e7e161 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:18.892714 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8c1a97a6-775e-4fc5-8e73-cf61b2e7e161 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1467 microversion: 2.1 time: 0.458780 Oct 10 18:53:18.893497 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 433/999] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:18 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1467 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:18.912439 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7fbaaaf2-4b3c-47c6-ae48-2f84d873e990 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Calling method '.version_select at 0x7f318ddee790>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:18.933665 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7fbaaaf2-4b3c-47c6-ae48-2f84d873e990 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-1012094872" status: 200 len: 513 microversion: 2.2 time: 0.036626 Oct 10 18:53:18.934488 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 434/1000] 10.222.0.43 () {60 vars in 1258 bytes} [Mon Oct 10 18:53:18 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1012094872 => generated 513 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:18.946208 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-12f05fa9-da0d-427c-b27d-fb590fcc2dda tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Calling method '.version_select at 0x7f318e2375e0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:19.053529 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-12f05fa9-da0d-427c-b27d-fb590fcc2dda tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1012094872" status: 204 len: 0 microversion: 2.2 time: 0.110099 Oct 10 18:53:19.061868 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 435/1001] 10.222.0.43 () {60 vars in 1261 bytes} [Mon Oct 10 18:53:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1012094872 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:19.068714 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-238945334", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:19.121634 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-296e42ed-813c-4881-a201-65bf1c855d66 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:19.144565 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] validate_networks() for None {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:53:19.152848 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-296e42ed-813c-4881-a201-65bf1c855d66 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1647 microversion: 2.1 time: 0.294008 Oct 10 18:53:19.164584 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 567/1002] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:18 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1647 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:19.165155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1bfce300-d597-440b-8e76-9d97f30eca05 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Action: 'create', calling method: .version_select at 0x7f318e7405e0>, body: {"keypair": {"name": "tempest-keypair-2016743030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxvakr2jVBFR58IZQ9QzhbQkWvx9xvRdS6vYgx5QyuQ4jUwMGe4v3LUk6ipaibizkOP6rpoIgUSYEoZwo8vMUA13ppCKITzEnDBSvKu1X+3QlLVnzfLEfup2SsJ3IaRNA=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:19.187368 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-1bfce300-d597-440b-8e76-9d97f30eca05 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:19.201190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-1bfce300-d597-440b-8e76-9d97f30eca05 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for user debe332142b1498ab8a0f43a0959f1f2 and project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:19.314881 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1bfce300-d597-440b-8e76-9d97f30eca05 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.156014 Oct 10 18:53:19.316061 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 568/1003] 10.222.0.43 () {62 vars in 1199 bytes} [Mon Oct 10 18:53:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 18:53:19.325467 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5ed16b14-096b-4057-9360-a07abe5f90d0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:19.326303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5ed16b14-096b-4057-9360-a07abe5f90d0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:19.334347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5ed16b14-096b-4057-9360-a07abe5f90d0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:19.334874 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5ed16b14-096b-4057-9360-a07abe5f90d0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:19.335517 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5ed16b14-096b-4057-9360-a07abe5f90d0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:19.336227 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5ed16b14-096b-4057-9360-a07abe5f90d0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:19.336708 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5ed16b14-096b-4057-9360-a07abe5f90d0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:19.337134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5ed16b14-096b-4057-9360-a07abe5f90d0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:19.489622 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5ed16b14-096b-4057-9360-a07abe5f90d0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:19.500007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5ed16b14-096b-4057-9360-a07abe5f90d0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:19.501918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5ed16b14-096b-4057-9360-a07abe5f90d0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:19.503204 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5ed16b14-096b-4057-9360-a07abe5f90d0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1362 microversion: 2.25 time: 0.186051 Oct 10 18:53:19.503761 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 569/1004] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:19 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:19.508712 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-880adecd-eedd-439d-a24d-68eb199d1418 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:19.509797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-880adecd-eedd-439d-a24d-68eb199d1418 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:19.516713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-880adecd-eedd-439d-a24d-68eb199d1418 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:19.517197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-880adecd-eedd-439d-a24d-68eb199d1418 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:19.520303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-880adecd-eedd-439d-a24d-68eb199d1418 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:19.520303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-880adecd-eedd-439d-a24d-68eb199d1418 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:19.520303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-880adecd-eedd-439d-a24d-68eb199d1418 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:19.520303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-880adecd-eedd-439d-a24d-68eb199d1418 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:19.740308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-880adecd-eedd-439d-a24d-68eb199d1418 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:19.754285 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-880adecd-eedd-439d-a24d-68eb199d1418 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1315 microversion: 2.1 time: 0.249120 Oct 10 18:53:19.755592 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 570/1005] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:19 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:19.760720 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8e814940-1c51-4147-b768-04c88eb20c92 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Calling method '.version_select at 0x7f318ef509d0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:19.774661 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:53:19.775231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:53:19.780645 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:53:19.781337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:53:19.781877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:53:19.813640 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:19.814299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:19.814803 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:19.815627 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:19.816112 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:19.816571 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:19.860772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Getting quotas for project 9fedc5f489634425b4bbae61ab3897bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:19.867949 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Getting quotas for user 7f32dfaf09884d848804aed1ed5a2be4 and project 9fedc5f489634425b4bbae61ab3897bd. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:19.876962 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8e814940-1c51-4147-b768-04c88eb20c92 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016743030" status: 204 len: 0 microversion: 2.2 time: 0.120245 Oct 10 18:53:19.878191 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 571/1006] 10.222.0.43 () {60 vars in 1261 bytes} [Mon Oct 10 18:53:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2016743030 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:19.883509 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7ba0ae29-7ae0-44c5-95e8-6428e3bbb932 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:19.885031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7ba0ae29-7ae0-44c5-95e8-6428e3bbb932 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:19.893501 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:53:19.894805 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ba0ae29-7ae0-44c5-95e8-6428e3bbb932 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:19.896035 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ba0ae29-7ae0-44c5-95e8-6428e3bbb932 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:19.896159 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:53:19.896869 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ba0ae29-7ae0-44c5-95e8-6428e3bbb932 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:19.897813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ba0ae29-7ae0-44c5-95e8-6428e3bbb932 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:19.898506 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ba0ae29-7ae0-44c5-95e8-6428e3bbb932 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:19.899282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ba0ae29-7ae0-44c5-95e8-6428e3bbb932 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:19.920296 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:19.970260 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7ba0ae29-7ae0-44c5-95e8-6428e3bbb932 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:20.001240 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7ba0ae29-7ae0-44c5-95e8-6428e3bbb932 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1220 microversion: 2.1 time: 0.099153 Oct 10 18:53:20.001240 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 572/1007] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:19 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:20.006249 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-576a540c-e01a-40f2-9e6d-521528da9590 req-9002f816-471c-430b-a6b1-0f26e142c424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1beef1-3d9a-4af8-ac68-048748261c19", "name": "network-vif-deleted", "tag": "98401b59-e218-4900-acf6-4ca8bcde0d49"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:20.019665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-576a540c-e01a-40f2-9e6d-521528da9590 req-9002f816-471c-430b-a6b1-0f26e142c424 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:20.020135 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-576a540c-e01a-40f2-9e6d-521528da9590 req-9002f816-471c-430b-a6b1-0f26e142c424 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:20.024966 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-576a540c-e01a-40f2-9e6d-521528da9590 req-9002f816-471c-430b-a6b1-0f26e142c424 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:20.033615 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-576a540c-e01a-40f2-9e6d-521528da9590 req-9002f816-471c-430b-a6b1-0f26e142c424 service nova] Creating event network-vif-deleted:98401b59-e218-4900-acf6-4ca8bcde0d49 for instance cf1beef1-3d9a-4af8-ac68-048748261c19 on n-h2-860863-1 Oct 10 18:53:20.038587 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-576a540c-e01a-40f2-9e6d-521528da9590 req-9002f816-471c-430b-a6b1-0f26e142c424 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041870 Oct 10 18:53:20.039620 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 573/1008] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:20.058574 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2146ae37-9ce1-42c1-ad57-f04102a5fda7 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.995317 Oct 10 18:53:20.059519 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 436/1009] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:53:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:53:20.065435 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-46c2d55f-51f7-4ae9-aabf-a409ca422430 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:20.066934 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-46c2d55f-51f7-4ae9-aabf-a409ca422430 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:20.073631 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a2bb2f34-bc2f-4145-bf8d-86d907068a4c tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Action: 'create', calling method: .version_select at 0x7f318dda4af0>, body: {"keypair": {"name": "tempest-keypair-817535340", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:20.075413 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46c2d55f-51f7-4ae9-aabf-a409ca422430 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:20.076153 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46c2d55f-51f7-4ae9-aabf-a409ca422430 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:20.077157 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46c2d55f-51f7-4ae9-aabf-a409ca422430 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:20.078363 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46c2d55f-51f7-4ae9-aabf-a409ca422430 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:20.079044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46c2d55f-51f7-4ae9-aabf-a409ca422430 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:20.079826 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46c2d55f-51f7-4ae9-aabf-a409ca422430 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:20.120948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-a2bb2f34-bc2f-4145-bf8d-86d907068a4c tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:20.126840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-a2bb2f34-bc2f-4145-bf8d-86d907068a4c tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for user debe332142b1498ab8a0f43a0959f1f2 and project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:20.282676 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a2bb2f34-bc2f-4145-bf8d-86d907068a4c tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.241767 Oct 10 18:53:20.289210 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 574/1010] 10.222.0.43 () {62 vars in 1199 bytes} [Mon Oct 10 18:53:20 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 245 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 18:53:20.295115 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-81da5097-8519-4c78-bc3c-3dbe16774790 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:20.296576 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-81da5097-8519-4c78-bc3c-3dbe16774790 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:20.319993 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-46c2d55f-51f7-4ae9-aabf-a409ca422430 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:20.329895 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-46c2d55f-51f7-4ae9-aabf-a409ca422430 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1472 microversion: 2.1 time: 0.268676 Oct 10 18:53:20.330870 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 437/1011] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:20 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1472 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:20.353601 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-10b2c43e-47b5-43ff-978a-ec1db8f7caba tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:20.354222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-10b2c43e-47b5-43ff-978a-ec1db8f7caba tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:20.363904 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-81da5097-8519-4c78-bc3c-3dbe16774790 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:20.364122 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10b2c43e-47b5-43ff-978a-ec1db8f7caba tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:20.371795 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-81da5097-8519-4c78-bc3c-3dbe16774790 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1218 microversion: 2.1 time: 0.085662 Oct 10 18:53:20.372320 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10b2c43e-47b5-43ff-978a-ec1db8f7caba tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:20.372918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10b2c43e-47b5-43ff-978a-ec1db8f7caba tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:20.374121 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 575/1012] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:20 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:20.377335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10b2c43e-47b5-43ff-978a-ec1db8f7caba tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:20.388825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10b2c43e-47b5-43ff-978a-ec1db8f7caba tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:20.389539 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10b2c43e-47b5-43ff-978a-ec1db8f7caba tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:20.397644 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d23b46fc-6aaf-427d-901b-9768bb702ec9 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Calling method '.version_select at 0x7f318dd77550>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:20.428026 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:20.463910 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10b2c43e-47b5-43ff-978a-ec1db8f7caba tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:20.464530 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10b2c43e-47b5-43ff-978a-ec1db8f7caba tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:20.465919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10b2c43e-47b5-43ff-978a-ec1db8f7caba tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:20.467791 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-10b2c43e-47b5-43ff-978a-ec1db8f7caba tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lazy-loading 'fault' on Instance uuid cf1beef1-3d9a-4af8-ac68-048748261c19 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:53:20.520722 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d23b46fc-6aaf-427d-901b-9768bb702ec9 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-817535340" status: 204 len: 0 microversion: 2.2 time: 0.144622 Oct 10 18:53:20.521508 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 576/1013] 10.222.0.43 () {60 vars in 1258 bytes} [Mon Oct 10 18:53:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-817535340 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:20.532708 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e8bb02ff-97fd-43b3-95aa-73e35e0d7858 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:20.533674 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e8bb02ff-97fd-43b3-95aa-73e35e0d7858 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:20.542319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8bb02ff-97fd-43b3-95aa-73e35e0d7858 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:20.545694 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8bb02ff-97fd-43b3-95aa-73e35e0d7858 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:20.546404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8bb02ff-97fd-43b3-95aa-73e35e0d7858 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:20.547464 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8bb02ff-97fd-43b3-95aa-73e35e0d7858 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:20.548122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8bb02ff-97fd-43b3-95aa-73e35e0d7858 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:20.549978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8bb02ff-97fd-43b3-95aa-73e35e0d7858 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:20.575485 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-10b2c43e-47b5-43ff-978a-ec1db8f7caba tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:20.584221 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-10b2c43e-47b5-43ff-978a-ec1db8f7caba tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 200 len: 1306 microversion: 2.1 time: 0.252212 Oct 10 18:53:20.590874 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 438/1014] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:20 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 1306 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:20.595900 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4375b142-1f28-4a4e-998e-88e6c9454a0f tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Action: 'create', calling method: .version_select at 0x7f318dd72940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-123531124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4Ngg7lvMGSFgURrns5FpAQc8QcY/Ps1gNvlTMOeigg58CLnb80F6VbowtgsGS6540ecwOtGt1IdEmbWtR1kWrETdOijw2jZuRyTKNG5CrC1BCFvMoNgNhkqcHwnVGFbA=="}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:20.623011 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-4375b142-1f28-4a4e-998e-88e6c9454a0f tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:20.628448 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-4375b142-1f28-4a4e-998e-88e6c9454a0f tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for user debe332142b1498ab8a0f43a0959f1f2 and project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:20.718460 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4375b142-1f28-4a4e-998e-88e6c9454a0f tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.124659 Oct 10 18:53:20.721797 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 439/1015] 10.222.0.43 () {62 vars in 1199 bytes} [Mon Oct 10 18:53:20 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 18:53:20.736327 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-160e7b1d-04eb-4b5e-9227-0490866f3e3c tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Action: 'create', calling method: .version_select at 0x7f318de3ec10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-793445377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwd3IRx3xWNKQaK+tgpZ4mcZ62D9mQZlJRYns92jeHKTb12iiJoz/HKrG6rVFSO7+YxhjIuh4Wu8fzYwDh4NyltkgazNcbfad7l8F4qo0DkbB6jpnSIUiDI0zKrM6dVqg=="}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:20.774146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-160e7b1d-04eb-4b5e-9227-0490866f3e3c tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:20.795142 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-160e7b1d-04eb-4b5e-9227-0490866f3e3c tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for user debe332142b1498ab8a0f43a0959f1f2 and project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:20.894185 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e8bb02ff-97fd-43b3-95aa-73e35e0d7858 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:20.918578 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e8bb02ff-97fd-43b3-95aa-73e35e0d7858 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:20.922237 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-160e7b1d-04eb-4b5e-9227-0490866f3e3c tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.189963 Oct 10 18:53:20.923151 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 440/1016] 10.222.0.43 () {62 vars in 1199 bytes} [Mon Oct 10 18:53:20 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 192 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 10 18:53:20.927126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e8bb02ff-97fd-43b3-95aa-73e35e0d7858 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:20.929786 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e8bb02ff-97fd-43b3-95aa-73e35e0d7858 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1362 microversion: 2.25 time: 0.401011 Oct 10 18:53:20.930952 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ddae2557-df06-4934-9fbd-33bf421e861a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:20.932904 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ddae2557-df06-4934-9fbd-33bf421e861a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:20.936457 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 577/1017] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:20 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:20.945388 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3abf55e5-d530-4712-9326-986e3e2a5e69 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Action: 'create', calling method: .version_select at 0x7f318deca550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-672839078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLveE79asESPOzYyFWbbbnaAp3FQ490wPHCQqRz2mjOb0r5jQMKPOs9LEFnAac58Jqk2hdC7GkZiLNgHHGe/ZNew0MQ7ef2dmVLF2sSqjBLPe7EopHApARxb02RwxsnjSQ=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:20.966068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ddae2557-df06-4934-9fbd-33bf421e861a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:20.966961 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ddae2557-df06-4934-9fbd-33bf421e861a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:20.967735 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ddae2557-df06-4934-9fbd-33bf421e861a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:20.975890 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ddae2557-df06-4934-9fbd-33bf421e861a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:20.975890 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ddae2557-df06-4934-9fbd-33bf421e861a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:20.975890 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ddae2557-df06-4934-9fbd-33bf421e861a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:21.005114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-3abf55e5-d530-4712-9326-986e3e2a5e69 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:21.030973 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-3abf55e5-d530-4712-9326-986e3e2a5e69 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for user debe332142b1498ab8a0f43a0959f1f2 and project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:21.210914 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3abf55e5-d530-4712-9326-986e3e2a5e69 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.272899 Oct 10 18:53:21.212290 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 578/1018] 10.222.0.43 () {62 vars in 1199 bytes} [Mon Oct 10 18:53:20 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 275 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 18:53:21.224042 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6cccca1c-785a-4be2-925c-5250195b87aa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:21.225664 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6cccca1c-785a-4be2-925c-5250195b87aa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:21.236951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cccca1c-785a-4be2-925c-5250195b87aa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:21.238096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cccca1c-785a-4be2-925c-5250195b87aa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:21.238706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cccca1c-785a-4be2-925c-5250195b87aa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:21.240375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cccca1c-785a-4be2-925c-5250195b87aa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:21.241082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cccca1c-785a-4be2-925c-5250195b87aa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:21.242839 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cccca1c-785a-4be2-925c-5250195b87aa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:21.392886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ddae2557-df06-4934-9fbd-33bf421e861a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:21.401566 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ddae2557-df06-4934-9fbd-33bf421e861a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1315 microversion: 2.1 time: 0.476884 Oct 10 18:53:21.405623 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 441/1019] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:20 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:21.414745 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-78e74681-2353-4ea1-87d5-c269af0f46ec tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Calling method '.version_select at 0x7f318dd723a0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:21.420390 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6cccca1c-785a-4be2-925c-5250195b87aa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:21.422249 n-d-860863-1 devstack@n-api.service[127289]: WARNING oslo_db.sqlalchemy.utils [None req-78e74681-2353-4ea1-87d5-c269af0f46ec tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 18:53:21.432641 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6cccca1c-785a-4be2-925c-5250195b87aa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1212 microversion: 2.1 time: 0.217522 Oct 10 18:53:21.433859 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 579/1020] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:21 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1212 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:21.446200 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-78e74681-2353-4ea1-87d5-c269af0f46ec tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.039176 Oct 10 18:53:21.460223 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 442/1021] 10.222.0.43 () {60 vars in 1177 bytes} [Mon Oct 10 18:53:21 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:21.468561 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0d7772fe-26a9-4f25-bfae-1200b04fe853 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:21.469559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0d7772fe-26a9-4f25-bfae-1200b04fe853 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:21.469800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f5768e8a-949b-4aad-8406-e047f2bcf6c7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:21.471282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f5768e8a-949b-4aad-8406-e047f2bcf6c7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:21.479337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:21.481717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:21.483428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5768e8a-949b-4aad-8406-e047f2bcf6c7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:21.484248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5768e8a-949b-4aad-8406-e047f2bcf6c7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:21.485515 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5768e8a-949b-4aad-8406-e047f2bcf6c7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:21.487096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5768e8a-949b-4aad-8406-e047f2bcf6c7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:21.487577 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d7772fe-26a9-4f25-bfae-1200b04fe853 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:21.487898 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5768e8a-949b-4aad-8406-e047f2bcf6c7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:21.488808 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f5768e8a-949b-4aad-8406-e047f2bcf6c7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:21.490049 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d7772fe-26a9-4f25-bfae-1200b04fe853 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:21.490598 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d7772fe-26a9-4f25-bfae-1200b04fe853 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:21.492892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d7772fe-26a9-4f25-bfae-1200b04fe853 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:21.499880 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d7772fe-26a9-4f25-bfae-1200b04fe853 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:21.500476 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d7772fe-26a9-4f25-bfae-1200b04fe853 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:21.696563 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f5768e8a-949b-4aad-8406-e047f2bcf6c7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:21.710420 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f5768e8a-949b-4aad-8406-e047f2bcf6c7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1478 microversion: 2.1 time: 0.254236 Oct 10 18:53:21.711370 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 580/1022] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:21 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1478 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:21.718189 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5798e77a-ae0f-4425-84f1-3d93d19ca70a tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Calling method '.version_select at 0x7f318deca550>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:21.777927 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5798e77a-ae0f-4425-84f1-3d93d19ca70a tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-672839078" status: 204 len: 0 microversion: 2.2 time: 0.065611 Oct 10 18:53:21.782497 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 581/1023] 10.222.0.43 () {60 vars in 1318 bytes} [Mon Oct 10 18:53:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-672839078 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:21.787325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-528bd3f9-f0f0-40da-b0ab-651d51ae0da1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:21.787325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-528bd3f9-f0f0-40da-b0ab-651d51ae0da1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:21.795658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-528bd3f9-f0f0-40da-b0ab-651d51ae0da1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:21.796241 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-528bd3f9-f0f0-40da-b0ab-651d51ae0da1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:21.796776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-528bd3f9-f0f0-40da-b0ab-651d51ae0da1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:21.797567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-528bd3f9-f0f0-40da-b0ab-651d51ae0da1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:21.798101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-528bd3f9-f0f0-40da-b0ab-651d51ae0da1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:21.798600 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-528bd3f9-f0f0-40da-b0ab-651d51ae0da1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:21.817341 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-528bd3f9-f0f0-40da-b0ab-651d51ae0da1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-528bd3f9-f0f0-40da-b0ab-651d51ae0da1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 HTTP/1.1 Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'cf1beef1-3d9a-4af8-ac68-048748261c19'} Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:21.819476 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:21.824431 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:21.824431 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:21.824431 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:21.824431 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:21.824431 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:21.824431 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:21.824431 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:21.824431 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-528bd3f9-f0f0-40da-b0ab-651d51ae0da1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 404 to user: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:21.824431 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-528bd3f9-f0f0-40da-b0ab-651d51ae0da1 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 404 len: 111 microversion: 2.1 time: 0.041537 Oct 10 18:53:21.824431 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 582/1024] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:21 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:53:21.827548 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1e127416-eb44-4793-9d6f-a4af88f32083 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Calling method '.version_select at 0x7f318dda4b80>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:21.855234 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0d7772fe-26a9-4f25-bfae-1200b04fe853 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:21.863977 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0d7772fe-26a9-4f25-bfae-1200b04fe853 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1222 microversion: 2.1 time: 0.402310 Oct 10 18:53:21.864657 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 443/1025] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:21 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1222 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:21.872086 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e057762e-82c8-400c-9ceb-778a4c63e7fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318dd72f70>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:21.911264 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1e127416-eb44-4793-9d6f-a4af88f32083 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-793445377" status: 204 len: 0 microversion: 2.2 time: 0.087757 Oct 10 18:53:21.912664 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 583/1026] 10.222.0.43 () {60 vars in 1318 bytes} [Mon Oct 10 18:53:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-793445377 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:21.921766 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5b98e953-901b-4d8a-b859-5f5611e4d3a1 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Calling method '.version_select at 0x7f318dd97d30>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:22.034562 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5b98e953-901b-4d8a-b859-5f5611e4d3a1 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-123531124" status: 204 len: 0 microversion: 2.2 time: 0.116828 Oct 10 18:53:22.035626 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 584/1027] 10.222.0.43 () {60 vars in 1318 bytes} [Mon Oct 10 18:53:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-123531124 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 18:53:22.045072 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f3e59c48-f923-48a9-ba72-56b82e88fe52 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:22.045959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f3e59c48-f923-48a9-ba72-56b82e88fe52 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:22.054598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3e59c48-f923-48a9-ba72-56b82e88fe52 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:22.056374 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3e59c48-f923-48a9-ba72-56b82e88fe52 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:22.057930 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3e59c48-f923-48a9-ba72-56b82e88fe52 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:22.058892 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3e59c48-f923-48a9-ba72-56b82e88fe52 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:22.059806 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3e59c48-f923-48a9-ba72-56b82e88fe52 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:22.060425 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3e59c48-f923-48a9-ba72-56b82e88fe52 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:22.218001 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f3e59c48-f923-48a9-ba72-56b82e88fe52 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:22.226669 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f3e59c48-f923-48a9-ba72-56b82e88fe52 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:22.228123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f3e59c48-f923-48a9-ba72-56b82e88fe52 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:22.229805 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f3e59c48-f923-48a9-ba72-56b82e88fe52 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1362 microversion: 2.25 time: 0.192971 Oct 10 18:53:22.230620 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 585/1028] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:22 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:22.235475 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-89a97894-631b-41d0-a7e2-379f324e8312 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Action: 'create', calling method: .version_select at 0x7f318ddbcee0>, body: {"keypair": {"name": "tempest-keypair-2102201997", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7LKTHnaOlnueOeAb/Km+9XCsXQH9+LlwsNQhSbYUhkTH3xEBOhj0F721mtaR0EBR2a4z6dv9Q+Nj3jnKR2G2Rw9RkTlLK8sY0YsYDhAl8XeO/g+7q6pURKI9nNmUDoEg=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:22.251539 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-89a97894-631b-41d0-a7e2-379f324e8312 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:22.257130 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-89a97894-631b-41d0-a7e2-379f324e8312 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for user debe332142b1498ab8a0f43a0959f1f2 and project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:22.276643 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e057762e-82c8-400c-9ceb-778a4c63e7fa tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58" status: 202 len: 0 microversion: 2.1 time: 0.410860 Oct 10 18:53:22.278073 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 444/1029] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:21 2022] DELETE /compute/v2.1/os-security-groups/cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:22.284003 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-8b1a10ed-d63b-4d18-931c-6046c08f2863 req-cb493a3c-2e51-4dd4-a51a-b7e9de0f6f96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89b360b-2f7e-4f80-9247-559c3b0cf714", "tag": "1442dec7-2556-4073-a34d-d9c24dea3b48"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:22.303868 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-8b1a10ed-d63b-4d18-931c-6046c08f2863 req-cb493a3c-2e51-4dd4-a51a-b7e9de0f6f96 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:22.309340 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-8b1a10ed-d63b-4d18-931c-6046c08f2863 req-cb493a3c-2e51-4dd4-a51a-b7e9de0f6f96 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:22.310322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-8b1a10ed-d63b-4d18-931c-6046c08f2863 req-cb493a3c-2e51-4dd4-a51a-b7e9de0f6f96 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:22.336787 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-8b1a10ed-d63b-4d18-931c-6046c08f2863 req-cb493a3c-2e51-4dd4-a51a-b7e9de0f6f96 service nova] Creating event network-changed:1442dec7-2556-4073-a34d-d9c24dea3b48 for instance d89b360b-2f7e-4f80-9247-559c3b0cf714 on n-h1-860863-1 Oct 10 18:53:22.344103 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-8b1a10ed-d63b-4d18-931c-6046c08f2863 req-cb493a3c-2e51-4dd4-a51a-b7e9de0f6f96 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063381 Oct 10 18:53:22.345178 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 445/1030] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:22.351153 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cb52da7c-40d1-4ea4-bdb8-3f4fd244bd4e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318dd725e0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:22.366219 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-89a97894-631b-41d0-a7e2-379f324e8312 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.134507 Oct 10 18:53:22.367173 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 586/1031] 10.222.0.43 () {62 vars in 1199 bytes} [Mon Oct 10 18:53:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 10 18:53:22.389265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7af0ac9f-44fd-4cc7-866d-d4dd96501309 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Calling method '.version_select at 0x7f3192378820>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:22.402469 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7af0ac9f-44fd-4cc7-866d-d4dd96501309 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-2102201997" status: 200 len: 513 microversion: 2.2 time: 0.027081 Oct 10 18:53:22.404020 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 587/1032] 10.222.0.43 () {60 vars in 1258 bytes} [Mon Oct 10 18:53:22 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2102201997 => generated 513 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:22.428512 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-10dc6f16-c517-4d51-b685-744e78871321 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Calling method '.version_select at 0x7f3192384dc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:22.435407 n-d-860863-1 devstack@n-api.service[127288]: WARNING oslo_db.sqlalchemy.utils [None req-10dc6f16-c517-4d51-b685-744e78871321 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 18:53:22.464385 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-10dc6f16-c517-4d51-b685-744e78871321 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.045172 Oct 10 18:53:22.470669 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 588/1033] 10.222.0.43 () {60 vars in 1177 bytes} [Mon Oct 10 18:53:22 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:22.480963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-28888170-a206-447e-8639-5438943dba23 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:22.491285 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-28888170-a206-447e-8639-5438943dba23 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:22.511962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-28888170-a206-447e-8639-5438943dba23 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:22.516570 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-28888170-a206-447e-8639-5438943dba23 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:22.516570 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-28888170-a206-447e-8639-5438943dba23 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:22.516570 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-28888170-a206-447e-8639-5438943dba23 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:22.516570 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-28888170-a206-447e-8639-5438943dba23 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:22.516570 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-28888170-a206-447e-8639-5438943dba23 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:22.715499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-28888170-a206-447e-8639-5438943dba23 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:22.726478 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-28888170-a206-447e-8639-5438943dba23 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1315 microversion: 2.1 time: 0.254348 Oct 10 18:53:22.727464 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 589/1034] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:22 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:22.734431 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-95a0a3c1-8111-485d-a9ab-65a9a470ad49 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:22.735455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-95a0a3c1-8111-485d-a9ab-65a9a470ad49 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:22.744405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-95a0a3c1-8111-485d-a9ab-65a9a470ad49 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:22.745560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-95a0a3c1-8111-485d-a9ab-65a9a470ad49 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:22.746150 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-95a0a3c1-8111-485d-a9ab-65a9a470ad49 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:22.747379 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-95a0a3c1-8111-485d-a9ab-65a9a470ad49 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:22.747725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-95a0a3c1-8111-485d-a9ab-65a9a470ad49 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:22.748155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-95a0a3c1-8111-485d-a9ab-65a9a470ad49 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:22.819212 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-95a0a3c1-8111-485d-a9ab-65a9a470ad49 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:22.828897 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-95a0a3c1-8111-485d-a9ab-65a9a470ad49 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1212 microversion: 2.1 time: 0.099466 Oct 10 18:53:22.829777 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 590/1035] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:22 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1212 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:22.846704 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-12482ea7-49fa-4d8e-a3a2-3ae66bcb39ef tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Calling method '.version_select at 0x7f3192384a60>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:22.920608 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-12482ea7-49fa-4d8e-a3a2-3ae66bcb39ef tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102201997" status: 204 len: 0 microversion: 2.2 time: 0.078831 Oct 10 18:53:22.921427 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 591/1036] 10.222.0.43 () {60 vars in 1261 bytes} [Mon Oct 10 18:53:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102201997 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:22.928657 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f06db83b-f088-4cd7-abaf-98ef36f3474a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:22.933247 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f06db83b-f088-4cd7-abaf-98ef36f3474a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:22.939457 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f06db83b-f088-4cd7-abaf-98ef36f3474a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:22.940051 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f06db83b-f088-4cd7-abaf-98ef36f3474a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:22.940711 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f06db83b-f088-4cd7-abaf-98ef36f3474a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:22.941622 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f06db83b-f088-4cd7-abaf-98ef36f3474a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:22.941795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f06db83b-f088-4cd7-abaf-98ef36f3474a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:22.942382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f06db83b-f088-4cd7-abaf-98ef36f3474a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:23.174833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f06db83b-f088-4cd7-abaf-98ef36f3474a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:23.179819 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f06db83b-f088-4cd7-abaf-98ef36f3474a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1478 microversion: 2.1 time: 0.255574 Oct 10 18:53:23.180476 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 592/1037] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:22 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1478 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:23.186433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e0c31528-0d26-4a25-95a5-75013c7acd2b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:23.187031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e0c31528-0d26-4a25-95a5-75013c7acd2b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:23.193050 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e0c31528-0d26-4a25-95a5-75013c7acd2b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:23.194273 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e0c31528-0d26-4a25-95a5-75013c7acd2b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:23.195134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e0c31528-0d26-4a25-95a5-75013c7acd2b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:23.195404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e0c31528-0d26-4a25-95a5-75013c7acd2b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:23.195852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e0c31528-0d26-4a25-95a5-75013c7acd2b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:23.196268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e0c31528-0d26-4a25-95a5-75013c7acd2b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:23.217390 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cb52da7c-40d1-4ea4-bdb8-3f4fd244bd4e tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/2b3fd4ec-9f5d-45b8-ab70-702fa0280d18" status: 202 len: 0 microversion: 2.1 time: 0.871053 Oct 10 18:53:23.219588 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 446/1038] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:22 2022] DELETE /compute/v2.1/os-security-groups/2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 => generated 0 bytes in 874 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:23.225506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d5569a2a-d5c3-4d30-b947-18c2ac692600 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Action: 'create', calling method: .version_select at 0x7f318e2375e0>, body: {"keypair": {"name": "tempest-keypair-830952571", "type": "x509"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:23.266299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-d5569a2a-d5c3-4d30-b947-18c2ac692600 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:23.274011 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-d5569a2a-d5c3-4d30-b947-18c2ac692600 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for user debe332142b1498ab8a0f43a0959f1f2 and project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:23.293767 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.processutils [None req-d5569a2a-d5c3-4d30-b947-18c2ac692600 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpjcs73iah/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpjcs73iah/temp.key -subj /CN=debe332142b1498ab8a0f43a0959f1f2 -extensions v3_req_client {{(pid=127289) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 10 18:53:23.304984 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e0c31528-0d26-4a25-95a5-75013c7acd2b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:23.323175 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e0c31528-0d26-4a25-95a5-75013c7acd2b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1214 microversion: 2.1 time: 0.141029 Oct 10 18:53:23.328847 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 593/1039] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:23 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:23.336453 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9a7117e5-25c1-4269-b493-0ba8cbb1fa09 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'create', calling method: .version_select at 0x7f3192384310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1622948231", "description": "tempest-description-872298012"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:23.578705 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.processutils [None req-d5569a2a-d5c3-4d30-b947-18c2ac692600 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpjcs73iah/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpjcs73iah/temp.key -subj /CN=debe332142b1498ab8a0f43a0959f1f2 -extensions v3_req_client" returned: 0 in 0.284s {{(pid=127289) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 10 18:53:23.580484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.processutils [None req-d5569a2a-d5c3-4d30-b947-18c2ac692600 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpjcs73iah/temp.key -password pass: {{(pid=127289) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 10 18:53:23.603986 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.processutils [None req-d5569a2a-d5c3-4d30-b947-18c2ac692600 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpjcs73iah/temp.key -password pass:" returned: 0 in 0.022s {{(pid=127289) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 10 18:53:23.689891 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9a7117e5-25c1-4269-b493-0ba8cbb1fa09 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.358477 Oct 10 18:53:23.698682 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 594/1040] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:53:23 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:23.702796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e4572c52-aab2-4d5c-a10d-96328f42c29e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:23.704180 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e4572c52-aab2-4d5c-a10d-96328f42c29e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:23.711051 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4572c52-aab2-4d5c-a10d-96328f42c29e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:23.711560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4572c52-aab2-4d5c-a10d-96328f42c29e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:23.712053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4572c52-aab2-4d5c-a10d-96328f42c29e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:23.713716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4572c52-aab2-4d5c-a10d-96328f42c29e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:23.714256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4572c52-aab2-4d5c-a10d-96328f42c29e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:23.714751 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4572c52-aab2-4d5c-a10d-96328f42c29e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:23.762296 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-d5569a2a-d5c3-4d30-b947-18c2ac692600 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:23.778366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-d5569a2a-d5c3-4d30-b947-18c2ac692600 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Getting quotas for user debe332142b1498ab8a0f43a0959f1f2 and project 5f14e501c3894097813e07350e017d27. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:23.819402 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d5569a2a-d5c3-4d30-b947-18c2ac692600 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.598129 Oct 10 18:53:23.820190 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 447/1041] 10.222.0.43 () {62 vars in 1198 bytes} [Mon Oct 10 18:53:23 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 600 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:23.827886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-190c3745-fa89-492d-a61a-800d107f74e8 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Action: 'update', calling method: .version_select at 0x7f318df6e0d0>, body: {"security_group": {"name": "tempest-sg-hth-1547906096", "description": "tempest-description-hth-1486150990"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:23.906573 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e4572c52-aab2-4d5c-a10d-96328f42c29e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:23.915334 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e4572c52-aab2-4d5c-a10d-96328f42c29e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:23.917723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e4572c52-aab2-4d5c-a10d-96328f42c29e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:23.918926 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e4572c52-aab2-4d5c-a10d-96328f42c29e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1362 microversion: 2.25 time: 0.226416 Oct 10 18:53:23.919562 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 595/1042] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:23 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:23.925184 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3d9c49ef-6588-4395-8620-97419c6fc3c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:23.925918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3d9c49ef-6588-4395-8620-97419c6fc3c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:23.934114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d9c49ef-6588-4395-8620-97419c6fc3c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:23.934647 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d9c49ef-6588-4395-8620-97419c6fc3c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:23.935138 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d9c49ef-6588-4395-8620-97419c6fc3c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:23.938702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d9c49ef-6588-4395-8620-97419c6fc3c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:23.938702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d9c49ef-6588-4395-8620-97419c6fc3c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:23.938702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d9c49ef-6588-4395-8620-97419c6fc3c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:24.109504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3d9c49ef-6588-4395-8620-97419c6fc3c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:24.119133 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3d9c49ef-6588-4395-8620-97419c6fc3c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1315 microversion: 2.1 time: 0.198447 Oct 10 18:53:24.119732 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 596/1043] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:23 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:24.139745 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a1502e17-3177-4aaf-8e02-890c00d740bd tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Calling method '.version_select at 0x7f318dd97040>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:24.155735 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a1502e17-3177-4aaf-8e02-890c00d740bd tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-830952571" status: 200 len: 1533 microversion: 2.2 time: 0.028119 Oct 10 18:53:24.156880 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 597/1044] 10.222.0.43 () {60 vars in 1255 bytes} [Mon Oct 10 18:53:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-830952571 => generated 1533 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:24.162079 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ddc820d4-9f79-47f1-a168-a0ac44af3559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:24.162824 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ddc820d4-9f79-47f1-a168-a0ac44af3559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:24.170658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ddc820d4-9f79-47f1-a168-a0ac44af3559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:24.171203 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ddc820d4-9f79-47f1-a168-a0ac44af3559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:24.171640 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ddc820d4-9f79-47f1-a168-a0ac44af3559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:24.172962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ddc820d4-9f79-47f1-a168-a0ac44af3559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:24.173422 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ddc820d4-9f79-47f1-a168-a0ac44af3559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:24.173851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ddc820d4-9f79-47f1-a168-a0ac44af3559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:24.249635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ddc820d4-9f79-47f1-a168-a0ac44af3559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:24.258755 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ddc820d4-9f79-47f1-a168-a0ac44af3559 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1268 microversion: 2.1 time: 0.100641 Oct 10 18:53:24.259409 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 598/1045] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:24 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1268 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:24.276050 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7234815b-38d5-4898-99da-370663f01723 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Calling method '.version_select at 0x7f3192384c10>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:24.280367 n-d-860863-1 devstack@n-api.service[127288]: WARNING oslo_db.sqlalchemy.utils [None req-7234815b-38d5-4898-99da-370663f01723 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 10 18:53:24.288956 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7234815b-38d5-4898-99da-370663f01723 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.027633 Oct 10 18:53:24.296261 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 599/1046] 10.222.0.43 () {60 vars in 1177 bytes} [Mon Oct 10 18:53:24 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:24.302469 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-eaaf2aab-ad1c-4f7f-bdc5-b9fbefff5fa2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:24.303339 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-eaaf2aab-ad1c-4f7f-bdc5-b9fbefff5fa2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:24.310365 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eaaf2aab-ad1c-4f7f-bdc5-b9fbefff5fa2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:24.311084 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eaaf2aab-ad1c-4f7f-bdc5-b9fbefff5fa2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:24.311834 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eaaf2aab-ad1c-4f7f-bdc5-b9fbefff5fa2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:24.312855 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eaaf2aab-ad1c-4f7f-bdc5-b9fbefff5fa2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:24.313492 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eaaf2aab-ad1c-4f7f-bdc5-b9fbefff5fa2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:24.316146 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eaaf2aab-ad1c-4f7f-bdc5-b9fbefff5fa2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:24.462237 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-190c3745-fa89-492d-a61a-800d107f74e8 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "PUT /compute/v2.1/os-security-groups/bf1cd2d7-3cb9-4088-a6d7-7ba4f08d6ec0" status: 200 len: 218 microversion: 2.1 time: 0.640490 Oct 10 18:53:24.463850 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 448/1047] 10.222.0.43 () {60 vars in 1290 bytes} [Mon Oct 10 18:53:23 2022] PUT /compute/v2.1/os-security-groups/bf1cd2d7-3cb9-4088-a6d7-7ba4f08d6ec0 => generated 218 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:24.468868 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-556c2466-c4dd-4657-88d0-a4239a008da0 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] Calling method '.version_select at 0x7f318e237ee0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:24.601704 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-556c2466-c4dd-4657-88d0-a4239a008da0 tempest-KeyPairsV22TestJSON-1584326678 tempest-KeyPairsV22TestJSON-1584326678-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-830952571" status: 204 len: 0 microversion: 2.2 time: 0.136629 Oct 10 18:53:24.604209 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 449/1048] 10.222.0.43 () {60 vars in 1258 bytes} [Mon Oct 10 18:53:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-830952571 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:24.623403 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5834ea04-209c-437f-a316-b8353542658e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:24.630163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5834ea04-209c-437f-a316-b8353542658e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:24.650679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-eaaf2aab-ad1c-4f7f-bdc5-b9fbefff5fa2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:24.660130 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-eaaf2aab-ad1c-4f7f-bdc5-b9fbefff5fa2 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1478 microversion: 2.1 time: 0.361825 Oct 10 18:53:24.663115 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5834ea04-209c-437f-a316-b8353542658e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:24.663865 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5834ea04-209c-437f-a316-b8353542658e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:24.666003 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5834ea04-209c-437f-a316-b8353542658e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:24.670525 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5834ea04-209c-437f-a316-b8353542658e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:24.673993 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5834ea04-209c-437f-a316-b8353542658e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:24.673993 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5834ea04-209c-437f-a316-b8353542658e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:24.674321 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 600/1049] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:24 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1478 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:24.689520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f18ed913-fd01-4548-aa88-ca3c5d423734 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f3192384700>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:24.857128 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f18ed913-fd01-4548-aa88-ca3c5d423734 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/bf1cd2d7-3cb9-4088-a6d7-7ba4f08d6ec0" status: 200 len: 218 microversion: 2.1 time: 0.182382 Oct 10 18:53:24.876939 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 601/1050] 10.222.0.43 () {58 vars in 1269 bytes} [Mon Oct 10 18:53:24 2022] GET /compute/v2.1/os-security-groups/bf1cd2d7-3cb9-4088-a6d7-7ba4f08d6ec0 => generated 218 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:24.886569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-5b3360bd-2a36-425b-8695-7826d35210e0 req-2eb78631-0fb3-431a-a896-560b5f3a1afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06dba6c-63b1-4f22-a1b1-d8be963d59d8", "name": "network-vif-plugged", "status": "completed", "tag": "64f101a7-8976-4073-913a-cafa0149f458"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:24.898867 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5b3360bd-2a36-425b-8695-7826d35210e0 req-2eb78631-0fb3-431a-a896-560b5f3a1afd service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:24.899527 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5b3360bd-2a36-425b-8695-7826d35210e0 req-2eb78631-0fb3-431a-a896-560b5f3a1afd service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:24.900475 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5b3360bd-2a36-425b-8695-7826d35210e0 req-2eb78631-0fb3-431a-a896-560b5f3a1afd service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:24.925115 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-5b3360bd-2a36-425b-8695-7826d35210e0 req-2eb78631-0fb3-431a-a896-560b5f3a1afd service nova] Creating event network-vif-plugged:64f101a7-8976-4073-913a-cafa0149f458 for instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 on n-h1-860863-1 Oct 10 18:53:24.935505 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-5b3360bd-2a36-425b-8695-7826d35210e0 req-2eb78631-0fb3-431a-a896-560b5f3a1afd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056928 Oct 10 18:53:24.936820 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 602/1051] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:24.943780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2f80c04f-2df5-416b-820a-39b5f9c0dc0f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f3192384e50>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:25.085155 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5834ea04-209c-437f-a316-b8353542658e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:25.098506 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5834ea04-209c-437f-a316-b8353542658e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1214 microversion: 2.1 time: 0.490992 Oct 10 18:53:25.114655 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 450/1052] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:24 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1214 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:25.123608 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0c4c3004-e7f1-452f-85a4-48bbb2aa4141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:25.124221 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0c4c3004-e7f1-452f-85a4-48bbb2aa4141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:25.157415 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c4c3004-e7f1-452f-85a4-48bbb2aa4141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:25.157969 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c4c3004-e7f1-452f-85a4-48bbb2aa4141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:25.165217 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c4c3004-e7f1-452f-85a4-48bbb2aa4141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:25.166624 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c4c3004-e7f1-452f-85a4-48bbb2aa4141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:25.167108 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c4c3004-e7f1-452f-85a4-48bbb2aa4141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:25.167546 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c4c3004-e7f1-452f-85a4-48bbb2aa4141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:25.606736 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2f80c04f-2df5-416b-820a-39b5f9c0dc0f tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/bf1cd2d7-3cb9-4088-a6d7-7ba4f08d6ec0" status: 202 len: 0 microversion: 2.1 time: 0.668470 Oct 10 18:53:25.607818 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 603/1053] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:24 2022] DELETE /compute/v2.1/os-security-groups/bf1cd2d7-3cb9-4088-a6d7-7ba4f08d6ec0 => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:25.612714 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9dee1b46-252b-4a22-8462-eee79fb8fb0d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:25.613628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9dee1b46-252b-4a22-8462-eee79fb8fb0d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:25.624355 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dee1b46-252b-4a22-8462-eee79fb8fb0d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:25.628423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dee1b46-252b-4a22-8462-eee79fb8fb0d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:25.631672 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dee1b46-252b-4a22-8462-eee79fb8fb0d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:25.632697 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dee1b46-252b-4a22-8462-eee79fb8fb0d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:25.633851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dee1b46-252b-4a22-8462-eee79fb8fb0d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:25.634571 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dee1b46-252b-4a22-8462-eee79fb8fb0d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:25.836933 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0c4c3004-e7f1-452f-85a4-48bbb2aa4141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:25.848423 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0c4c3004-e7f1-452f-85a4-48bbb2aa4141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:25.855214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0c4c3004-e7f1-452f-85a4-48bbb2aa4141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:25.856906 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0c4c3004-e7f1-452f-85a4-48bbb2aa4141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1362 microversion: 2.25 time: 0.741038 Oct 10 18:53:25.858590 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 451/1054] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:25 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1362 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:25.870040 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8748a5d5-ac11-4537-8683-81943d817e70 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:25.870853 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8748a5d5-ac11-4537-8683-81943d817e70 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:25.891162 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8748a5d5-ac11-4537-8683-81943d817e70 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:25.891931 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8748a5d5-ac11-4537-8683-81943d817e70 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:25.892368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8748a5d5-ac11-4537-8683-81943d817e70 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:25.902854 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8748a5d5-ac11-4537-8683-81943d817e70 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:25.904664 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8748a5d5-ac11-4537-8683-81943d817e70 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:25.906346 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8748a5d5-ac11-4537-8683-81943d817e70 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:26.047199 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8748a5d5-ac11-4537-8683-81943d817e70 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:26.061837 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8748a5d5-ac11-4537-8683-81943d817e70 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1274 microversion: 2.1 time: 0.200906 Oct 10 18:53:26.072886 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 452/1055] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:25 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:26.077936 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-22bc309b-a662-4acf-9f57-323bb577a643 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:26.078668 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-22bc309b-a662-4acf-9f57-323bb577a643 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:26.088646 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22bc309b-a662-4acf-9f57-323bb577a643 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:26.089426 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9dee1b46-252b-4a22-8462-eee79fb8fb0d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:26.091283 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22bc309b-a662-4acf-9f57-323bb577a643 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:26.091283 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22bc309b-a662-4acf-9f57-323bb577a643 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:26.091988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22bc309b-a662-4acf-9f57-323bb577a643 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:26.092736 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22bc309b-a662-4acf-9f57-323bb577a643 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:26.093578 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22bc309b-a662-4acf-9f57-323bb577a643 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:26.097120 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9dee1b46-252b-4a22-8462-eee79fb8fb0d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1315 microversion: 2.1 time: 0.488055 Oct 10 18:53:26.097703 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 604/1056] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:25 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:26.102207 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ddb498c6-7dc3-423f-a11c-2c788186e344 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:26.102809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ddb498c6-7dc3-423f-a11c-2c788186e344 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:26.115680 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-22bc309b-a662-4acf-9f57-323bb577a643 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-22bc309b-a662-4acf-9f57-323bb577a643 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 HTTP/1.1 Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'cf1beef1-3d9a-4af8-ac68-048748261c19'} Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:53:26.118542 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:53:26.124418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:26.124418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.124418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.124418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.124418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.124418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.124418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.124418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:26.124418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:26.124418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:26.124418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.125274 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ddb498c6-7dc3-423f-a11c-2c788186e344 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:26.125385 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-22bc309b-a662-4acf-9f57-323bb577a643 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 404 to user: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:26.125481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ddb498c6-7dc3-423f-a11c-2c788186e344 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:26.125481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ddb498c6-7dc3-423f-a11c-2c788186e344 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:26.125481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ddb498c6-7dc3-423f-a11c-2c788186e344 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:26.125481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ddb498c6-7dc3-423f-a11c-2c788186e344 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:26.125822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ddb498c6-7dc3-423f-a11c-2c788186e344 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:26.126994 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-22bc309b-a662-4acf-9f57-323bb577a643 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 404 len: 111 microversion: 2.1 time: 0.053042 Oct 10 18:53:26.130755 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 453/1057] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:53:26 2022] DELETE /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:53:26.138473 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-be6e4e70-7458-4b3e-bcb9-fd1369bb791b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:26.139697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-be6e4e70-7458-4b3e-bcb9-fd1369bb791b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: cf1beef1-3d9a-4af8-ac68-048748261c19] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:26.146331 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be6e4e70-7458-4b3e-bcb9-fd1369bb791b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:26.147566 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be6e4e70-7458-4b3e-bcb9-fd1369bb791b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:26.148096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be6e4e70-7458-4b3e-bcb9-fd1369bb791b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:26.149061 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be6e4e70-7458-4b3e-bcb9-fd1369bb791b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:26.149765 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be6e4e70-7458-4b3e-bcb9-fd1369bb791b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:26.152321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be6e4e70-7458-4b3e-bcb9-fd1369bb791b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:26.172976 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-be6e4e70-7458-4b3e-bcb9-fd1369bb791b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-be6e4e70-7458-4b3e-bcb9-fd1369bb791b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 HTTP/1.1 Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'cf1beef1-3d9a-4af8-ac68-048748261c19'} Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.175278 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.182975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.182975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.182975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.182975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:26.182975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:26.182975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. Oct 10 18:53:26.182975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.182975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-be6e4e70-7458-4b3e-bcb9-fd1369bb791b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 404 to user: Instance cf1beef1-3d9a-4af8-ac68-048748261c19 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:26.185954 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-be6e4e70-7458-4b3e-bcb9-fd1369bb791b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19" status: 404 len: 111 microversion: 2.1 time: 0.050962 Oct 10 18:53:26.186748 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 454/1058] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:26 2022] GET /compute/v2.1/servers/cf1beef1-3d9a-4af8-ac68-048748261c19 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:53:26.202292 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-23752c8b-ebe5-4475-98a7-6ddb39b5396a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:26.205294 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-23752c8b-ebe5-4475-98a7-6ddb39b5396a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:26.213808 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23752c8b-ebe5-4475-98a7-6ddb39b5396a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:26.214686 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23752c8b-ebe5-4475-98a7-6ddb39b5396a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:26.215396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23752c8b-ebe5-4475-98a7-6ddb39b5396a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:26.217129 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23752c8b-ebe5-4475-98a7-6ddb39b5396a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:26.217931 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23752c8b-ebe5-4475-98a7-6ddb39b5396a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:26.218619 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23752c8b-ebe5-4475-98a7-6ddb39b5396a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:26.336780 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-23752c8b-ebe5-4475-98a7-6ddb39b5396a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:26.347388 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-23752c8b-ebe5-4475-98a7-6ddb39b5396a tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1270 microversion: 2.1 time: 0.154178 Oct 10 18:53:26.347991 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 455/1059] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:26 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:26.360750 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-03837efd-c843-48c7-b0db-03f67a94db6c tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318de4e940>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:26.416982 n-d-860863-1 devstack@n-api.service[127289]: DEBUG neutronclient.v2_0.client [None req-03837efd-c843-48c7-b0db-03f67a94db6c tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 does not exist", "detail": ""}} {{(pid=127289) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:53:26.420777 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.security_group_api [None req-03837efd-c843-48c7-b0db-03f67a94db6c tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Neutron security group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 not found {{(pid=127289) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:53:26.423435 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-03837efd-c843-48c7-b0db-03f67a94db6c tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Security group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 does not exist Oct 10 18:53:26.423435 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-6af680c8-b732-40f9-9ad4-61a9deaa9a23'] Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-03837efd-c843-48c7-b0db-03f67a94db6c tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/os-security-groups/2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 HTTP/1.1 Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: exception: Security group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 does not exist Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-6af680c8-b732-40f9-9ad4-61a9deaa9a23'] Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '2b3fd4ec-9f5d-45b8-ab70-702fa0280d18'} Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:53:26.430832 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 does not exist Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6af680c8-b732-40f9-9ad4-61a9deaa9a23'] Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 does not exist Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6af680c8-b732-40f9-9ad4-61a9deaa9a23'] Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 does not exist Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6af680c8-b732-40f9-9ad4-61a9deaa9a23'] Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 does not exist Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6af680c8-b732-40f9-9ad4-61a9deaa9a23'] Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-03837efd-c843-48c7-b0db-03f67a94db6c tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 404 to user: Security group 2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 does not exist Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-6af680c8-b732-40f9-9ad4-61a9deaa9a23'] {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-03837efd-c843-48c7-b0db-03f67a94db6c tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/2b3fd4ec-9f5d-45b8-ab70-702fa0280d18" status: 404 len: 194 microversion: 2.1 time: 0.084178 Oct 10 18:53:26.439232 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 456/1060] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:26 2022] DELETE /compute/v2.1/os-security-groups/2b3fd4ec-9f5d-45b8-ab70-702fa0280d18 => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:53:26.448677 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4212e6ae-d50d-4c04-815c-6e1cf1d71b5b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318de4fe50>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:26.477596 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ddb498c6-7dc3-423f-a11c-2c788186e344 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:26.490117 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ddb498c6-7dc3-423f-a11c-2c788186e344 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1478 microversion: 2.1 time: 0.391380 Oct 10 18:53:26.500023 n-d-860863-1 devstack@n-api.service[127289]: DEBUG neutronclient.v2_0.client [None req-4212e6ae-d50d-4c04-815c-6e1cf1d71b5b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 does not exist", "detail": ""}} {{(pid=127289) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:53:26.500644 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.security_group_api [None req-4212e6ae-d50d-4c04-815c-6e1cf1d71b5b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Neutron security group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 not found {{(pid=127289) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:53:26.501225 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-4212e6ae-d50d-4c04-815c-6e1cf1d71b5b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Security group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 does not exist Oct 10 18:53:26.501225 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-00666ab9-3978-4ce0-9f8b-8bd3643859db'] Oct 10 18:53:26.502234 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 605/1061] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:26 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1478 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4212e6ae-d50d-4c04-815c-6e1cf1d71b5b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/os-security-groups/cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 HTTP/1.1 Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: exception: Security group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 does not exist Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-00666ab9-3978-4ce0-9f8b-8bd3643859db'] Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58'} Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:53:26.503699 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 does not exist Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00666ab9-3978-4ce0-9f8b-8bd3643859db'] Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 does not exist Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00666ab9-3978-4ce0-9f8b-8bd3643859db'] Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 does not exist Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00666ab9-3978-4ce0-9f8b-8bd3643859db'] Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 does not exist Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00666ab9-3978-4ce0-9f8b-8bd3643859db'] Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4212e6ae-d50d-4c04-815c-6e1cf1d71b5b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 404 to user: Security group cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 does not exist Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-00666ab9-3978-4ce0-9f8b-8bd3643859db'] {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:26.508872 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4212e6ae-d50d-4c04-815c-6e1cf1d71b5b tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58" status: 404 len: 194 microversion: 2.1 time: 0.061511 Oct 10 18:53:26.512390 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 457/1062] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:26 2022] DELETE /compute/v2.1/os-security-groups/cfb234f9-c8a8-4d1c-9d22-a1f4e5474f58 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:53:26.523897 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-eaff24ce-0706-4b2e-9ded-31154068ecca tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f3192384430>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:26.554339 n-d-860863-1 devstack@n-api.service[127288]: DEBUG neutronclient.v2_0.client [None req-eaff24ce-0706-4b2e-9ded-31154068ecca tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist", "detail": ""}} {{(pid=127288) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:53:26.554944 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.security_group_api [None req-eaff24ce-0706-4b2e-9ded-31154068ecca tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Neutron security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 not found {{(pid=127288) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:53:26.555460 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-eaff24ce-0706-4b2e-9ded-31154068ecca tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist Oct 10 18:53:26.555460 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-a5bf1b69-4185-4ae9-8f68-cd1c555db763'] Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-eaff24ce-0706-4b2e-9ded-31154068ecca tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/os-security-groups/4b2e3aa5-8580-453f-a3c0-806900b2dd11 HTTP/1.1 Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: exception: Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-a5bf1b69-4185-4ae9-8f68-cd1c555db763'] Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '4b2e3aa5-8580-453f-a3c0-806900b2dd11'} Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:53:26.558969 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5bf1b69-4185-4ae9-8f68-cd1c555db763'] Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5bf1b69-4185-4ae9-8f68-cd1c555db763'] Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5bf1b69-4185-4ae9-8f68-cd1c555db763'] Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5bf1b69-4185-4ae9-8f68-cd1c555db763'] Oct 10 18:53:26.563884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.570695 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-eaff24ce-0706-4b2e-9ded-31154068ecca tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 404 to user: Security group 4b2e3aa5-8580-453f-a3c0-806900b2dd11 does not exist Oct 10 18:53:26.570695 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-a5bf1b69-4185-4ae9-8f68-cd1c555db763'] {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:26.571833 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-eaff24ce-0706-4b2e-9ded-31154068ecca tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/4b2e3aa5-8580-453f-a3c0-806900b2dd11" status: 404 len: 194 microversion: 2.1 time: 0.060330 Oct 10 18:53:26.576059 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 606/1063] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:26 2022] DELETE /compute/v2.1/os-security-groups/4b2e3aa5-8580-453f-a3c0-806900b2dd11 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:53:26.581238 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-15c3e7d1-851e-4928-b3ce-eaa0ff4d6f38 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318de4e820>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:26.658810 n-d-860863-1 devstack@n-api.service[127289]: DEBUG neutronclient.v2_0.client [None req-15c3e7d1-851e-4928-b3ce-eaa0ff4d6f38 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist", "detail": ""}} {{(pid=127289) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:53:26.660308 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.security_group_api [None req-15c3e7d1-851e-4928-b3ce-eaa0ff4d6f38 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Neutron security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a not found {{(pid=127289) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:53:26.663475 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-15c3e7d1-851e-4928-b3ce-eaa0ff4d6f38 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist Oct 10 18:53:26.663475 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-761bcd44-8bd3-4b4f-9e9c-c5bf1b436bf5'] Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-15c3e7d1-851e-4928-b3ce-eaa0ff4d6f38 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/os-security-groups/630e2d17-25c5-4982-ab5c-ef81dd82e65a HTTP/1.1 Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: exception: Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-761bcd44-8bd3-4b4f-9e9c-c5bf1b436bf5'] Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '630e2d17-25c5-4982-ab5c-ef81dd82e65a'} Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:53:26.667453 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-761bcd44-8bd3-4b4f-9e9c-c5bf1b436bf5'] Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-761bcd44-8bd3-4b4f-9e9c-c5bf1b436bf5'] Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-761bcd44-8bd3-4b4f-9e9c-c5bf1b436bf5'] Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-761bcd44-8bd3-4b4f-9e9c-c5bf1b436bf5'] Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-15c3e7d1-851e-4928-b3ce-eaa0ff4d6f38 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 404 to user: Security group 630e2d17-25c5-4982-ab5c-ef81dd82e65a does not exist Oct 10 18:53:26.674553 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-761bcd44-8bd3-4b4f-9e9c-c5bf1b436bf5'] {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:26.678952 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-15c3e7d1-851e-4928-b3ce-eaa0ff4d6f38 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/630e2d17-25c5-4982-ab5c-ef81dd82e65a" status: 404 len: 194 microversion: 2.1 time: 0.093182 Oct 10 18:53:26.679311 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 458/1064] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:26 2022] DELETE /compute/v2.1/os-security-groups/630e2d17-25c5-4982-ab5c-ef81dd82e65a => generated 194 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:53:26.688572 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d8d194da-7585-4383-abe4-6af9167b0f92 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318df77f70>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:26.730031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG neutronclient.v2_0.client [None req-d8d194da-7585-4383-abe4-6af9167b0f92 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist", "detail": ""}} {{(pid=127288) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:53:26.731032 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.security_group_api [None req-d8d194da-7585-4383-abe4-6af9167b0f92 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Neutron security group 8c05b064-8143-4e71-b66a-a28b12a746ce not found {{(pid=127288) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:53:26.732968 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-d8d194da-7585-4383-abe4-6af9167b0f92 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist Oct 10 18:53:26.732968 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-7288e7c4-e69c-456a-89fa-e740909244e9'] Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d8d194da-7585-4383-abe4-6af9167b0f92 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/os-security-groups/8c05b064-8143-4e71-b66a-a28b12a746ce HTTP/1.1 Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: exception: Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-7288e7c4-e69c-456a-89fa-e740909244e9'] Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '8c05b064-8143-4e71-b66a-a28b12a746ce'} Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:53:26.735315 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7288e7c4-e69c-456a-89fa-e740909244e9'] Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7288e7c4-e69c-456a-89fa-e740909244e9'] Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7288e7c4-e69c-456a-89fa-e740909244e9'] Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7288e7c4-e69c-456a-89fa-e740909244e9'] Oct 10 18:53:26.739768 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.760006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d8d194da-7585-4383-abe4-6af9167b0f92 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 404 to user: Security group 8c05b064-8143-4e71-b66a-a28b12a746ce does not exist Oct 10 18:53:26.760006 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-7288e7c4-e69c-456a-89fa-e740909244e9'] {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:26.763254 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d8d194da-7585-4383-abe4-6af9167b0f92 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/8c05b064-8143-4e71-b66a-a28b12a746ce" status: 404 len: 194 microversion: 2.1 time: 0.079834 Oct 10 18:53:26.766162 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 607/1065] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:26 2022] DELETE /compute/v2.1/os-security-groups/8c05b064-8143-4e71-b66a-a28b12a746ce => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:53:26.773922 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ee67e404-217f-4f6a-af6b-2d3d5bb312f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318ddeedc0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:26.848667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG neutronclient.v2_0.client [None req-ee67e404-217f-4f6a-af6b-2d3d5bb312f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist", "detail": ""}} {{(pid=127289) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:53:26.850076 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.security_group_api [None req-ee67e404-217f-4f6a-af6b-2d3d5bb312f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Neutron security group 0b702303-0b59-4872-9d04-3c7865319289 not found {{(pid=127289) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:53:26.850732 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-ee67e404-217f-4f6a-af6b-2d3d5bb312f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist Oct 10 18:53:26.850732 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-adaf4caa-1ddd-4f06-bf5f-427479574021'] Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ee67e404-217f-4f6a-af6b-2d3d5bb312f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/os-security-groups/0b702303-0b59-4872-9d04-3c7865319289 HTTP/1.1 Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: exception: Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-adaf4caa-1ddd-4f06-bf5f-427479574021'] Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '0b702303-0b59-4872-9d04-3c7865319289'} Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:53:26.854229 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adaf4caa-1ddd-4f06-bf5f-427479574021'] Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adaf4caa-1ddd-4f06-bf5f-427479574021'] Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adaf4caa-1ddd-4f06-bf5f-427479574021'] Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adaf4caa-1ddd-4f06-bf5f-427479574021'] Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ee67e404-217f-4f6a-af6b-2d3d5bb312f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 404 to user: Security group 0b702303-0b59-4872-9d04-3c7865319289 does not exist Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-adaf4caa-1ddd-4f06-bf5f-427479574021'] {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ee67e404-217f-4f6a-af6b-2d3d5bb312f0 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/0b702303-0b59-4872-9d04-3c7865319289" status: 404 len: 194 microversion: 2.1 time: 0.086994 Oct 10 18:53:26.864592 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 459/1066] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:26 2022] DELETE /compute/v2.1/os-security-groups/0b702303-0b59-4872-9d04-3c7865319289 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:53:26.871676 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2a0d1f56-6f26-4eab-a94f-66d028817832 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:26.872262 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2a0d1f56-6f26-4eab-a94f-66d028817832 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:26.888858 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-85b6c3ce-a1f8-40f1-a16d-6e56da2941d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:26.889661 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-85b6c3ce-a1f8-40f1-a16d-6e56da2941d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:26.897458 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a0d1f56-6f26-4eab-a94f-66d028817832 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:26.899083 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a0d1f56-6f26-4eab-a94f-66d028817832 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:26.902929 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a0d1f56-6f26-4eab-a94f-66d028817832 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:26.904943 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85b6c3ce-a1f8-40f1-a16d-6e56da2941d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:26.908370 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85b6c3ce-a1f8-40f1-a16d-6e56da2941d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:26.908941 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85b6c3ce-a1f8-40f1-a16d-6e56da2941d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:26.909476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a0d1f56-6f26-4eab-a94f-66d028817832 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:26.909883 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85b6c3ce-a1f8-40f1-a16d-6e56da2941d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:26.910001 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a0d1f56-6f26-4eab-a94f-66d028817832 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:26.910396 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a0d1f56-6f26-4eab-a94f-66d028817832 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:26.910512 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85b6c3ce-a1f8-40f1-a16d-6e56da2941d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:26.913374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85b6c3ce-a1f8-40f1-a16d-6e56da2941d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:26.958367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2a0d1f56-6f26-4eab-a94f-66d028817832 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:53:26.965663 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:27.203637 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:27.302261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-85b6c3ce-a1f8-40f1-a16d-6e56da2941d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:27.316848 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-85b6c3ce-a1f8-40f1-a16d-6e56da2941d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:27.318315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-85b6c3ce-a1f8-40f1-a16d-6e56da2941d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:27.319662 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-85b6c3ce-a1f8-40f1-a16d-6e56da2941d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1362 microversion: 2.25 time: 0.438087 Oct 10 18:53:27.340909 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 460/1067] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:26 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:27.345804 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a03f332a-d374-4bf5-b2cb-18ef0581209b tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:27.346422 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a03f332a-d374-4bf5-b2cb-18ef0581209b tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:27.369406 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a03f332a-d374-4bf5-b2cb-18ef0581209b tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:27.369905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a03f332a-d374-4bf5-b2cb-18ef0581209b tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:27.370395 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a03f332a-d374-4bf5-b2cb-18ef0581209b tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:27.371166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a03f332a-d374-4bf5-b2cb-18ef0581209b tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:27.371613 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a03f332a-d374-4bf5-b2cb-18ef0581209b tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:27.372039 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a03f332a-d374-4bf5-b2cb-18ef0581209b tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:27.402146 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2a0d1f56-6f26-4eab-a94f-66d028817832 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 204 len: 0 microversion: 2.1 time: 0.538545 Oct 10 18:53:27.403170 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 608/1068] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:53:26 2022] DELETE /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:27.410497 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5e2eb075-49bb-457c-ad42-45d6431f476e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:27.416709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5e2eb075-49bb-457c-ad42-45d6431f476e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:27.452469 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5e2eb075-49bb-457c-ad42-45d6431f476e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:27.453033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5e2eb075-49bb-457c-ad42-45d6431f476e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:27.458924 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5e2eb075-49bb-457c-ad42-45d6431f476e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:27.461005 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5e2eb075-49bb-457c-ad42-45d6431f476e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:27.461982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5e2eb075-49bb-457c-ad42-45d6431f476e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:27.462801 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5e2eb075-49bb-457c-ad42-45d6431f476e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:27.676765 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a03f332a-d374-4bf5-b2cb-18ef0581209b tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:27.685364 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a03f332a-d374-4bf5-b2cb-18ef0581209b tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1316 microversion: 2.1 time: 0.343291 Oct 10 18:53:27.685963 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 461/1069] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:27 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:27.717455 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e2e756f2-5df8-41c6-a5dd-265c6d66bd00 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:27.718070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e2e756f2-5df8-41c6-a5dd-265c6d66bd00 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:27.738112 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2e756f2-5df8-41c6-a5dd-265c6d66bd00 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:27.738602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2e756f2-5df8-41c6-a5dd-265c6d66bd00 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:27.739041 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2e756f2-5df8-41c6-a5dd-265c6d66bd00 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:27.739757 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2e756f2-5df8-41c6-a5dd-265c6d66bd00 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:27.740210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2e756f2-5df8-41c6-a5dd-265c6d66bd00 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:27.740657 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2e756f2-5df8-41c6-a5dd-265c6d66bd00 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:28.149583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e2e756f2-5df8-41c6-a5dd-265c6d66bd00 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:28.158497 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e2e756f2-5df8-41c6-a5dd-265c6d66bd00 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1288 microversion: 2.1 time: 0.444789 Oct 10 18:53:28.169049 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 462/1070] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:27 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1288 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:28.181958 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bc5ce768-1127-40af-a0dd-57c7621bd0bb tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:28.182904 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bc5ce768-1127-40af-a0dd-57c7621bd0bb tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:28.201118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc5ce768-1127-40af-a0dd-57c7621bd0bb tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:28.204075 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc5ce768-1127-40af-a0dd-57c7621bd0bb tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:28.204744 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc5ce768-1127-40af-a0dd-57c7621bd0bb tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:28.205973 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc5ce768-1127-40af-a0dd-57c7621bd0bb tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:28.210702 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc5ce768-1127-40af-a0dd-57c7621bd0bb tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:28.211265 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc5ce768-1127-40af-a0dd-57c7621bd0bb tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:28.217946 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5e2eb075-49bb-457c-ad42-45d6431f476e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:28.234553 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5e2eb075-49bb-457c-ad42-45d6431f476e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1315 microversion: 2.1 time: 0.829135 Oct 10 18:53:28.236899 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 609/1071] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:27 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:28.251532 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-689c4fce-6a7a-46a3-a69b-a291cd16dbab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:28.252527 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-689c4fce-6a7a-46a3-a69b-a291cd16dbab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:28.265383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-689c4fce-6a7a-46a3-a69b-a291cd16dbab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:28.267231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-689c4fce-6a7a-46a3-a69b-a291cd16dbab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:28.268804 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-689c4fce-6a7a-46a3-a69b-a291cd16dbab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:28.272852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-689c4fce-6a7a-46a3-a69b-a291cd16dbab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:28.274998 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-689c4fce-6a7a-46a3-a69b-a291cd16dbab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:28.279153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-689c4fce-6a7a-46a3-a69b-a291cd16dbab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:28.626766 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bc5ce768-1127-40af-a0dd-57c7621bd0bb tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:28.643115 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bc5ce768-1127-40af-a0dd-57c7621bd0bb tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1647 microversion: 2.1 time: 0.466722 Oct 10 18:53:28.644485 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 463/1072] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:28 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1647 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:28.663404 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-fb7ba51e-a2ac-44ad-8e14-9634e7aea4e9 req-3a8d202e-fc66-45f6-96ef-21ae644fcc91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3624eba-30d5-486c-8753-86e4277189ff", "name": "network-vif-plugged", "status": "completed", "tag": "877788c4-8817-4a16-9c01-e7dd796eebdd"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:28.686237 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-689c4fce-6a7a-46a3-a69b-a291cd16dbab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:28.698192 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-689c4fce-6a7a-46a3-a69b-a291cd16dbab tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1478 microversion: 2.1 time: 0.457122 Oct 10 18:53:28.699438 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 610/1073] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:28 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1478 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:28.699966 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-fb7ba51e-a2ac-44ad-8e14-9634e7aea4e9 req-3a8d202e-fc66-45f6-96ef-21ae644fcc91 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:28.700656 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-fb7ba51e-a2ac-44ad-8e14-9634e7aea4e9 req-3a8d202e-fc66-45f6-96ef-21ae644fcc91 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:28.701711 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-fb7ba51e-a2ac-44ad-8e14-9634e7aea4e9 req-3a8d202e-fc66-45f6-96ef-21ae644fcc91 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:28.705750 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b52b86b8-e74b-4fc7-8cbc-a57e4303ec11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:28.707704 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b52b86b8-e74b-4fc7-8cbc-a57e4303ec11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:28.723944 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b52b86b8-e74b-4fc7-8cbc-a57e4303ec11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:28.723944 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b52b86b8-e74b-4fc7-8cbc-a57e4303ec11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:28.723944 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b52b86b8-e74b-4fc7-8cbc-a57e4303ec11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:28.723944 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b52b86b8-e74b-4fc7-8cbc-a57e4303ec11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:28.723944 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b52b86b8-e74b-4fc7-8cbc-a57e4303ec11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:28.723944 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b52b86b8-e74b-4fc7-8cbc-a57e4303ec11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:28.726615 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-fb7ba51e-a2ac-44ad-8e14-9634e7aea4e9 req-3a8d202e-fc66-45f6-96ef-21ae644fcc91 service nova] Creating event network-vif-plugged:877788c4-8817-4a16-9c01-e7dd796eebdd for instance d3624eba-30d5-486c-8753-86e4277189ff on n-h1-860863-1 Oct 10 18:53:28.732931 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-fb7ba51e-a2ac-44ad-8e14-9634e7aea4e9 req-3a8d202e-fc66-45f6-96ef-21ae644fcc91 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086215 Oct 10 18:53:28.736830 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 464/1074] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:28.745497 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9b41c606-ca8c-4b68-ae3a-b29fd3bc4474 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:28.745832 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9b41c606-ca8c-4b68-ae3a-b29fd3bc4474 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:28.753593 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9b41c606-ca8c-4b68-ae3a-b29fd3bc4474 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:28.754087 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9b41c606-ca8c-4b68-ae3a-b29fd3bc4474 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:28.754523 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9b41c606-ca8c-4b68-ae3a-b29fd3bc4474 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:28.755286 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9b41c606-ca8c-4b68-ae3a-b29fd3bc4474 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:28.755745 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9b41c606-ca8c-4b68-ae3a-b29fd3bc4474 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:28.756169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9b41c606-ca8c-4b68-ae3a-b29fd3bc4474 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:28.962269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b52b86b8-e74b-4fc7-8cbc-a57e4303ec11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:28.972641 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b52b86b8-e74b-4fc7-8cbc-a57e4303ec11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:28.974648 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b52b86b8-e74b-4fc7-8cbc-a57e4303ec11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:28.976454 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b52b86b8-e74b-4fc7-8cbc-a57e4303ec11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1362 microversion: 2.25 time: 0.275635 Oct 10 18:53:28.984525 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 611/1075] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:28 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:29.054604 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-3a7ceece-8d24-4b1b-ba71-381fc5741c5a req-429da594-f7f7-4265-ae26-63b4468978c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5", "tag": "c849a4db-bdc3-4389-af5c-2c1c543bc002"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:29.064864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-3a7ceece-8d24-4b1b-ba71-381fc5741c5a req-429da594-f7f7-4265-ae26-63b4468978c1 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:29.065826 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-3a7ceece-8d24-4b1b-ba71-381fc5741c5a req-429da594-f7f7-4265-ae26-63b4468978c1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:29.070840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-3a7ceece-8d24-4b1b-ba71-381fc5741c5a req-429da594-f7f7-4265-ae26-63b4468978c1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:29.078641 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-3a7ceece-8d24-4b1b-ba71-381fc5741c5a req-429da594-f7f7-4265-ae26-63b4468978c1 service nova] Creating event network-changed:c849a4db-bdc3-4389-af5c-2c1c543bc002 for instance 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 on n-h1-860863-1 Oct 10 18:53:29.083752 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-3a7ceece-8d24-4b1b-ba71-381fc5741c5a req-429da594-f7f7-4265-ae26-63b4468978c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032751 Oct 10 18:53:29.084716 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 612/1076] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:29.214504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d63f0fc0-c3b5-407d-94c9-e591692d4952 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:29.215553 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d63f0fc0-c3b5-407d-94c9-e591692d4952 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:29.218774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9b41c606-ca8c-4b68-ae3a-b29fd3bc4474 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:29.224503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d63f0fc0-c3b5-407d-94c9-e591692d4952 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:29.227521 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d63f0fc0-c3b5-407d-94c9-e591692d4952 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:29.227521 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d63f0fc0-c3b5-407d-94c9-e591692d4952 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:29.227521 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d63f0fc0-c3b5-407d-94c9-e591692d4952 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:29.228856 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9b41c606-ca8c-4b68-ae3a-b29fd3bc4474 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1316 microversion: 2.1 time: 0.488744 Oct 10 18:53:29.229383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d63f0fc0-c3b5-407d-94c9-e591692d4952 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:29.229512 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 465/1077] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:28 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:29.230147 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d63f0fc0-c3b5-407d-94c9-e591692d4952 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:29.263592 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-663eae1e-3c7f-4339-9e55-971d97922949 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:29.264204 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-663eae1e-3c7f-4339-9e55-971d97922949 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:29.273496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-663eae1e-3c7f-4339-9e55-971d97922949 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:29.274273 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-663eae1e-3c7f-4339-9e55-971d97922949 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:29.275332 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-663eae1e-3c7f-4339-9e55-971d97922949 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:29.276374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-663eae1e-3c7f-4339-9e55-971d97922949 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:29.277315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-663eae1e-3c7f-4339-9e55-971d97922949 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:29.277971 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-663eae1e-3c7f-4339-9e55-971d97922949 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:29.384801 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d63f0fc0-c3b5-407d-94c9-e591692d4952 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:29.403434 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d63f0fc0-c3b5-407d-94c9-e591692d4952 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1276 microversion: 2.1 time: 0.201268 Oct 10 18:53:29.404302 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 613/1078] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:29 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1276 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:29.668008 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a60c760f-7f61-47ca-a266-76ddb67fad78 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:29.669956 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a60c760f-7f61-47ca-a266-76ddb67fad78 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:29.684047 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a60c760f-7f61-47ca-a266-76ddb67fad78 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:29.685492 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a60c760f-7f61-47ca-a266-76ddb67fad78 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:29.686128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a60c760f-7f61-47ca-a266-76ddb67fad78 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:29.686851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a60c760f-7f61-47ca-a266-76ddb67fad78 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:29.687302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a60c760f-7f61-47ca-a266-76ddb67fad78 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:29.687861 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a60c760f-7f61-47ca-a266-76ddb67fad78 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:29.786402 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-663eae1e-3c7f-4339-9e55-971d97922949 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:29.797332 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-663eae1e-3c7f-4339-9e55-971d97922949 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1503 microversion: 2.1 time: 0.538313 Oct 10 18:53:29.798104 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 466/1079] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:29 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1503 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:53:29.822345 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-63253a04-fa44-4375-8266-a859e8fadffc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:29.826544 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-63253a04-fa44-4375-8266-a859e8fadffc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:29.831505 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:29.833029 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63253a04-fa44-4375-8266-a859e8fadffc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:29.834329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63253a04-fa44-4375-8266-a859e8fadffc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:29.835645 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63253a04-fa44-4375-8266-a859e8fadffc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:29.837156 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63253a04-fa44-4375-8266-a859e8fadffc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:29.838682 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63253a04-fa44-4375-8266-a859e8fadffc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:29.839340 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63253a04-fa44-4375-8266-a859e8fadffc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:30.082089 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a60c760f-7f61-47ca-a266-76ddb67fad78 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:30.119076 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a60c760f-7f61-47ca-a266-76ddb67fad78 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1647 microversion: 2.1 time: 0.455380 Oct 10 18:53:30.120954 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 614/1080] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:29 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1647 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:53:30.138833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4a3236ed-2237-42a1-ab2b-453ae6a33a76 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:30.139526 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4a3236ed-2237-42a1-ab2b-453ae6a33a76 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:30.161597 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a3236ed-2237-42a1-ab2b-453ae6a33a76 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:30.162484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a3236ed-2237-42a1-ab2b-453ae6a33a76 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:30.163096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a3236ed-2237-42a1-ab2b-453ae6a33a76 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:30.163999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a3236ed-2237-42a1-ab2b-453ae6a33a76 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:30.164661 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a3236ed-2237-42a1-ab2b-453ae6a33a76 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:30.165559 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4a3236ed-2237-42a1-ab2b-453ae6a33a76 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:30.204586 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4a3236ed-2237-42a1-ab2b-453ae6a33a76 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:53:30.287625 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-63253a04-fa44-4375-8266-a859e8fadffc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:30.298861 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-63253a04-fa44-4375-8266-a859e8fadffc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1478 microversion: 2.1 time: 0.481353 Oct 10 18:53:30.299466 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 467/1081] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:29 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1478 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:30.322052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-00e3ccf9-8af6-400e-936c-4fd4e9f72dc9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:30.323740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-00e3ccf9-8af6-400e-936c-4fd4e9f72dc9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:30.330225 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-00e3ccf9-8af6-400e-936c-4fd4e9f72dc9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:30.331053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-00e3ccf9-8af6-400e-936c-4fd4e9f72dc9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:30.331716 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-00e3ccf9-8af6-400e-936c-4fd4e9f72dc9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:30.332713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-00e3ccf9-8af6-400e-936c-4fd4e9f72dc9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:30.333400 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-00e3ccf9-8af6-400e-936c-4fd4e9f72dc9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:30.334057 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-00e3ccf9-8af6-400e-936c-4fd4e9f72dc9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:30.599135 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4a3236ed-2237-42a1-ab2b-453ae6a33a76 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 204 len: 0 microversion: 2.1 time: 0.472622 Oct 10 18:53:30.599135 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 615/1082] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:53:30 2022] DELETE /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:30.604620 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-075f4c6e-3407-490d-829f-51e363a0163d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:30.605325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-075f4c6e-3407-490d-829f-51e363a0163d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:30.623313 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-075f4c6e-3407-490d-829f-51e363a0163d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:30.623809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-075f4c6e-3407-490d-829f-51e363a0163d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:30.624247 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-075f4c6e-3407-490d-829f-51e363a0163d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:30.624990 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-075f4c6e-3407-490d-829f-51e363a0163d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:30.625641 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-075f4c6e-3407-490d-829f-51e363a0163d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:30.626071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-075f4c6e-3407-490d-829f-51e363a0163d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:30.987384 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-075f4c6e-3407-490d-829f-51e363a0163d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:31.002668 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-075f4c6e-3407-490d-829f-51e363a0163d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1316 microversion: 2.1 time: 0.401181 Oct 10 18:53:31.005393 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 616/1083] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:30 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:31.020476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-16a2cab8-d629-4482-8106-0aa460e45978 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:31.021417 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-16a2cab8-d629-4482-8106-0aa460e45978 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:31.031046 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16a2cab8-d629-4482-8106-0aa460e45978 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:31.033917 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16a2cab8-d629-4482-8106-0aa460e45978 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:31.034586 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16a2cab8-d629-4482-8106-0aa460e45978 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:31.035555 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16a2cab8-d629-4482-8106-0aa460e45978 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:31.036164 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16a2cab8-d629-4482-8106-0aa460e45978 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:31.036855 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-16a2cab8-d629-4482-8106-0aa460e45978 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:31.217335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-00e3ccf9-8af6-400e-936c-4fd4e9f72dc9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:31.229669 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-00e3ccf9-8af6-400e-936c-4fd4e9f72dc9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:31.231794 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-00e3ccf9-8af6-400e-936c-4fd4e9f72dc9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:31.233601 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-00e3ccf9-8af6-400e-936c-4fd4e9f72dc9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1362 microversion: 2.25 time: 0.919317 Oct 10 18:53:31.234346 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 468/1084] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:30 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1362 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:31.241269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b3ae0e3a-ddee-439c-96e1-27c7c620cdfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:31.242950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b3ae0e3a-ddee-439c-96e1-27c7c620cdfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:31.247302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-16a2cab8-d629-4482-8106-0aa460e45978 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:31.255736 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-16a2cab8-d629-4482-8106-0aa460e45978 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1318 microversion: 2.1 time: 0.249023 Oct 10 18:53:31.266622 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 617/1085] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:31 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:31.270349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3ae0e3a-ddee-439c-96e1-27c7c620cdfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:31.270843 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3ae0e3a-ddee-439c-96e1-27c7c620cdfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:31.271281 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3ae0e3a-ddee-439c-96e1-27c7c620cdfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:31.272023 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3ae0e3a-ddee-439c-96e1-27c7c620cdfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:31.272484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3ae0e3a-ddee-439c-96e1-27c7c620cdfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:31.272948 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3ae0e3a-ddee-439c-96e1-27c7c620cdfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:31.281755 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-f1484cc3-e705-40b4-9a8e-39d4123fab17 req-489a90d2-2081-4075-ab8a-3de539bc186e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89b360b-2f7e-4f80-9247-559c3b0cf714", "name": "network-vif-plugged", "status": "completed", "tag": "1442dec7-2556-4073-a34d-d9c24dea3b48"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:31.294847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f1484cc3-e705-40b4-9a8e-39d4123fab17 req-489a90d2-2081-4075-ab8a-3de539bc186e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:31.295573 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f1484cc3-e705-40b4-9a8e-39d4123fab17 req-489a90d2-2081-4075-ab8a-3de539bc186e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:31.296190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f1484cc3-e705-40b4-9a8e-39d4123fab17 req-489a90d2-2081-4075-ab8a-3de539bc186e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:31.312355 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-f1484cc3-e705-40b4-9a8e-39d4123fab17 req-489a90d2-2081-4075-ab8a-3de539bc186e service nova] Creating event network-vif-plugged:1442dec7-2556-4073-a34d-d9c24dea3b48 for instance d89b360b-2f7e-4f80-9247-559c3b0cf714 on n-h1-860863-1 Oct 10 18:53:31.323686 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-f1484cc3-e705-40b4-9a8e-39d4123fab17 req-489a90d2-2081-4075-ab8a-3de539bc186e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049649 Oct 10 18:53:31.323686 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 618/1086] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:31.325709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3e912232-8d36-459d-b3a8-97e0e855226a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:31.326419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3e912232-8d36-459d-b3a8-97e0e855226a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:31.341521 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e912232-8d36-459d-b3a8-97e0e855226a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:31.342447 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e912232-8d36-459d-b3a8-97e0e855226a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:31.343374 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e912232-8d36-459d-b3a8-97e0e855226a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:31.344772 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e912232-8d36-459d-b3a8-97e0e855226a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:31.345271 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e912232-8d36-459d-b3a8-97e0e855226a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:31.345673 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e912232-8d36-459d-b3a8-97e0e855226a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:31.350222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:31.428165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3e912232-8d36-459d-b3a8-97e0e855226a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ada4cd6646b4ba397f952d939e36814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091182527c74871b45587d4ff107e9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:31.442038 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3e912232-8d36-459d-b3a8-97e0e855226a tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 200 len: 1301 microversion: 2.1 time: 0.120594 Oct 10 18:53:31.458602 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 619/1087] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:31 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 1301 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:31.465230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-8fd657d9-dc86-42af-a3d5-06db9a6653b9 req-4de54d1f-d60c-49bf-9f72-61fe599f91eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d7e0b3-09b9-43cd-a996-c33d4bed703b", "name": "network-vif-deleted", "tag": "262c829d-3cff-42ed-af35-b1a9a1cfab8d"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:31.470764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:31.478097 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8fd657d9-dc86-42af-a3d5-06db9a6653b9 req-4de54d1f-d60c-49bf-9f72-61fe599f91eb service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:31.479380 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8fd657d9-dc86-42af-a3d5-06db9a6653b9 req-4de54d1f-d60c-49bf-9f72-61fe599f91eb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:31.480069 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8fd657d9-dc86-42af-a3d5-06db9a6653b9 req-4de54d1f-d60c-49bf-9f72-61fe599f91eb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:31.495393 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-8fd657d9-dc86-42af-a3d5-06db9a6653b9 req-4de54d1f-d60c-49bf-9f72-61fe599f91eb service nova] Creating event network-vif-deleted:262c829d-3cff-42ed-af35-b1a9a1cfab8d for instance 17d7e0b3-09b9-43cd-a996-c33d4bed703b on n-h2-860863-1 Oct 10 18:53:31.501809 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-8fd657d9-dc86-42af-a3d5-06db9a6653b9 req-4de54d1f-d60c-49bf-9f72-61fe599f91eb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041255 Oct 10 18:53:31.503085 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 620/1088] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:31.509581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3aeefd43-7f3c-48f3-a0aa-3c774f549de4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:31.510860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3aeefd43-7f3c-48f3-a0aa-3c774f549de4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:31.523862 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3aeefd43-7f3c-48f3-a0aa-3c774f549de4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:31.524716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3aeefd43-7f3c-48f3-a0aa-3c774f549de4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:31.525946 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3aeefd43-7f3c-48f3-a0aa-3c774f549de4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:31.526925 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3aeefd43-7f3c-48f3-a0aa-3c774f549de4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:31.527537 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3aeefd43-7f3c-48f3-a0aa-3c774f549de4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:31.529177 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3aeefd43-7f3c-48f3-a0aa-3c774f549de4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:31.618195 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b3ae0e3a-ddee-439c-96e1-27c7c620cdfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:31.641749 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b3ae0e3a-ddee-439c-96e1-27c7c620cdfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1509 microversion: 2.1 time: 0.392832 Oct 10 18:53:31.657652 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 469/1089] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:31 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1509 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:31.741807 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3aeefd43-7f3c-48f3-a0aa-3c774f549de4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:31.750953 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3aeefd43-7f3c-48f3-a0aa-3c774f549de4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1464 microversion: 2.1 time: 0.246695 Oct 10 18:53:31.751615 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 621/1090] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:31 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1464 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:31.773449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2c69a6a2-91ba-4423-9492-f44eeed05b04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:31.774226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2c69a6a2-91ba-4423-9492-f44eeed05b04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:31.781364 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2c69a6a2-91ba-4423-9492-f44eeed05b04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:31.785037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2c69a6a2-91ba-4423-9492-f44eeed05b04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:31.785037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2c69a6a2-91ba-4423-9492-f44eeed05b04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:31.785037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2c69a6a2-91ba-4423-9492-f44eeed05b04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:31.785037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2c69a6a2-91ba-4423-9492-f44eeed05b04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:31.785037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2c69a6a2-91ba-4423-9492-f44eeed05b04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:32.028403 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-61d8413d-7669-4adb-8dae-38f19e5f4779 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:32.029343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-61d8413d-7669-4adb-8dae-38f19e5f4779 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:32.040970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61d8413d-7669-4adb-8dae-38f19e5f4779 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:32.041433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61d8413d-7669-4adb-8dae-38f19e5f4779 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:32.044105 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61d8413d-7669-4adb-8dae-38f19e5f4779 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:32.047149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61d8413d-7669-4adb-8dae-38f19e5f4779 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:32.047900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61d8413d-7669-4adb-8dae-38f19e5f4779 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:32.049970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61d8413d-7669-4adb-8dae-38f19e5f4779 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:32.265554 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=44 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:32.292283 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2c69a6a2-91ba-4423-9492-f44eeed05b04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:32.301178 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2c69a6a2-91ba-4423-9492-f44eeed05b04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1464 microversion: 2.1 time: 0.531436 Oct 10 18:53:32.302391 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 470/1091] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:31 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1464 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:32.311121 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a1224e48-95c1-4ef8-89ca-2ed609babdc1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:32.311737 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a1224e48-95c1-4ef8-89ca-2ed609babdc1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:32.328105 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1224e48-95c1-4ef8-89ca-2ed609babdc1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:32.328677 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1224e48-95c1-4ef8-89ca-2ed609babdc1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:32.329562 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1224e48-95c1-4ef8-89ca-2ed609babdc1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:32.330549 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1224e48-95c1-4ef8-89ca-2ed609babdc1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:32.331160 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1224e48-95c1-4ef8-89ca-2ed609babdc1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:32.331808 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1224e48-95c1-4ef8-89ca-2ed609babdc1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:32.390159 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-61d8413d-7669-4adb-8dae-38f19e5f4779 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:32.399560 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-61d8413d-7669-4adb-8dae-38f19e5f4779 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1316 microversion: 2.1 time: 0.377162 Oct 10 18:53:32.415710 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 622/1092] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:32 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:32.415710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0dd4f0c9-9daa-46f9-aa20-591326c660be tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:32.415710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0dd4f0c9-9daa-46f9-aa20-591326c660be tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:32.415710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0dd4f0c9-9daa-46f9-aa20-591326c660be tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:32.415710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0dd4f0c9-9daa-46f9-aa20-591326c660be tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:32.415710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0dd4f0c9-9daa-46f9-aa20-591326c660be tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:32.415710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0dd4f0c9-9daa-46f9-aa20-591326c660be tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:32.417123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0dd4f0c9-9daa-46f9-aa20-591326c660be tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:32.417123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0dd4f0c9-9daa-46f9-aa20-591326c660be tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:32.651714 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0dd4f0c9-9daa-46f9-aa20-591326c660be tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:32.664530 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0dd4f0c9-9daa-46f9-aa20-591326c660be tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1318 microversion: 2.1 time: 0.262723 Oct 10 18:53:32.680710 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 623/1093] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:32 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:32.689455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:32.692696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:32.699477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:32.699968 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:32.701237 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:32.701970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:32.702427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:32.702853 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:32.709230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:32.796859 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:53:32.797659 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:53:32.797801 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:53:32.798116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:53:32.798753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:53:33.003195 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a1224e48-95c1-4ef8-89ca-2ed609babdc1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:33.013593 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a1224e48-95c1-4ef8-89ca-2ed609babdc1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:33.015059 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a1224e48-95c1-4ef8-89ca-2ed609babdc1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:33.020949 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a1224e48-95c1-4ef8-89ca-2ed609babdc1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1362 microversion: 2.25 time: 0.711916 Oct 10 18:53:33.020949 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 471/1094] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:32 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1362 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:33.021936 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:33.028238 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:33.029342 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:33.030998 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:33.032082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:33.032612 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:33.033052 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:33.048144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-98694129-3502-401c-8de1-c3753fa88774 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:33.049242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-98694129-3502-401c-8de1-c3753fa88774 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] [instance: 17d7e0b3-09b9-43cd-a996-c33d4bed703b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:33.060288 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98694129-3502-401c-8de1-c3753fa88774 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:33.061246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98694129-3502-401c-8de1-c3753fa88774 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:33.066727 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98694129-3502-401c-8de1-c3753fa88774 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:33.066727 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98694129-3502-401c-8de1-c3753fa88774 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:33.067118 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-47425449-6e94-4119-9242-70f84d72187d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "POST /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff/action" status: 202 len: 1068 microversion: 2.1 time: 0.378343 Oct 10 18:53:33.067212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98694129-3502-401c-8de1-c3753fa88774 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:33.067212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98694129-3502-401c-8de1-c3753fa88774 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:33.077960 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 624/1095] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:53:32 2022] POST /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff/action => generated 1068 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 10 18:53:33.085442 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-34c32d3a-d03e-48e8-975f-d52dbb605c9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:33.086343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-34c32d3a-d03e-48e8-975f-d52dbb605c9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:33.088135 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-98694129-3502-401c-8de1-c3753fa88774 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] HTTP exception thrown: Instance 17d7e0b3-09b9-43cd-a996-c33d4bed703b could not be found. Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-98694129-3502-401c-8de1-c3753fa88774 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Request method failure captured: Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b HTTP/1.1 Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGm--aQAlvBKEa3ByMy0C1Tp4LkbzuVgNT-luctVqUAYuZYjT1V4PvW-kbYkjK7pGoY1oyE5SrLohsiVSTk-AYfvhmLMxqrVEsnWbbQj5cdM59ZgzuSXkl3KYhzc55Z-UolAQ6ocWG5QnSVccHGALU1CJwVwMQoa40q6E2iLeTHZu6M Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8091182527c74871b45587d4ff107e9f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8091182527c74871b45587d4ff107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8091182527c74871b45587d4ff107e9f"}]}] Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 8091182527c74871b45587d4ff107e9f Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-370882183 Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 5ada4cd6646b4ba397f952d939e36814 Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-SecurityGroupsTestJSON-370882183-project Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 17d7e0b3-09b9-43cd-a996-c33d4bed703b could not be found. Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '17d7e0b3-09b9-43cd-a996-c33d4bed703b'} Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d7e0b3-09b9-43cd-a996-c33d4bed703b could not be found. Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d7e0b3-09b9-43cd-a996-c33d4bed703b could not be found. Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:33.089964 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:33.095586 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:33.095586 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:33.095586 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:33.095586 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:33.095586 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:33.095586 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d7e0b3-09b9-43cd-a996-c33d4bed703b could not be found. Oct 10 18:53:33.095586 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:33.096165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34c32d3a-d03e-48e8-975f-d52dbb605c9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:33.096165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34c32d3a-d03e-48e8-975f-d52dbb605c9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:33.096165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34c32d3a-d03e-48e8-975f-d52dbb605c9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:33.096165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34c32d3a-d03e-48e8-975f-d52dbb605c9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:33.096165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34c32d3a-d03e-48e8-975f-d52dbb605c9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:33.096165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34c32d3a-d03e-48e8-975f-d52dbb605c9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:33.097555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-98694129-3502-401c-8de1-c3753fa88774 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Returning 404 to user: Instance 17d7e0b3-09b9-43cd-a996-c33d4bed703b could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:33.098875 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-98694129-3502-401c-8de1-c3753fa88774 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b" status: 404 len: 111 microversion: 2.1 time: 0.058431 Oct 10 18:53:33.102952 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 472/1096] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:33 2022] GET /compute/v2.1/servers/17d7e0b3-09b9-43cd-a996-c33d4bed703b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:53:33.109100 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a3c2debb-b31a-4fd3-945e-96de813afc3a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:33.109922 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a3c2debb-b31a-4fd3-945e-96de813afc3a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:33.129888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c2debb-b31a-4fd3-945e-96de813afc3a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:33.131007 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c2debb-b31a-4fd3-945e-96de813afc3a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:33.131007 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c2debb-b31a-4fd3-945e-96de813afc3a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:33.131585 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c2debb-b31a-4fd3-945e-96de813afc3a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:33.132102 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c2debb-b31a-4fd3-945e-96de813afc3a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:33.132566 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c2debb-b31a-4fd3-945e-96de813afc3a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:33.302454 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-34c32d3a-d03e-48e8-975f-d52dbb605c9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:33.311299 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-34c32d3a-d03e-48e8-975f-d52dbb605c9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1509 microversion: 2.1 time: 0.232120 Oct 10 18:53:33.311891 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 625/1097] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:33 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:33.316920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2f743db8-b0de-4a3d-8966-caffe82c4eb7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f318dd779d0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:33.632170 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2f743db8-b0de-4a3d-8966-caffe82c4eb7 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/e501335c-edbe-4587-af16-cc9a15683827" status: 202 len: 0 microversion: 2.1 time: 0.318947 Oct 10 18:53:33.637217 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 626/1098] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:33 2022] DELETE /compute/v2.1/os-security-groups/e501335c-edbe-4587-af16-cc9a15683827 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:33.640198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-06efd789-2b9f-4ff2-bd12-e53782fc7c59 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:33.641240 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-06efd789-2b9f-4ff2-bd12-e53782fc7c59 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:33.652002 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-06efd789-2b9f-4ff2-bd12-e53782fc7c59 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:33.652738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-06efd789-2b9f-4ff2-bd12-e53782fc7c59 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:33.653465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-06efd789-2b9f-4ff2-bd12-e53782fc7c59 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:33.655728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-06efd789-2b9f-4ff2-bd12-e53782fc7c59 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:33.667719 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-06efd789-2b9f-4ff2-bd12-e53782fc7c59 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:33.668292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-06efd789-2b9f-4ff2-bd12-e53782fc7c59 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:33.791321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=50 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:33.845740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-06efd789-2b9f-4ff2-bd12-e53782fc7c59 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:33.855814 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-06efd789-2b9f-4ff2-bd12-e53782fc7c59 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1316 microversion: 2.1 time: 0.221682 Oct 10 18:53:33.866536 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 627/1099] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:33 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:33.866536 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-430a2a83-653d-4315-a43b-61eca235f743 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] Calling method '.version_select at 0x7f319233aee0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:33.894710 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a3c2debb-b31a-4fd3-945e-96de813afc3a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:33.913590 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a3c2debb-b31a-4fd3-945e-96de813afc3a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.808544 Oct 10 18:53:33.914392 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 473/1100] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:33 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:33.930485 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2734e914-7a53-4c69-ba2c-8e459cea80cc tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:33.931472 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2734e914-7a53-4c69-ba2c-8e459cea80cc tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:33.947736 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2734e914-7a53-4c69-ba2c-8e459cea80cc tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:33.952457 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2734e914-7a53-4c69-ba2c-8e459cea80cc tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:33.953226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2734e914-7a53-4c69-ba2c-8e459cea80cc tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:33.954732 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2734e914-7a53-4c69-ba2c-8e459cea80cc tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:33.955405 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2734e914-7a53-4c69-ba2c-8e459cea80cc tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:33.955927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2734e914-7a53-4c69-ba2c-8e459cea80cc tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:34.189645 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-430a2a83-653d-4315-a43b-61eca235f743 tempest-SecurityGroupsTestJSON-370882183 tempest-SecurityGroupsTestJSON-370882183-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/50949f81-b1cd-469d-b594-bb9f293a7473" status: 202 len: 0 microversion: 2.1 time: 0.331886 Oct 10 18:53:34.190955 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 628/1101] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:33 2022] DELETE /compute/v2.1/os-security-groups/50949f81-b1cd-469d-b594-bb9f293a7473 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:34.199632 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ab49c35d-4016-4353-94fc-7c7d44b824a7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:34.200763 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ab49c35d-4016-4353-94fc-7c7d44b824a7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:34.210730 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ab49c35d-4016-4353-94fc-7c7d44b824a7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:34.211351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ab49c35d-4016-4353-94fc-7c7d44b824a7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:34.211877 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ab49c35d-4016-4353-94fc-7c7d44b824a7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:34.212908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ab49c35d-4016-4353-94fc-7c7d44b824a7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:34.213576 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ab49c35d-4016-4353-94fc-7c7d44b824a7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:34.214212 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ab49c35d-4016-4353-94fc-7c7d44b824a7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:34.587394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2734e914-7a53-4c69-ba2c-8e459cea80cc tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:34.592649 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ab49c35d-4016-4353-94fc-7c7d44b824a7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:34.601434 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2734e914-7a53-4c69-ba2c-8e459cea80cc tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1318 microversion: 2.1 time: 0.683038 Oct 10 18:53:34.602383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ab49c35d-4016-4353-94fc-7c7d44b824a7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:34.604298 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 474/1102] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:33 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1318 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:34.607997 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ab49c35d-4016-4353-94fc-7c7d44b824a7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:34.609224 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ab49c35d-4016-4353-94fc-7c7d44b824a7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1362 microversion: 2.25 time: 0.416492 Oct 10 18:53:34.609778 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 629/1103] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:34 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1362 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:34.616117 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-282a86bb-6af9-4bd3-8d7d-a6a9cb0d723d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:34.616769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-282a86bb-6af9-4bd3-8d7d-a6a9cb0d723d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:34.632099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-282a86bb-6af9-4bd3-8d7d-a6a9cb0d723d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:34.632606 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-282a86bb-6af9-4bd3-8d7d-a6a9cb0d723d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:34.633021 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-282a86bb-6af9-4bd3-8d7d-a6a9cb0d723d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:34.633736 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-282a86bb-6af9-4bd3-8d7d-a6a9cb0d723d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:34.634193 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-282a86bb-6af9-4bd3-8d7d-a6a9cb0d723d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:34.634619 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-282a86bb-6af9-4bd3-8d7d-a6a9cb0d723d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:34.809960 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-9dc35eb3-f08d-4b4a-b2f2-c22fb1f5ca8f req-18debe7e-cc08-482c-aeaa-7a64744fef3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06dba6c-63b1-4f22-a1b1-d8be963d59d8", "name": "network-vif-deleted", "tag": "64f101a7-8976-4073-913a-cafa0149f458"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:34.862413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-9dc35eb3-f08d-4b4a-b2f2-c22fb1f5ca8f req-18debe7e-cc08-482c-aeaa-7a64744fef3f service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:34.869754 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-9dc35eb3-f08d-4b4a-b2f2-c22fb1f5ca8f req-18debe7e-cc08-482c-aeaa-7a64744fef3f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:34.870193 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-9dc35eb3-f08d-4b4a-b2f2-c22fb1f5ca8f req-18debe7e-cc08-482c-aeaa-7a64744fef3f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:34.883185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-282a86bb-6af9-4bd3-8d7d-a6a9cb0d723d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:34.896098 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-282a86bb-6af9-4bd3-8d7d-a6a9cb0d723d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1467 microversion: 2.1 time: 0.290321 Oct 10 18:53:34.899164 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 475/1104] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:34 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1467 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:34.913649 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-9dc35eb3-f08d-4b4a-b2f2-c22fb1f5ca8f req-18debe7e-cc08-482c-aeaa-7a64744fef3f service nova] Creating event network-vif-deleted:64f101a7-8976-4073-913a-cafa0149f458 for instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 on n-h1-860863-1 Oct 10 18:53:34.917809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-426b9ff0-5dc9-424c-9db8-48b5abd43f14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:34.921227 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-426b9ff0-5dc9-424c-9db8-48b5abd43f14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:34.931245 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-9dc35eb3-f08d-4b4a-b2f2-c22fb1f5ca8f req-18debe7e-cc08-482c-aeaa-7a64744fef3f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130481 Oct 10 18:53:34.934045 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-426b9ff0-5dc9-424c-9db8-48b5abd43f14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:34.935271 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 630/1105] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:34.945540 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-426b9ff0-5dc9-424c-9db8-48b5abd43f14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:34.955950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-426b9ff0-5dc9-424c-9db8-48b5abd43f14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:34.955950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-426b9ff0-5dc9-424c-9db8-48b5abd43f14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:34.955950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-426b9ff0-5dc9-424c-9db8-48b5abd43f14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:34.955950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-426b9ff0-5dc9-424c-9db8-48b5abd43f14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:34.956567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2db1082e-4673-4167-8576-97066aa5b565 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:34.957341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2db1082e-4673-4167-8576-97066aa5b565 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:34.971442 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2db1082e-4673-4167-8576-97066aa5b565 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:34.971946 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2db1082e-4673-4167-8576-97066aa5b565 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:34.972376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2db1082e-4673-4167-8576-97066aa5b565 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:34.973113 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2db1082e-4673-4167-8576-97066aa5b565 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:34.973561 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2db1082e-4673-4167-8576-97066aa5b565 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:34.974042 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2db1082e-4673-4167-8576-97066aa5b565 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:35.262693 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2db1082e-4673-4167-8576-97066aa5b565 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:35.273709 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-426b9ff0-5dc9-424c-9db8-48b5abd43f14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:35.274310 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2db1082e-4673-4167-8576-97066aa5b565 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.337731 Oct 10 18:53:35.276565 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 631/1106] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:34 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:35.286424 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-426b9ff0-5dc9-424c-9db8-48b5abd43f14 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1316 microversion: 2.1 time: 0.377626 Oct 10 18:53:35.301515 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 476/1107] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:34 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:35.630611 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-31afae4f-123b-4247-a0cf-ce17e31ce0a5 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:35.645067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-31afae4f-123b-4247-a0cf-ce17e31ce0a5 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:35.645067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31afae4f-123b-4247-a0cf-ce17e31ce0a5 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:35.645067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31afae4f-123b-4247-a0cf-ce17e31ce0a5 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:35.646576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31afae4f-123b-4247-a0cf-ce17e31ce0a5 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:35.647479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31afae4f-123b-4247-a0cf-ce17e31ce0a5 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:35.648964 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31afae4f-123b-4247-a0cf-ce17e31ce0a5 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:35.651316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31afae4f-123b-4247-a0cf-ce17e31ce0a5 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:35.789385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f503e5ea-0d94-479b-ae08-72a114e7e371 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Action: 'create', calling method: .version_select at 0x7f3192378e50>, body: {"keypair": {"name": "tempest-keypair-597174242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZgVHY7QdNQxOPh1oFtCwFfJMccO90lBopvaXpx7JCp8AKhcHE3pZo8beuJR8SXIaDU5+Nqk+ymqiN70f47dTxQ/VIEWzpeVw+CNkMyOtmES0DNqdBONPNVN4MXTkKmTQ=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:35.807926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-f503e5ea-0d94-479b-ae08-72a114e7e371 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Getting quotas for project 92d05639af8046dd87fe6973ff26f161. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:35.813098 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-f503e5ea-0d94-479b-ae08-72a114e7e371 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Getting quotas for user abed6abc941a421682af5e3f5df98040 and project 92d05639af8046dd87fe6973ff26f161. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:35.921830 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f503e5ea-0d94-479b-ae08-72a114e7e371 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.522097 Oct 10 18:53:35.930104 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 632/1108] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:53:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:35.933439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-311569d6-ac4a-4af7-b4ba-834ca58148d7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:35.934357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-311569d6-ac4a-4af7-b4ba-834ca58148d7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:35.958033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-311569d6-ac4a-4af7-b4ba-834ca58148d7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:35.958544 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-311569d6-ac4a-4af7-b4ba-834ca58148d7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:35.958979 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-311569d6-ac4a-4af7-b4ba-834ca58148d7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:35.959706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-311569d6-ac4a-4af7-b4ba-834ca58148d7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:35.960160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-311569d6-ac4a-4af7-b4ba-834ca58148d7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:35.960609 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-311569d6-ac4a-4af7-b4ba-834ca58148d7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:36.013598 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-31afae4f-123b-4247-a0cf-ce17e31ce0a5 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:36.030417 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-31afae4f-123b-4247-a0cf-ce17e31ce0a5 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1318 microversion: 2.1 time: 0.404354 Oct 10 18:53:36.031899 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 477/1109] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:35 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:36.038758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-750a0fec-d7bb-4719-b592-efe1d33881a6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:36.040051 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-750a0fec-d7bb-4719-b592-efe1d33881a6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:36.053261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-750a0fec-d7bb-4719-b592-efe1d33881a6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:36.054055 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-750a0fec-d7bb-4719-b592-efe1d33881a6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:36.054657 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-750a0fec-d7bb-4719-b592-efe1d33881a6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:36.055602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-750a0fec-d7bb-4719-b592-efe1d33881a6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:36.056234 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-750a0fec-d7bb-4719-b592-efe1d33881a6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:36.057060 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-750a0fec-d7bb-4719-b592-efe1d33881a6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:36.146094 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-750a0fec-d7bb-4719-b592-efe1d33881a6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:36.147732 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-750a0fec-d7bb-4719-b592-efe1d33881a6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:36.148515 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-750a0fec-d7bb-4719-b592-efe1d33881a6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:36.149165 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-750a0fec-d7bb-4719-b592-efe1d33881a6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lazy-loading 'fault' on Instance uuid c06dba6c-63b1-4f22-a1b1-d8be963d59d8 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:53:36.245569 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-750a0fec-d7bb-4719-b592-efe1d33881a6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:36.272244 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-750a0fec-d7bb-4719-b592-efe1d33881a6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 200 len: 1305 microversion: 2.1 time: 0.239047 Oct 10 18:53:36.276516 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 478/1110] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:36 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 1305 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:36.303688 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0ee8d966-b30d-416e-8f41-1335e06df9b4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:36.304564 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0ee8d966-b30d-416e-8f41-1335e06df9b4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:36.322915 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ee8d966-b30d-416e-8f41-1335e06df9b4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:36.322915 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ee8d966-b30d-416e-8f41-1335e06df9b4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:36.322915 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ee8d966-b30d-416e-8f41-1335e06df9b4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:36.322915 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ee8d966-b30d-416e-8f41-1335e06df9b4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:36.322915 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ee8d966-b30d-416e-8f41-1335e06df9b4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:36.322915 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ee8d966-b30d-416e-8f41-1335e06df9b4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:36.395204 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-311569d6-ac4a-4af7-b4ba-834ca58148d7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:36.409279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-311569d6-ac4a-4af7-b4ba-834ca58148d7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:36.411261 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-311569d6-ac4a-4af7-b4ba-834ca58148d7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:36.413206 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-311569d6-ac4a-4af7-b4ba-834ca58148d7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1557 microversion: 2.25 time: 0.488698 Oct 10 18:53:36.424036 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 633/1111] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:35 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1557 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:36.445835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-452a5b5a-5a7c-41aa-87ab-eaa9e52f71c2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:36.446927 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-452a5b5a-5a7c-41aa-87ab-eaa9e52f71c2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:36.459320 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-452a5b5a-5a7c-41aa-87ab-eaa9e52f71c2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:36.459320 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-452a5b5a-5a7c-41aa-87ab-eaa9e52f71c2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:36.459320 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-452a5b5a-5a7c-41aa-87ab-eaa9e52f71c2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:36.459320 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-452a5b5a-5a7c-41aa-87ab-eaa9e52f71c2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:36.459320 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-452a5b5a-5a7c-41aa-87ab-eaa9e52f71c2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:36.460690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-452a5b5a-5a7c-41aa-87ab-eaa9e52f71c2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:36.858692 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-452a5b5a-5a7c-41aa-87ab-eaa9e52f71c2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:36.869947 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-452a5b5a-5a7c-41aa-87ab-eaa9e52f71c2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1316 microversion: 2.1 time: 0.443367 Oct 10 18:53:36.871181 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 634/1112] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:36 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:36.877217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9ea578be-3153-4ef3-a841-be66f71762ed tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:36.880237 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9ea578be-3153-4ef3-a841-be66f71762ed tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:36.891525 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ea578be-3153-4ef3-a841-be66f71762ed tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:36.892839 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ea578be-3153-4ef3-a841-be66f71762ed tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:36.893927 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ea578be-3153-4ef3-a841-be66f71762ed tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:36.896851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ea578be-3153-4ef3-a841-be66f71762ed tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:36.897641 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ea578be-3153-4ef3-a841-be66f71762ed tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:36.898346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9ea578be-3153-4ef3-a841-be66f71762ed tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:36.933475 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0ee8d966-b30d-416e-8f41-1335e06df9b4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:36.943713 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0ee8d966-b30d-416e-8f41-1335e06df9b4 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.644272 Oct 10 18:53:36.944861 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 479/1113] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:36 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:36.996831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-c19c71b6-fbf7-494e-8ddc-59997e7556f6 req-aabc5d47-79ce-48c7-a979-3966ae49886f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367f9726-b32e-4ce6-94f8-b4075d746833", "tag": "78998a37-aff7-4723-9b60-bfb50a9adb5d"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:37.014591 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-c19c71b6-fbf7-494e-8ddc-59997e7556f6 req-aabc5d47-79ce-48c7-a979-3966ae49886f service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:37.015520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-c19c71b6-fbf7-494e-8ddc-59997e7556f6 req-aabc5d47-79ce-48c7-a979-3966ae49886f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:37.016133 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-c19c71b6-fbf7-494e-8ddc-59997e7556f6 req-aabc5d47-79ce-48c7-a979-3966ae49886f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:37.039081 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-c19c71b6-fbf7-494e-8ddc-59997e7556f6 req-aabc5d47-79ce-48c7-a979-3966ae49886f service nova] Creating event network-changed:78998a37-aff7-4723-9b60-bfb50a9adb5d for instance 367f9726-b32e-4ce6-94f8-b4075d746833 on n-h1-860863-1 Oct 10 18:53:37.051138 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-c19c71b6-fbf7-494e-8ddc-59997e7556f6 req-aabc5d47-79ce-48c7-a979-3966ae49886f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058456 Oct 10 18:53:37.053021 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 480/1114] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:37.071502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9aee0394-5304-40b2-bd5c-5098a754cd5b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:37.072376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9aee0394-5304-40b2-bd5c-5098a754cd5b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:37.090660 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9aee0394-5304-40b2-bd5c-5098a754cd5b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:37.094042 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9aee0394-5304-40b2-bd5c-5098a754cd5b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:37.094424 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9aee0394-5304-40b2-bd5c-5098a754cd5b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:37.095166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9aee0394-5304-40b2-bd5c-5098a754cd5b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:37.095626 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9aee0394-5304-40b2-bd5c-5098a754cd5b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:37.096053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9aee0394-5304-40b2-bd5c-5098a754cd5b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:37.255013 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-9ea578be-3153-4ef3-a841-be66f71762ed tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid d89b360b-2f7e-4f80-9247-559c3b0cf714 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:53:37.297086 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9ea578be-3153-4ef3-a841-be66f71762ed tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 2050 microversion: 2.25 time: 0.423895 Oct 10 18:53:37.297979 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 635/1115] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:36 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 2050 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:37.321415 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-23cf9464-f2c3-4aaa-9d57-2a2a145e3176 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:37.321894 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-23cf9464-f2c3-4aaa-9d57-2a2a145e3176 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:37.324653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9aee0394-5304-40b2-bd5c-5098a754cd5b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:37.330653 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23cf9464-f2c3-4aaa-9d57-2a2a145e3176 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:37.331144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23cf9464-f2c3-4aaa-9d57-2a2a145e3176 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:37.331567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23cf9464-f2c3-4aaa-9d57-2a2a145e3176 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:37.332739 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23cf9464-f2c3-4aaa-9d57-2a2a145e3176 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:37.333580 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23cf9464-f2c3-4aaa-9d57-2a2a145e3176 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:37.335403 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23cf9464-f2c3-4aaa-9d57-2a2a145e3176 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:37.347365 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9aee0394-5304-40b2-bd5c-5098a754cd5b tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1318 microversion: 2.1 time: 0.292806 Oct 10 18:53:37.359042 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-23cf9464-f2c3-4aaa-9d57-2a2a145e3176 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-23cf9464-f2c3-4aaa-9d57-2a2a145e3176 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 HTTP/1.1 Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'c06dba6c-63b1-4f22-a1b1-d8be963d59d8'} Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:37.364012 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:37.369223 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:37.369223 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:37.369223 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:37.369223 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:37.369223 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:37.369223 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:53:37.369223 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:37.369223 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-23cf9464-f2c3-4aaa-9d57-2a2a145e3176 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:37.370994 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-23cf9464-f2c3-4aaa-9d57-2a2a145e3176 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 404 len: 111 microversion: 2.1 time: 0.057100 Oct 10 18:53:37.371723 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 636/1117] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:37 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:53:37.371836 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 481/1117] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:37 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:37.383315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4a215ad5-a1b6-45da-ae26-7ef196f0fccf tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:37.383315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4a215ad5-a1b6-45da-ae26-7ef196f0fccf tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:37.391242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a215ad5-a1b6-45da-ae26-7ef196f0fccf tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:37.393144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a215ad5-a1b6-45da-ae26-7ef196f0fccf tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:37.393375 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a215ad5-a1b6-45da-ae26-7ef196f0fccf tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:37.394099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a215ad5-a1b6-45da-ae26-7ef196f0fccf tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:37.394576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a215ad5-a1b6-45da-ae26-7ef196f0fccf tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:37.397180 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a215ad5-a1b6-45da-ae26-7ef196f0fccf tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:37.615580 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1570338087", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "737898c7-94e7-46dc-b9d9-724fb5cc9d52"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:37.711794 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] validate_networks() for [('737898c7-94e7-46dc-b9d9-724fb5cc9d52', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:53:38.129386 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-4a215ad5-a1b6-45da-ae26-7ef196f0fccf tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid d89b360b-2f7e-4f80-9247-559c3b0cf714 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:53:38.157473 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4a215ad5-a1b6-45da-ae26-7ef196f0fccf tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 2050 microversion: 2.25 time: 0.784393 Oct 10 18:53:38.158836 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 482/1118] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:37 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 2050 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:38.166218 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3b18d099-c860-467e-8430-72c5764bf178 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:38.167071 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3b18d099-c860-467e-8430-72c5764bf178 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:38.183844 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b18d099-c860-467e-8430-72c5764bf178 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:38.184696 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b18d099-c860-467e-8430-72c5764bf178 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:38.185604 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b18d099-c860-467e-8430-72c5764bf178 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:38.186627 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b18d099-c860-467e-8430-72c5764bf178 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:38.187246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b18d099-c860-467e-8430-72c5764bf178 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:38.187835 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b18d099-c860-467e-8430-72c5764bf178 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:38.750667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3b18d099-c860-467e-8430-72c5764bf178 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:38.761243 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3b18d099-c860-467e-8430-72c5764bf178 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1316 microversion: 2.1 time: 0.600967 Oct 10 18:53:38.764428 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 483/1119] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:38 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1316 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:38.783645 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a6c9a16c-59a3-4470-acd7-797ca0ea148a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:38.784407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a6c9a16c-59a3-4470-acd7-797ca0ea148a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:38.796888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6c9a16c-59a3-4470-acd7-797ca0ea148a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:38.798567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6c9a16c-59a3-4470-acd7-797ca0ea148a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:38.799128 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6c9a16c-59a3-4470-acd7-797ca0ea148a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:38.801031 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6c9a16c-59a3-4470-acd7-797ca0ea148a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:38.802184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6c9a16c-59a3-4470-acd7-797ca0ea148a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:38.806035 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6c9a16c-59a3-4470-acd7-797ca0ea148a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:38.874753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:53:38.877144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:53:38.877838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:53:38.889386 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:53:38.889386 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:53:38.909384 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:38.910167 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:38.910766 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:38.911654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:38.912551 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:38.913307 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:38.947842 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Getting quotas for project c5d5fb01be0c409d98c222551a2c0e2e. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:38.953792 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Getting quotas for user afedfd9cc5b241ad97e27f6e911244a1 and project c5d5fb01be0c409d98c222551a2c0e2e. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:38.969388 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:53:38.971977 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:53:39.148618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a6c9a16c-59a3-4470-acd7-797ca0ea148a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:39.164180 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a6c9a16c-59a3-4470-acd7-797ca0ea148a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.392305 Oct 10 18:53:39.165848 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 484/1120] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:38 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:39.177765 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-924eaec9-0e45-4165-af52-202bd6166e78 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.569092 Oct 10 18:53:39.185624 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 637/1121] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:53:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 18:53:39.190977 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-969e8f1e-8179-4b2a-864d-a29f047f6b04 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:39.198927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-969e8f1e-8179-4b2a-864d-a29f047f6b04 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:39.198927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-969e8f1e-8179-4b2a-864d-a29f047f6b04 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:39.205308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2fda8b39-e957-438c-aa6b-ce16b0bfb01e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:39.205936 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2fda8b39-e957-438c-aa6b-ce16b0bfb01e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:39.215717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fda8b39-e957-438c-aa6b-ce16b0bfb01e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:39.216282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fda8b39-e957-438c-aa6b-ce16b0bfb01e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:39.216769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fda8b39-e957-438c-aa6b-ce16b0bfb01e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:39.217495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fda8b39-e957-438c-aa6b-ce16b0bfb01e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:39.217951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fda8b39-e957-438c-aa6b-ce16b0bfb01e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:39.218376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fda8b39-e957-438c-aa6b-ce16b0bfb01e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:39.227216 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-969e8f1e-8179-4b2a-864d-a29f047f6b04 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:39.228140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-969e8f1e-8179-4b2a-864d-a29f047f6b04 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:39.228672 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-969e8f1e-8179-4b2a-864d-a29f047f6b04 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:39.229281 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-969e8f1e-8179-4b2a-864d-a29f047f6b04 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:39.280797 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-969e8f1e-8179-4b2a-864d-a29f047f6b04 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.113503 Oct 10 18:53:39.281414 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 485/1122] 10.222.0.43 () {60 vars in 1217 bytes} [Mon Oct 10 18:53:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:53:39.295374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-138c8879-9ed3-4f97-8878-bdfa921f9b15 req-bb67c652-deaa-436d-a82b-614a31896385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5", "name": "network-vif-plugged", "status": "completed", "tag": "c849a4db-bdc3-4389-af5c-2c1c543bc002"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:39.336976 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-138c8879-9ed3-4f97-8878-bdfa921f9b15 req-bb67c652-deaa-436d-a82b-614a31896385 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:39.337740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-138c8879-9ed3-4f97-8878-bdfa921f9b15 req-bb67c652-deaa-436d-a82b-614a31896385 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:39.338934 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-138c8879-9ed3-4f97-8878-bdfa921f9b15 req-bb67c652-deaa-436d-a82b-614a31896385 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:39.355386 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-138c8879-9ed3-4f97-8878-bdfa921f9b15 req-bb67c652-deaa-436d-a82b-614a31896385 service nova] Creating event network-vif-plugged:c849a4db-bdc3-4389-af5c-2c1c543bc002 for instance 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 on n-h1-860863-1 Oct 10 18:53:39.368753 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-138c8879-9ed3-4f97-8878-bdfa921f9b15 req-bb67c652-deaa-436d-a82b-614a31896385 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076888 Oct 10 18:53:39.369941 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 486/1123] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:39.381380 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8c98d55f-9736-4ec5-83cd-86ee0f2e09f6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:39.382365 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8c98d55f-9736-4ec5-83cd-86ee0f2e09f6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:39.393459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:39.535752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8c98d55f-9736-4ec5-83cd-86ee0f2e09f6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:39.545348 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8c98d55f-9736-4ec5-83cd-86ee0f2e09f6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1215 microversion: 2.1 time: 0.173241 Oct 10 18:53:39.546127 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 487/1124] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:39 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1215 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:39.571754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-53052431-730d-45ac-82d0-0eb349b21252 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:39.573191 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-53052431-730d-45ac-82d0-0eb349b21252 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:39.579963 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53052431-730d-45ac-82d0-0eb349b21252 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:39.580689 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53052431-730d-45ac-82d0-0eb349b21252 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:39.581279 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53052431-730d-45ac-82d0-0eb349b21252 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:39.582337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53052431-730d-45ac-82d0-0eb349b21252 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:39.582945 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53052431-730d-45ac-82d0-0eb349b21252 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:39.583518 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53052431-730d-45ac-82d0-0eb349b21252 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:39.643284 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:39.749407 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2fda8b39-e957-438c-aa6b-ce16b0bfb01e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:39.774870 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2fda8b39-e957-438c-aa6b-ce16b0bfb01e tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1318 microversion: 2.1 time: 0.584925 Oct 10 18:53:39.776616 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 638/1125] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:39 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:39.805625 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b96fde02-b8a5-44a8-a937-ba058e0d4784 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:39.808654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b96fde02-b8a5-44a8-a937-ba058e0d4784 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:39.827954 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b96fde02-b8a5-44a8-a937-ba058e0d4784 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:39.831229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b96fde02-b8a5-44a8-a937-ba058e0d4784 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:39.831229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b96fde02-b8a5-44a8-a937-ba058e0d4784 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:39.831229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b96fde02-b8a5-44a8-a937-ba058e0d4784 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:39.831229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b96fde02-b8a5-44a8-a937-ba058e0d4784 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:39.831229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b96fde02-b8a5-44a8-a937-ba058e0d4784 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:39.888831 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-53052431-730d-45ac-82d0-0eb349b21252 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714/action" status: 202 len: 0 microversion: 2.25 time: 0.324060 Oct 10 18:53:39.888831 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 488/1126] 10.222.0.43 () {62 vars in 1319 bytes} [Mon Oct 10 18:53:39 2022] POST /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:39.900650 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-02885e0b-b524-4d68-9d9d-fbb21f29c447 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:39.903025 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-02885e0b-b524-4d68-9d9d-fbb21f29c447 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:39.925403 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02885e0b-b524-4d68-9d9d-fbb21f29c447 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:39.929927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02885e0b-b524-4d68-9d9d-fbb21f29c447 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:39.930408 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02885e0b-b524-4d68-9d9d-fbb21f29c447 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:39.932723 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02885e0b-b524-4d68-9d9d-fbb21f29c447 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:39.933269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02885e0b-b524-4d68-9d9d-fbb21f29c447 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:39.936668 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-02885e0b-b524-4d68-9d9d-fbb21f29c447 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:40.422990 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b96fde02-b8a5-44a8-a937-ba058e0d4784 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:40.432920 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b96fde02-b8a5-44a8-a937-ba058e0d4784 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1316 microversion: 2.1 time: 0.641745 Oct 10 18:53:40.433504 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 639/1127] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:39 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:40.439025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-54d858af-3899-448a-a5c6-64ab3cecb93e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:40.439889 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-54d858af-3899-448a-a5c6-64ab3cecb93e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:40.446484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54d858af-3899-448a-a5c6-64ab3cecb93e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:40.447261 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54d858af-3899-448a-a5c6-64ab3cecb93e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:40.447855 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54d858af-3899-448a-a5c6-64ab3cecb93e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:40.448908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54d858af-3899-448a-a5c6-64ab3cecb93e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:40.449521 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54d858af-3899-448a-a5c6-64ab3cecb93e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:40.450252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54d858af-3899-448a-a5c6-64ab3cecb93e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:40.770589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-54d858af-3899-448a-a5c6-64ab3cecb93e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:40.788057 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-54d858af-3899-448a-a5c6-64ab3cecb93e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.352776 Oct 10 18:53:40.789924 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 640/1128] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:40 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:40.805729 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b712ed80-e4de-497f-bcc2-0aeb4542bd91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:40.807748 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b712ed80-e4de-497f-bcc2-0aeb4542bd91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:40.821983 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b712ed80-e4de-497f-bcc2-0aeb4542bd91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:40.822951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b712ed80-e4de-497f-bcc2-0aeb4542bd91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:40.823927 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b712ed80-e4de-497f-bcc2-0aeb4542bd91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:40.824925 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b712ed80-e4de-497f-bcc2-0aeb4542bd91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:40.826160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b712ed80-e4de-497f-bcc2-0aeb4542bd91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:40.836389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b712ed80-e4de-497f-bcc2-0aeb4542bd91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:41.160158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b712ed80-e4de-497f-bcc2-0aeb4542bd91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:41.177938 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b712ed80-e4de-497f-bcc2-0aeb4542bd91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1219 microversion: 2.1 time: 0.386699 Oct 10 18:53:41.201892 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 641/1129] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:40 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1219 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:41.212138 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-42e4b038-60d1-4b65-b65e-badc4b4bc969 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:41.219534 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-42e4b038-60d1-4b65-b65e-badc4b4bc969 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:41.246894 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42e4b038-60d1-4b65-b65e-badc4b4bc969 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:41.247559 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42e4b038-60d1-4b65-b65e-badc4b4bc969 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:41.248153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42e4b038-60d1-4b65-b65e-badc4b4bc969 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:41.249080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42e4b038-60d1-4b65-b65e-badc4b4bc969 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:41.249696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42e4b038-60d1-4b65-b65e-badc4b4bc969 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:41.250260 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42e4b038-60d1-4b65-b65e-badc4b4bc969 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:41.350759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-02885e0b-b524-4d68-9d9d-fbb21f29c447 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid d89b360b-2f7e-4f80-9247-559c3b0cf714 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:53:41.395430 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-02885e0b-b524-4d68-9d9d-fbb21f29c447 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 2055 microversion: 2.25 time: 1.500393 Oct 10 18:53:41.397175 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 489/1130] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:39 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 2055 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:53:41.464076 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-322bf6d8-0d9c-401f-9489-cd04f556ae3d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:41.465316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-322bf6d8-0d9c-401f-9489-cd04f556ae3d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:41.480570 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-322bf6d8-0d9c-401f-9489-cd04f556ae3d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:41.483777 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-322bf6d8-0d9c-401f-9489-cd04f556ae3d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:41.483777 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-322bf6d8-0d9c-401f-9489-cd04f556ae3d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:41.483777 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-322bf6d8-0d9c-401f-9489-cd04f556ae3d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:41.493226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-322bf6d8-0d9c-401f-9489-cd04f556ae3d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:41.495041 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-322bf6d8-0d9c-401f-9489-cd04f556ae3d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:41.765421 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-42e4b038-60d1-4b65-b65e-badc4b4bc969 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:41.777085 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-42e4b038-60d1-4b65-b65e-badc4b4bc969 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1318 microversion: 2.1 time: 0.573938 Oct 10 18:53:41.780574 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 642/1131] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:41 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1318 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:41.816958 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2a1732e4-7a55-4ae3-98f5-ec790bb090e8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:41.817574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2a1732e4-7a55-4ae3-98f5-ec790bb090e8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:41.828058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a1732e4-7a55-4ae3-98f5-ec790bb090e8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:41.829635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a1732e4-7a55-4ae3-98f5-ec790bb090e8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:41.829635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a1732e4-7a55-4ae3-98f5-ec790bb090e8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:41.830542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a1732e4-7a55-4ae3-98f5-ec790bb090e8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:41.831568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a1732e4-7a55-4ae3-98f5-ec790bb090e8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:41.832327 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a1732e4-7a55-4ae3-98f5-ec790bb090e8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:41.856922 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:41.955423 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-322bf6d8-0d9c-401f-9489-cd04f556ae3d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:41.968428 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-322bf6d8-0d9c-401f-9489-cd04f556ae3d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1316 microversion: 2.1 time: 0.507015 Oct 10 18:53:41.969108 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 490/1132] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:41 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:42.071122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2a1732e4-7a55-4ae3-98f5-ec790bb090e8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:42.080041 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2a1732e4-7a55-4ae3-98f5-ec790bb090e8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.268587 Oct 10 18:53:42.080957 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 643/1133] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:41 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:53:42.208232 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0d71c806-f848-44fc-9c28-e98ec3c047be tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:42.209932 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0d71c806-f848-44fc-9c28-e98ec3c047be tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:42.217116 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d71c806-f848-44fc-9c28-e98ec3c047be tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:42.226218 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d71c806-f848-44fc-9c28-e98ec3c047be tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:42.226880 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d71c806-f848-44fc-9c28-e98ec3c047be tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:42.227785 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d71c806-f848-44fc-9c28-e98ec3c047be tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:42.229033 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d71c806-f848-44fc-9c28-e98ec3c047be tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:42.229658 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d71c806-f848-44fc-9c28-e98ec3c047be tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:42.320616 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0d71c806-f848-44fc-9c28-e98ec3c047be tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:42.331949 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0d71c806-f848-44fc-9c28-e98ec3c047be tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1267 microversion: 2.1 time: 0.127344 Oct 10 18:53:42.334496 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 491/1134] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:42 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1267 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:42.430963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7aefb9de-fdc7-420d-b9be-2b6ea9d15a6a tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:42.431634 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7aefb9de-fdc7-420d-b9be-2b6ea9d15a6a tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:42.438518 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7aefb9de-fdc7-420d-b9be-2b6ea9d15a6a tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:42.439004 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7aefb9de-fdc7-420d-b9be-2b6ea9d15a6a tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:42.439456 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7aefb9de-fdc7-420d-b9be-2b6ea9d15a6a tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:42.440158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7aefb9de-fdc7-420d-b9be-2b6ea9d15a6a tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:42.440676 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7aefb9de-fdc7-420d-b9be-2b6ea9d15a6a tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:42.441027 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7aefb9de-fdc7-420d-b9be-2b6ea9d15a6a tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:42.714465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-7aefb9de-fdc7-420d-b9be-2b6ea9d15a6a tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid d89b360b-2f7e-4f80-9247-559c3b0cf714 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:53:42.737303 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7aefb9de-fdc7-420d-b9be-2b6ea9d15a6a tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 2035 microversion: 2.25 time: 0.311126 Oct 10 18:53:42.738860 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 644/1135] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:42 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 2035 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:42.763954 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-128e77b0-8d13-4ebc-b05d-98afe1aa83cd tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860863-1", "block_migration": "auto"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:42.767108 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-128e77b0-8d13-4ebc-b05d-98afe1aa83cd tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:42.773527 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-128e77b0-8d13-4ebc-b05d-98afe1aa83cd tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:42.774252 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-128e77b0-8d13-4ebc-b05d-98afe1aa83cd tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:42.774869 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-128e77b0-8d13-4ebc-b05d-98afe1aa83cd tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:42.776324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-128e77b0-8d13-4ebc-b05d-98afe1aa83cd tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:42.776977 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-128e77b0-8d13-4ebc-b05d-98afe1aa83cd tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:42.777606 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-128e77b0-8d13-4ebc-b05d-98afe1aa83cd tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:42.806111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fb554c7d-01e4-4344-b937-bd7bb8b70579 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:42.807598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fb554c7d-01e4-4344-b937-bd7bb8b70579 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:42.823099 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb554c7d-01e4-4344-b937-bd7bb8b70579 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:42.825823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb554c7d-01e4-4344-b937-bd7bb8b70579 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:42.827143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb554c7d-01e4-4344-b937-bd7bb8b70579 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:42.829222 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb554c7d-01e4-4344-b937-bd7bb8b70579 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:42.831311 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb554c7d-01e4-4344-b937-bd7bb8b70579 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:42.832081 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb554c7d-01e4-4344-b937-bd7bb8b70579 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:42.836718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-128e77b0-8d13-4ebc-b05d-98afe1aa83cd tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'flavor' on Instance uuid d89b360b-2f7e-4f80-9247-559c3b0cf714 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:53:42.866245 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-128e77b0-8d13-4ebc-b05d-98afe1aa83cd tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Going to try to live migrate instance to n-h2-860863-1 {{(pid=127289) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 18:53:43.041840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fb554c7d-01e4-4344-b937-bd7bb8b70579 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:43.052796 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fb554c7d-01e4-4344-b937-bd7bb8b70579 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1318 microversion: 2.1 time: 0.253012 Oct 10 18:53:43.053992 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 645/1136] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:42 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:53:43.061111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4b9a9c0e-6000-413b-9d0d-47973b274d9e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:43.062190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4b9a9c0e-6000-413b-9d0d-47973b274d9e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:43.120305 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b9a9c0e-6000-413b-9d0d-47973b274d9e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:43.125129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b9a9c0e-6000-413b-9d0d-47973b274d9e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:43.126119 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b9a9c0e-6000-413b-9d0d-47973b274d9e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:43.130160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b9a9c0e-6000-413b-9d0d-47973b274d9e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:43.130160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b9a9c0e-6000-413b-9d0d-47973b274d9e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:43.130160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b9a9c0e-6000-413b-9d0d-47973b274d9e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:43.377509 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4b9a9c0e-6000-413b-9d0d-47973b274d9e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:43.389083 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4b9a9c0e-6000-413b-9d0d-47973b274d9e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1466 microversion: 2.1 time: 0.332790 Oct 10 18:53:43.390376 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 646/1137] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:43 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1466 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:43.396131 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-5e45053c-c602-46d4-acd9-fef64e487fb4 req-b35de043-31bc-4e78-81b2-42d2b2543819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367f9726-b32e-4ce6-94f8-b4075d746833", "name": "network-vif-plugged", "status": "completed", "tag": "78998a37-aff7-4723-9b60-bfb50a9adb5d"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:43.423219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5e45053c-c602-46d4-acd9-fef64e487fb4 req-b35de043-31bc-4e78-81b2-42d2b2543819 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:43.424189 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5e45053c-c602-46d4-acd9-fef64e487fb4 req-b35de043-31bc-4e78-81b2-42d2b2543819 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:43.426356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5e45053c-c602-46d4-acd9-fef64e487fb4 req-b35de043-31bc-4e78-81b2-42d2b2543819 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:43.445695 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-5e45053c-c602-46d4-acd9-fef64e487fb4 req-b35de043-31bc-4e78-81b2-42d2b2543819 service nova] Creating event network-vif-plugged:78998a37-aff7-4723-9b60-bfb50a9adb5d for instance 367f9726-b32e-4ce6-94f8-b4075d746833 on n-h1-860863-1 Oct 10 18:53:43.454709 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-5e45053c-c602-46d4-acd9-fef64e487fb4 req-b35de043-31bc-4e78-81b2-42d2b2543819 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062399 Oct 10 18:53:43.459059 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 647/1138] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:43.466985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e02697d6-bd90-44c8-868e-0f2cd2ec0a95 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:43.468139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e02697d6-bd90-44c8-868e-0f2cd2ec0a95 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:43.505755 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e02697d6-bd90-44c8-868e-0f2cd2ec0a95 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:43.506264 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e02697d6-bd90-44c8-868e-0f2cd2ec0a95 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:43.508875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e02697d6-bd90-44c8-868e-0f2cd2ec0a95 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:43.509602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e02697d6-bd90-44c8-868e-0f2cd2ec0a95 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:43.510976 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e02697d6-bd90-44c8-868e-0f2cd2ec0a95 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:43.512316 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e02697d6-bd90-44c8-868e-0f2cd2ec0a95 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:43.736999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e02697d6-bd90-44c8-868e-0f2cd2ec0a95 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:43.742189 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e02697d6-bd90-44c8-868e-0f2cd2ec0a95 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.280463 Oct 10 18:53:43.757570 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 648/1139] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:43 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:43.763423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b2a07f47-9b9a-4304-a074-58f5c3723c05 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:43.764157 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b2a07f47-9b9a-4304-a074-58f5c3723c05 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:43.770845 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2a07f47-9b9a-4304-a074-58f5c3723c05 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:43.770845 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2a07f47-9b9a-4304-a074-58f5c3723c05 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:43.771324 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2a07f47-9b9a-4304-a074-58f5c3723c05 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:43.772574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2a07f47-9b9a-4304-a074-58f5c3723c05 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:43.772574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2a07f47-9b9a-4304-a074-58f5c3723c05 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:43.773183 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2a07f47-9b9a-4304-a074-58f5c3723c05 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:43.887865 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b2a07f47-9b9a-4304-a074-58f5c3723c05 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:43.899726 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b2a07f47-9b9a-4304-a074-58f5c3723c05 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1273 microversion: 2.1 time: 0.140173 Oct 10 18:53:43.901167 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 649/1140] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:43 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:43.909076 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1a8b37cd-4311-46d7-9906-8da61b8eba73 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:43.915450 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1a8b37cd-4311-46d7-9906-8da61b8eba73 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:43.925162 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a8b37cd-4311-46d7-9906-8da61b8eba73 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:43.927795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a8b37cd-4311-46d7-9906-8da61b8eba73 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:43.930570 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a8b37cd-4311-46d7-9906-8da61b8eba73 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:43.931851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a8b37cd-4311-46d7-9906-8da61b8eba73 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:43.934843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a8b37cd-4311-46d7-9906-8da61b8eba73 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:43.935836 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a8b37cd-4311-46d7-9906-8da61b8eba73 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:44.123047 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1a8b37cd-4311-46d7-9906-8da61b8eba73 tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1617 microversion: 2.1 time: 0.220467 Oct 10 18:53:44.123759 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 650/1141] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:43 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1617 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:44.128795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-562632914", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "ba4a18b8-9531-4729-9069-fa4abbd83a44"}], "security_groups": [{"name": "tempest-securitygroup--1059623132"}], "key_name": "tempest-keypair-597174242", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:44.271442 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] validate_networks() for [('ba4a18b8-9531-4729-9069-fa4abbd83a44', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:53:44.880684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:53:44.881443 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:53:44.882106 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:53:44.883187 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:53:44.883802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:53:44.897169 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:44.897823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:44.898034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:44.899078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:44.899340 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:44.899766 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:44.921269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Getting quotas for project 92d05639af8046dd87fe6973ff26f161. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:44.926063 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Getting quotas for user abed6abc941a421682af5e3f5df98040 and project 92d05639af8046dd87fe6973ff26f161. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:44.938857 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:53:44.941170 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:53:44.953325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:45.099025 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0d8e4ae1-658f-40a2-b31d-a60a3ec6aa11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.973797 Oct 10 18:53:45.104063 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 651/1142] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:53:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:53:45.114428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1989a00a-0600-428e-860f-202a69c27bbf tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:45.115351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1989a00a-0600-428e-860f-202a69c27bbf tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:45.123693 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1989a00a-0600-428e-860f-202a69c27bbf tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:45.124605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1989a00a-0600-428e-860f-202a69c27bbf tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:45.125451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1989a00a-0600-428e-860f-202a69c27bbf tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:45.126413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1989a00a-0600-428e-860f-202a69c27bbf tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:45.127982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1989a00a-0600-428e-860f-202a69c27bbf tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:45.128914 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1989a00a-0600-428e-860f-202a69c27bbf tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:45.288809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1989a00a-0600-428e-860f-202a69c27bbf tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:45.298083 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1989a00a-0600-428e-860f-202a69c27bbf tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1318 microversion: 2.1 time: 0.190719 Oct 10 18:53:45.299050 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 652/1143] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:45 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:45.573975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-009f11a7-26ed-4bb7-9b48-1d105e695bf9 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Action: 'create', calling method: .version_select at 0x7f31923781f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2046146119", "description": "tempest-description-1874538347"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:45.966146 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-009f11a7-26ed-4bb7-9b48-1d105e695bf9 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.665412 Oct 10 18:53:45.979748 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 653/1144] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:53:45 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:45.986265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1129606871", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["1bbc9663-3d8f-4bdf-a8a3-9398530d7415"]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:46.078300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] validate_networks() for None {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:53:46.208321 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-128e77b0-8d13-4ebc-b05d-98afe1aa83cd tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714/action" status: 202 len: 0 microversion: 2.25 time: 3.448667 Oct 10 18:53:46.211943 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 492/1145] 10.222.0.43 () {62 vars in 1319 bytes} [Mon Oct 10 18:53:42 2022] POST /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714/action => generated 0 bytes in 3451 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:46.346263 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d7da2ad4-a225-45f3-b86f-b1e10fdb3f9c tempest-AZV2TestJSON-1238031396 tempest-AZV2TestJSON-1238031396-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:46.348030 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d7da2ad4-a225-45f3-b86f-b1e10fdb3f9c tempest-AZV2TestJSON-1238031396 tempest-AZV2TestJSON-1238031396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:46.348818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d7da2ad4-a225-45f3-b86f-b1e10fdb3f9c tempest-AZV2TestJSON-1238031396 tempest-AZV2TestJSON-1238031396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:46.349535 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d7da2ad4-a225-45f3-b86f-b1e10fdb3f9c tempest-AZV2TestJSON-1238031396 tempest-AZV2TestJSON-1238031396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:46.350515 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d7da2ad4-a225-45f3-b86f-b1e10fdb3f9c tempest-AZV2TestJSON-1238031396 tempest-AZV2TestJSON-1238031396-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:46.351232 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d7da2ad4-a225-45f3-b86f-b1e10fdb3f9c tempest-AZV2TestJSON-1238031396 tempest-AZV2TestJSON-1238031396-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:46.352126 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d7da2ad4-a225-45f3-b86f-b1e10fdb3f9c tempest-AZV2TestJSON-1238031396 tempest-AZV2TestJSON-1238031396-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:46.373340 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:53:46.373803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:53:46.374453 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:53:46.388598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:53:46.388598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:53:46.388598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:46.388598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:46.388598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:46.388598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:46.388598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:46.388598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:46.392166 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d7da2ad4-a225-45f3-b86f-b1e10fdb3f9c tempest-AZV2TestJSON-1238031396 tempest-AZV2TestJSON-1238031396-project] 10.222.0.43 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.181080 Oct 10 18:53:46.392875 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 493/1146] 10.222.0.43 () {58 vars in 1164 bytes} [Mon Oct 10 18:53:46 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:53:46.404801 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6adb6293-8f96-4f35-af35-b6cc26f34409 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:46.405805 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6adb6293-8f96-4f35-af35-b6cc26f34409 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:46.412741 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6adb6293-8f96-4f35-af35-b6cc26f34409 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:46.413546 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6adb6293-8f96-4f35-af35-b6cc26f34409 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:46.413906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:53:46.414458 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6adb6293-8f96-4f35-af35-b6cc26f34409 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:46.415701 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6adb6293-8f96-4f35-af35-b6cc26f34409 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:46.417718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6adb6293-8f96-4f35-af35-b6cc26f34409 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:46.418382 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6adb6293-8f96-4f35-af35-b6cc26f34409 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:46.420308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:53:46.435427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:53:46.438593 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:53:46.655817 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5cd31076-cdf1-455c-b361-238d5fe32700 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673226 Oct 10 18:53:46.657211 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 654/1147] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:53:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:53:46.662646 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f18be2e7-a4ec-48ac-94c1-a142958ce08a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:46.663985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f18be2e7-a4ec-48ac-94c1-a142958ce08a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:46.677912 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f18be2e7-a4ec-48ac-94c1-a142958ce08a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:46.681746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f18be2e7-a4ec-48ac-94c1-a142958ce08a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:46.684507 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f18be2e7-a4ec-48ac-94c1-a142958ce08a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:46.686032 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f18be2e7-a4ec-48ac-94c1-a142958ce08a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:46.686672 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f18be2e7-a4ec-48ac-94c1-a142958ce08a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:46.688569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f18be2e7-a4ec-48ac-94c1-a142958ce08a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:46.780125 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6adb6293-8f96-4f35-af35-b6cc26f34409 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:46.792568 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6adb6293-8f96-4f35-af35-b6cc26f34409 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.398301 Oct 10 18:53:46.814487 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 494/1148] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:46 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:46.821197 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d49b22a7-259c-4a79-9292-3952538d19d7 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:46.828816 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d49b22a7-259c-4a79-9292-3952538d19d7 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:46.833886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d49b22a7-259c-4a79-9292-3952538d19d7 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:46.835680 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d49b22a7-259c-4a79-9292-3952538d19d7 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:46.848124 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d49b22a7-259c-4a79-9292-3952538d19d7 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:46.850545 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d49b22a7-259c-4a79-9292-3952538d19d7 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:46.858683 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d49b22a7-259c-4a79-9292-3952538d19d7 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:46.860441 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d49b22a7-259c-4a79-9292-3952538d19d7 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:46.985406 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d49b22a7-259c-4a79-9292-3952538d19d7 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:47.002330 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d49b22a7-259c-4a79-9292-3952538d19d7 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1244 microversion: 2.1 time: 0.183800 Oct 10 18:53:47.002330 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 495/1149] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:46 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1244 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:47.006302 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-79e5df33-5444-4f50-9d39-b8403155387b tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Action: 'create', calling method: .version_select at 0x7f318dd72c10>, body: {"security_group_rule": {"parent_group_id": "b16d63a5-3297-428b-9300-18019b906ab2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:47.141838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f18be2e7-a4ec-48ac-94c1-a142958ce08a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:47.154421 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f18be2e7-a4ec-48ac-94c1-a142958ce08a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1315 microversion: 2.1 time: 0.495651 Oct 10 18:53:47.155013 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 655/1150] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:46 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:47.159912 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-c1d44702-e532-4e15-a382-30ca6eab6d71 req-175ee91e-3e01-4dba-8ba2-8d00a6e3933e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4812966e-0f45-4261-bf1d-99e46ebab1ac", "tag": "a67b1ca6-1605-4592-8d8e-0973c5d12f86"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:47.176133 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c1d44702-e532-4e15-a382-30ca6eab6d71 req-175ee91e-3e01-4dba-8ba2-8d00a6e3933e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:47.176627 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c1d44702-e532-4e15-a382-30ca6eab6d71 req-175ee91e-3e01-4dba-8ba2-8d00a6e3933e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:47.177063 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c1d44702-e532-4e15-a382-30ca6eab6d71 req-175ee91e-3e01-4dba-8ba2-8d00a6e3933e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:47.189349 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-c1d44702-e532-4e15-a382-30ca6eab6d71 req-175ee91e-3e01-4dba-8ba2-8d00a6e3933e service nova] Creating event network-changed:a67b1ca6-1605-4592-8d8e-0973c5d12f86 for instance 4812966e-0f45-4261-bf1d-99e46ebab1ac on n-h2-860863-1 Oct 10 18:53:47.195824 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-c1d44702-e532-4e15-a382-30ca6eab6d71 req-175ee91e-3e01-4dba-8ba2-8d00a6e3933e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038574 Oct 10 18:53:47.202682 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 656/1151] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:47.209172 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3ac8b8f9-4b43-4a9c-bc81-0bb4dab1baeb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:47.210048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3ac8b8f9-4b43-4a9c-bc81-0bb4dab1baeb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:47.216682 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3ac8b8f9-4b43-4a9c-bc81-0bb4dab1baeb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:47.217422 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3ac8b8f9-4b43-4a9c-bc81-0bb4dab1baeb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:47.217848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3ac8b8f9-4b43-4a9c-bc81-0bb4dab1baeb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:47.218734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3ac8b8f9-4b43-4a9c-bc81-0bb4dab1baeb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:47.219348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3ac8b8f9-4b43-4a9c-bc81-0bb4dab1baeb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:47.220142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3ac8b8f9-4b43-4a9c-bc81-0bb4dab1baeb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:47.432339 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3ac8b8f9-4b43-4a9c-bc81-0bb4dab1baeb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:47.436408 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3ac8b8f9-4b43-4a9c-bc81-0bb4dab1baeb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:47.437832 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3ac8b8f9-4b43-4a9c-bc81-0bb4dab1baeb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:47.439033 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3ac8b8f9-4b43-4a9c-bc81-0bb4dab1baeb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1567 microversion: 2.25 time: 0.235030 Oct 10 18:53:47.439822 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 657/1152] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:47 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:47.444730 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c835329b-9d21-4981-a80b-9aa2b4e3f9a8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:47.446525 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c835329b-9d21-4981-a80b-9aa2b4e3f9a8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:47.452024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c835329b-9d21-4981-a80b-9aa2b4e3f9a8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:47.452565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c835329b-9d21-4981-a80b-9aa2b4e3f9a8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:47.453155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c835329b-9d21-4981-a80b-9aa2b4e3f9a8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:47.454178 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c835329b-9d21-4981-a80b-9aa2b4e3f9a8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:47.454833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c835329b-9d21-4981-a80b-9aa2b4e3f9a8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:47.455521 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c835329b-9d21-4981-a80b-9aa2b4e3f9a8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:47.618328 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-79e5df33-5444-4f50-9d39-b8403155387b tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.616144 Oct 10 18:53:47.621331 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 496/1153] 10.222.0.43 () {60 vars in 1195 bytes} [Mon Oct 10 18:53:47 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:47.628836 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3237cafa-cc00-467e-b32c-a4c398d05362 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:47.629496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3237cafa-cc00-467e-b32c-a4c398d05362 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:47.713493 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c835329b-9d21-4981-a80b-9aa2b4e3f9a8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:47.718961 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3237cafa-cc00-467e-b32c-a4c398d05362 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:47.722474 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c835329b-9d21-4981-a80b-9aa2b4e3f9a8 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1468 microversion: 2.1 time: 0.281224 Oct 10 18:53:47.723058 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 658/1154] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:47 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1468 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:47.729022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a9d71fdd-3b06-4df8-ac1f-c6aa959c04e0 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Action: 'create', calling method: .version_select at 0x7f31923574c0>, body: {"security_group_rule": {"parent_group_id": "b16d63a5-3297-428b-9300-18019b906ab2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:47.731436 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3237cafa-cc00-467e-b32c-a4c398d05362 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1217 microversion: 2.1 time: 0.108169 Oct 10 18:53:47.737414 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 497/1155] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:47 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:47.748504 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cab0b20d-496f-4537-9fa4-6104f597b71c tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:47.749070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cab0b20d-496f-4537-9fa4-6104f597b71c tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:47.755985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cab0b20d-496f-4537-9fa4-6104f597b71c tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:47.756864 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cab0b20d-496f-4537-9fa4-6104f597b71c tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:47.757483 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cab0b20d-496f-4537-9fa4-6104f597b71c tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:47.758348 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cab0b20d-496f-4537-9fa4-6104f597b71c tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:47.759075 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cab0b20d-496f-4537-9fa4-6104f597b71c tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:47.759700 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cab0b20d-496f-4537-9fa4-6104f597b71c tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:47.783567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-cab0b20d-496f-4537-9fa4-6104f597b71c tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lazy-loading 'flavor' on Instance uuid 367f9726-b32e-4ce6-94f8-b4075d746833 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:53:47.787147 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-a9d71fdd-3b06-4df8-ac1f-c6aa959c04e0 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] HTTP exception thrown: This rule already exists in group b16d63a5-3297-428b-9300-18019b906ab2 Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a9d71fdd-3b06-4df8-ac1f-c6aa959c04e0 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Request method failure captured: Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 138 Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGo3H_y3mIWdbbnY-CK-yJDis3AlywJ9lJ263VJ43rKbhW4Per3riHRn9-yaiR7JI-3NkiSh3ODMLgVezFFy9CCpTJwVwJlQFCIxygQ1mgkcMo0aEMjfI014MiooJu4p6x72UYhe1HiNjqaJFcBLKW-C27GElI4eaI3Dm0y2-urBYKk Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_20f37e65bfc84d2781cc3782389f620b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}] Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 82b78e5887e34cfc9f1a15977fe683cc Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: {"security_group_rule": {"parent_group_id": "b16d63a5-3297-428b-9300-18019b906ab2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: exception: This rule already exists in group b16d63a5-3297-428b-9300-18019b906ab2 Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b16d63a5-3297-428b-9300-18019b906ab2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group b16d63a5-3297-428b-9300-18019b906ab2 Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group b16d63a5-3297-428b-9300-18019b906ab2 Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:47.789692 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:47.799727 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:47.799727 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:47.799727 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group b16d63a5-3297-428b-9300-18019b906ab2 Oct 10 18:53:47.799727 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:47.799727 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a9d71fdd-3b06-4df8-ac1f-c6aa959c04e0 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Returning 400 to user: This rule already exists in group b16d63a5-3297-428b-9300-18019b906ab2 {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:47.799727 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a9d71fdd-3b06-4df8-ac1f-c6aa959c04e0 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.067834 Oct 10 18:53:47.799727 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 659/1156] 10.222.0.43 () {60 vars in 1195 bytes} [Mon Oct 10 18:53:47 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:53:47.802362 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-031cb823-4665-412f-b975-c6f97201d23d tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Calling method '.version_select at 0x7f31922f98b0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:47.995513 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-031cb823-4665-412f-b975-c6f97201d23d tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/f370a3d1-f1e6-43ba-b9ad-5637e4c0d765" status: 202 len: 0 microversion: 2.1 time: 0.197805 Oct 10 18:53:47.996076 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 660/1157] 10.222.0.43 () {58 vars in 1287 bytes} [Mon Oct 10 18:53:47 2022] DELETE /compute/v2.1/os-security-group-rules/f370a3d1-f1e6-43ba-b9ad-5637e4c0d765 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:48.003700 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2c4e845c-af8d-4098-995b-a4a4d5841fa3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:48.004336 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2c4e845c-af8d-4098-995b-a4a4d5841fa3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:48.013498 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c4e845c-af8d-4098-995b-a4a4d5841fa3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:48.013498 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c4e845c-af8d-4098-995b-a4a4d5841fa3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:48.013903 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c4e845c-af8d-4098-995b-a4a4d5841fa3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:48.014491 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c4e845c-af8d-4098-995b-a4a4d5841fa3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:48.014956 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c4e845c-af8d-4098-995b-a4a4d5841fa3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:48.015571 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c4e845c-af8d-4098-995b-a4a4d5841fa3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:48.018114 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cab0b20d-496f-4537-9fa4-6104f597b71c tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833/action" status: 202 len: 0 microversion: 2.1 time: 0.273289 Oct 10 18:53:48.022280 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 498/1158] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:53:47 2022] POST /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 18:53:48.026491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d16be55a-c278-47d5-9b2e-9be9347cb222 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Action: 'create', calling method: .version_select at 0x7f318dd2bc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-231026287", "description": "tempest-description-741533427"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:48.151942 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2c4e845c-af8d-4098-995b-a4a4d5841fa3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:48.161369 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2c4e845c-af8d-4098-995b-a4a4d5841fa3 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.164146 Oct 10 18:53:48.172252 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 661/1159] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:47 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:48.172252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4051f10e-3d2a-4e67-afa0-9cffe1fd3d2b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:48.172252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4051f10e-3d2a-4e67-afa0-9cffe1fd3d2b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:48.174920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4051f10e-3d2a-4e67-afa0-9cffe1fd3d2b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:48.175050 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4051f10e-3d2a-4e67-afa0-9cffe1fd3d2b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:48.175451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4051f10e-3d2a-4e67-afa0-9cffe1fd3d2b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:48.176397 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4051f10e-3d2a-4e67-afa0-9cffe1fd3d2b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:48.177037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4051f10e-3d2a-4e67-afa0-9cffe1fd3d2b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:48.177623 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4051f10e-3d2a-4e67-afa0-9cffe1fd3d2b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:48.294489 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4051f10e-3d2a-4e67-afa0-9cffe1fd3d2b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:48.306693 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4051f10e-3d2a-4e67-afa0-9cffe1fd3d2b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1236 microversion: 2.1 time: 0.142272 Oct 10 18:53:48.308435 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 662/1160] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:48 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1236 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:48.315798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6bfef57b-02b0-4b32-b297-9692169c58eb tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:48.316404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6bfef57b-02b0-4b32-b297-9692169c58eb tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:48.336998 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6bfef57b-02b0-4b32-b297-9692169c58eb tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:48.337641 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6bfef57b-02b0-4b32-b297-9692169c58eb tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:48.338667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6bfef57b-02b0-4b32-b297-9692169c58eb tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:48.339465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6bfef57b-02b0-4b32-b297-9692169c58eb tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:48.340026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6bfef57b-02b0-4b32-b297-9692169c58eb tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:48.342521 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6bfef57b-02b0-4b32-b297-9692169c58eb tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:48.550404 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d16be55a-c278-47d5-9b2e-9be9347cb222 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.529373 Oct 10 18:53:48.560229 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 499/1161] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:53:48 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:48.565144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f341d370-bb74-441c-8373-a59e5f7c4292 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:48.565871 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f341d370-bb74-441c-8373-a59e5f7c4292 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:48.579277 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f341d370-bb74-441c-8373-a59e5f7c4292 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:48.588822 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f341d370-bb74-441c-8373-a59e5f7c4292 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:48.589764 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f341d370-bb74-441c-8373-a59e5f7c4292 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:48.590826 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f341d370-bb74-441c-8373-a59e5f7c4292 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:48.592215 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f341d370-bb74-441c-8373-a59e5f7c4292 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:48.593389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f341d370-bb74-441c-8373-a59e5f7c4292 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:48.662754 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6bfef57b-02b0-4b32-b297-9692169c58eb tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:48.672819 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6bfef57b-02b0-4b32-b297-9692169c58eb tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1476 microversion: 2.1 time: 0.360277 Oct 10 18:53:48.688413 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 663/1162] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:48 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1476 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:48.714608 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-257cd2f4-14eb-4002-8a95-e9a0b96a0799 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:48.715519 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-257cd2f4-14eb-4002-8a95-e9a0b96a0799 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:48.733345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-257cd2f4-14eb-4002-8a95-e9a0b96a0799 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:48.734919 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-257cd2f4-14eb-4002-8a95-e9a0b96a0799 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:48.737764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-257cd2f4-14eb-4002-8a95-e9a0b96a0799 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:48.738635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-257cd2f4-14eb-4002-8a95-e9a0b96a0799 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:48.739225 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-257cd2f4-14eb-4002-8a95-e9a0b96a0799 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:48.743581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-257cd2f4-14eb-4002-8a95-e9a0b96a0799 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:49.102244 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f341d370-bb74-441c-8373-a59e5f7c4292 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:49.111058 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f341d370-bb74-441c-8373-a59e5f7c4292 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1315 microversion: 2.1 time: 0.549487 Oct 10 18:53:49.131071 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 500/1163] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:48 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:49.136312 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cdb69d76-0458-4c58-8235-4bf3c1beb040 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Action: 'create', calling method: .version_select at 0x7f318dd2bf70>, body: {"security_group_rule": {"parent_group_id": "6a038e47-a941-4a59-bd76-885db1d34e3e", "ip_protocol": "tcp", "from_port": 1955378777, "to_port": 22}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:49.170778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-257cd2f4-14eb-4002-8a95-e9a0b96a0799 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:49.192809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-257cd2f4-14eb-4002-8a95-e9a0b96a0799 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:49.196661 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-257cd2f4-14eb-4002-8a95-e9a0b96a0799 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:49.198351 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-257cd2f4-14eb-4002-8a95-e9a0b96a0799 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1567 microversion: 2.25 time: 0.507607 Oct 10 18:53:49.199425 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 664/1164] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:48 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1567 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:49.218256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4ffb5b73-6c2c-4a93-8d07-ddc98ae18615 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:49.221320 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4ffb5b73-6c2c-4a93-8d07-ddc98ae18615 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:49.236018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ffb5b73-6c2c-4a93-8d07-ddc98ae18615 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:49.237505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ffb5b73-6c2c-4a93-8d07-ddc98ae18615 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:49.238207 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ffb5b73-6c2c-4a93-8d07-ddc98ae18615 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:49.239156 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ffb5b73-6c2c-4a93-8d07-ddc98ae18615 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:49.240116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ffb5b73-6c2c-4a93-8d07-ddc98ae18615 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:49.241072 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ffb5b73-6c2c-4a93-8d07-ddc98ae18615 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:49.246693 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-cdb69d76-0458-4c58-8235-4bf3c1beb040 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] HTTP exception thrown: Invalid port range 1955378777:22. Former value cannot be greater than the later Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cdb69d76-0458-4c58-8235-4bf3c1beb040 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Request method failure captured: Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 146 Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGo3H_y3mIWdbbnY-CK-yJDis3AlywJ9lJ263VJ43rKbhW4Per3riHRn9-yaiR7JI-3NkiSh3ODMLgVezFFy9CCpTJwVwJlQFCIxygQ1mgkcMo0aEMjfI014MiooJu4p6x72UYhe1HiNjqaJFcBLKW-C27GElI4eaI3Dm0y2-urBYKk Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_20f37e65bfc84d2781cc3782389f620b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}] Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 82b78e5887e34cfc9f1a15977fe683cc Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: {"security_group_rule": {"parent_group_id": "6a038e47-a941-4a59-bd76-885db1d34e3e", "ip_protocol": "tcp", "from_port": 1955378777, "to_port": 22}} Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: exception: Invalid port range 1955378777:22. Former value cannot be greater than the later Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6a038e47-a941-4a59-bd76-885db1d34e3e', 'ip_protocol': 'tcp', 'from_port': 1955378777, 'to_port': 22}}} Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1955378777:22. Former value cannot be greater than the later Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1955378777:22. Former value cannot be greater than the later Oct 10 18:53:49.248706 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:49.252888 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:49.252888 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:49.252888 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:49.252888 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:49.252888 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:49.252888 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:49.252888 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:49.252888 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1955378777:22. Former value cannot be greater than the later Oct 10 18:53:49.252888 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:49.254985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cdb69d76-0458-4c58-8235-4bf3c1beb040 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Returning 400 to user: Invalid port range 1955378777:22. Former value cannot be greater than the later {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:49.256169 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cdb69d76-0458-4c58-8235-4bf3c1beb040 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.123895 Oct 10 18:53:49.261424 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 501/1165] 10.222.0.43 () {60 vars in 1195 bytes} [Mon Oct 10 18:53:49 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:53:49.263470 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:49.269595 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7713a2be-aac4-4641-b9d3-e5a6929383c8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:49.270452 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7713a2be-aac4-4641-b9d3-e5a6929383c8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:49.286146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7713a2be-aac4-4641-b9d3-e5a6929383c8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:49.287021 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7713a2be-aac4-4641-b9d3-e5a6929383c8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:49.287552 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7713a2be-aac4-4641-b9d3-e5a6929383c8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:49.288508 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7713a2be-aac4-4641-b9d3-e5a6929383c8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:49.288972 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7713a2be-aac4-4641-b9d3-e5a6929383c8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:49.289450 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7713a2be-aac4-4641-b9d3-e5a6929383c8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:49.518470 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7713a2be-aac4-4641-b9d3-e5a6929383c8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:49.539918 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7713a2be-aac4-4641-b9d3-e5a6929383c8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.270942 Oct 10 18:53:49.541151 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 502/1166] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:49 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:49.555864 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0e3a92a4-97e8-4203-9e2b-bc22776bb79a tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Action: 'create', calling method: .version_select at 0x7f318de4e4c0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1810149071", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-0e3a92a4-97e8-4203-9e2b-bc22776bb79a tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] HTTP exception thrown: Security group id should be uuid Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0e3a92a4-97e8-4203-9e2b-bc22776bb79a tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Request method failure captured: Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 131 Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGo3H_y3mIWdbbnY-CK-yJDis3AlywJ9lJ263VJ43rKbhW4Per3riHRn9-yaiR7JI-3NkiSh3ODMLgVezFFy9CCpTJwVwJlQFCIxygQ1mgkcMo0aEMjfI014MiooJu4p6x72UYhe1HiNjqaJFcBLKW-C27GElI4eaI3Dm0y2-urBYKk Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_20f37e65bfc84d2781cc3782389f620b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}] Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 82b78e5887e34cfc9f1a15977fe683cc Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1810149071", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: exception: Security group id should be uuid Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1810149071', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:49.560905 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:49.565155 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:49.565155 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:49.565155 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:49.565155 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 10 18:53:49.565155 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:49.565155 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0e3a92a4-97e8-4203-9e2b-bc22776bb79a tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Returning 400 to user: Security group id should be uuid {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:49.567372 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0e3a92a4-97e8-4203-9e2b-bc22776bb79a tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.019561 Oct 10 18:53:49.568170 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 503/1167] 10.222.0.43 () {60 vars in 1195 bytes} [Mon Oct 10 18:53:49 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 18:53:49.574493 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c569f800-2990-4cff-8e0b-535909b3078f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:49.575379 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c569f800-2990-4cff-8e0b-535909b3078f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:49.585190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c569f800-2990-4cff-8e0b-535909b3078f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:49.586084 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4ffb5b73-6c2c-4a93-8d07-ddc98ae18615 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:49.587708 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c569f800-2990-4cff-8e0b-535909b3078f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:49.589205 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c569f800-2990-4cff-8e0b-535909b3078f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:49.590588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c569f800-2990-4cff-8e0b-535909b3078f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:49.591446 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c569f800-2990-4cff-8e0b-535909b3078f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:49.592226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c569f800-2990-4cff-8e0b-535909b3078f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:49.604401 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4ffb5b73-6c2c-4a93-8d07-ddc98ae18615 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1269 microversion: 2.1 time: 0.392956 Oct 10 18:53:49.605026 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 665/1168] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:49 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1269 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:49.610490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-11d27c43-1c49-4df8-9d33-7c816a94f30b tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Action: 'create', calling method: .version_select at 0x7f318e7a7040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1285199341", "description": "tempest-description-225874599"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:49.686432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c569f800-2990-4cff-8e0b-535909b3078f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:49.702497 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c569f800-2990-4cff-8e0b-535909b3078f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1292 microversion: 2.1 time: 0.132928 Oct 10 18:53:49.703136 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 504/1169] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:49 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1292 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:49.709384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1530f2a2-70e2-4b91-8108-2191ed635377 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:49.710327 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1530f2a2-70e2-4b91-8108-2191ed635377 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:49.718413 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1530f2a2-70e2-4b91-8108-2191ed635377 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:49.718896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1530f2a2-70e2-4b91-8108-2191ed635377 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:49.719540 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1530f2a2-70e2-4b91-8108-2191ed635377 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:49.720336 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1530f2a2-70e2-4b91-8108-2191ed635377 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:49.720931 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1530f2a2-70e2-4b91-8108-2191ed635377 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:49.721501 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1530f2a2-70e2-4b91-8108-2191ed635377 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:50.238312 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-11d27c43-1c49-4df8-9d33-7c816a94f30b tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.631867 Oct 10 18:53:50.239592 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 666/1170] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:53:49 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:50.245802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-901eb227-61d0-42de-8e45-126caf0e765d req-8c99fa79-1ec9-491f-b92c-534c4964800d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89b360b-2f7e-4f80-9247-559c3b0cf714", "name": "network-vif-unplugged", "status": "completed", "tag": "1442dec7-2556-4073-a34d-d9c24dea3b48"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:50.262842 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-901eb227-61d0-42de-8e45-126caf0e765d req-8c99fa79-1ec9-491f-b92c-534c4964800d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:50.263887 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-901eb227-61d0-42de-8e45-126caf0e765d req-8c99fa79-1ec9-491f-b92c-534c4964800d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:50.264317 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-901eb227-61d0-42de-8e45-126caf0e765d req-8c99fa79-1ec9-491f-b92c-534c4964800d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:50.277700 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-901eb227-61d0-42de-8e45-126caf0e765d req-8c99fa79-1ec9-491f-b92c-534c4964800d service nova] Creating event network-vif-unplugged:1442dec7-2556-4073-a34d-d9c24dea3b48 for instance d89b360b-2f7e-4f80-9247-559c3b0cf714 on n-h1-860863-1 Oct 10 18:53:50.283529 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-901eb227-61d0-42de-8e45-126caf0e765d req-8c99fa79-1ec9-491f-b92c-534c4964800d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042392 Oct 10 18:53:50.284461 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 667/1171] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:50.290649 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f80235b4-b3eb-4afe-8d10-46778b1a790f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:50.292201 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f80235b4-b3eb-4afe-8d10-46778b1a790f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:50.298875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f80235b4-b3eb-4afe-8d10-46778b1a790f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:50.299355 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f80235b4-b3eb-4afe-8d10-46778b1a790f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:50.299774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f80235b4-b3eb-4afe-8d10-46778b1a790f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:50.300743 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f80235b4-b3eb-4afe-8d10-46778b1a790f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:50.301474 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f80235b4-b3eb-4afe-8d10-46778b1a790f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:50.302230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f80235b4-b3eb-4afe-8d10-46778b1a790f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:50.359567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1530f2a2-70e2-4b91-8108-2191ed635377 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:50.374451 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1530f2a2-70e2-4b91-8108-2191ed635377 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1459 microversion: 2.1 time: 0.670073 Oct 10 18:53:50.375229 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 505/1172] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:49 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1459 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:50.397930 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-47e6b367-02d8-4334-9d1e-06b5c637574e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:50.398798 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-47e6b367-02d8-4334-9d1e-06b5c637574e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:50.406235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47e6b367-02d8-4334-9d1e-06b5c637574e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:50.406913 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47e6b367-02d8-4334-9d1e-06b5c637574e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:50.407573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47e6b367-02d8-4334-9d1e-06b5c637574e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:50.408578 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47e6b367-02d8-4334-9d1e-06b5c637574e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:50.409242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47e6b367-02d8-4334-9d1e-06b5c637574e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:50.409876 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47e6b367-02d8-4334-9d1e-06b5c637574e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:50.427567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:50.518140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f80235b4-b3eb-4afe-8d10-46778b1a790f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:50.528775 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f80235b4-b3eb-4afe-8d10-46778b1a790f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1315 microversion: 2.1 time: 0.242878 Oct 10 18:53:50.530772 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 668/1173] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:50 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:50.535658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f66f6569-fdcd-4a19-92c2-dd2e8f9ef23f tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Action: 'create', calling method: .version_select at 0x7f319233adc0>, body: {"security_group_rule": {"parent_group_id": "1a420a78-6604-43ef-9182-1122013946d4", "ip_protocol": "tempest-999-598725951", "from_port": 22, "to_port": 22}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:50.718126 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-47e6b367-02d8-4334-9d1e-06b5c637574e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:50.722075 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-f66f6569-fdcd-4a19-92c2-dd2e8f9ef23f tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] HTTP exception thrown: Invalid IP protocol tempest-999-598725951. Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f66f6569-fdcd-4a19-92c2-dd2e8f9ef23f tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Request method failure captured: Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 156 Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGo3H_y3mIWdbbnY-CK-yJDis3AlywJ9lJ263VJ43rKbhW4Per3riHRn9-yaiR7JI-3NkiSh3ODMLgVezFFy9CCpTJwVwJlQFCIxygQ1mgkcMo0aEMjfI014MiooJu4p6x72UYhe1HiNjqaJFcBLKW-C27GElI4eaI3Dm0y2-urBYKk Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_20f37e65bfc84d2781cc3782389f620b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}] Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 82b78e5887e34cfc9f1a15977fe683cc Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: {"security_group_rule": {"parent_group_id": "1a420a78-6604-43ef-9182-1122013946d4", "ip_protocol": "tempest-999-598725951", "from_port": 22, "to_port": 22}} Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: exception: Invalid IP protocol tempest-999-598725951. Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1a420a78-6604-43ef-9182-1122013946d4', 'ip_protocol': 'tempest-999-598725951', 'from_port': 22, 'to_port': 22}}} Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-598725951. Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-598725951. Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:50.723738 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:50.730846 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:50.730846 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:50.730846 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:50.730846 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:50.730846 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:50.730846 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:50.730846 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-598725951. Oct 10 18:53:50.730846 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:50.730846 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f66f6569-fdcd-4a19-92c2-dd2e8f9ef23f tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Returning 400 to user: Invalid IP protocol tempest-999-598725951. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:50.730846 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f66f6569-fdcd-4a19-92c2-dd2e8f9ef23f tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.193281 Oct 10 18:53:50.730846 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 669/1174] 10.222.0.43 () {60 vars in 1195 bytes} [Mon Oct 10 18:53:50 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 195 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 10 18:53:50.739333 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c62e83dc-fdfd-41eb-93f1-edafc1a47150 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:50.742627 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-47e6b367-02d8-4334-9d1e-06b5c637574e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:50.745134 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-47e6b367-02d8-4334-9d1e-06b5c637574e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:50.745928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c62e83dc-fdfd-41eb-93f1-edafc1a47150 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:50.746669 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-47e6b367-02d8-4334-9d1e-06b5c637574e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1567 microversion: 2.25 time: 0.368695 Oct 10 18:53:50.747574 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 506/1175] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:50 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1567 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:50.753915 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-29cb8048-16cc-4274-818c-5c49212c452c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:50.754852 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-29cb8048-16cc-4274-818c-5c49212c452c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:50.759946 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c62e83dc-fdfd-41eb-93f1-edafc1a47150 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:50.760440 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c62e83dc-fdfd-41eb-93f1-edafc1a47150 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:50.761879 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c62e83dc-fdfd-41eb-93f1-edafc1a47150 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:50.762875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c62e83dc-fdfd-41eb-93f1-edafc1a47150 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:50.763503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c62e83dc-fdfd-41eb-93f1-edafc1a47150 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:50.764080 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29cb8048-16cc-4274-818c-5c49212c452c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:50.764316 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c62e83dc-fdfd-41eb-93f1-edafc1a47150 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:50.765261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29cb8048-16cc-4274-818c-5c49212c452c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:50.766119 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29cb8048-16cc-4274-818c-5c49212c452c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:50.767059 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29cb8048-16cc-4274-818c-5c49212c452c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:50.767605 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29cb8048-16cc-4274-818c-5c49212c452c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:50.771163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29cb8048-16cc-4274-818c-5c49212c452c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:51.180685 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c62e83dc-fdfd-41eb-93f1-edafc1a47150 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1610 microversion: 2.1 time: 0.448444 Oct 10 18:53:51.181386 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 670/1176] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:50 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1610 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:51.192752 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6373ea4c-6dc4-49c6-a2ca-d5c304cf08af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:51.192752 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6373ea4c-6dc4-49c6-a2ca-d5c304cf08af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:51.201038 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6373ea4c-6dc4-49c6-a2ca-d5c304cf08af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:51.201536 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6373ea4c-6dc4-49c6-a2ca-d5c304cf08af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:51.201973 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6373ea4c-6dc4-49c6-a2ca-d5c304cf08af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:51.202689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6373ea4c-6dc4-49c6-a2ca-d5c304cf08af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:51.203142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6373ea4c-6dc4-49c6-a2ca-d5c304cf08af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:51.203600 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6373ea4c-6dc4-49c6-a2ca-d5c304cf08af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:51.266254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6373ea4c-6dc4-49c6-a2ca-d5c304cf08af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:51.284655 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6373ea4c-6dc4-49c6-a2ca-d5c304cf08af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1275 microversion: 2.1 time: 0.102055 Oct 10 18:53:51.296560 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 671/1177] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:51 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1275 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:51.296560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f82cdbc3-4096-47aa-bf57-c0b881a4ed12 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:51.296560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f82cdbc3-4096-47aa-bf57-c0b881a4ed12 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:51.305620 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f82cdbc3-4096-47aa-bf57-c0b881a4ed12 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:51.306419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f82cdbc3-4096-47aa-bf57-c0b881a4ed12 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:51.307371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f82cdbc3-4096-47aa-bf57-c0b881a4ed12 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:51.308493 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f82cdbc3-4096-47aa-bf57-c0b881a4ed12 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:51.309176 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f82cdbc3-4096-47aa-bf57-c0b881a4ed12 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:51.309802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f82cdbc3-4096-47aa-bf57-c0b881a4ed12 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:51.330394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-29cb8048-16cc-4274-818c-5c49212c452c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:51.340495 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-29cb8048-16cc-4274-818c-5c49212c452c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.591776 Oct 10 18:53:51.341716 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 507/1178] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:50 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:51.346671 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d0d8ef30-648a-4f47-8565-b76b446aa4d1 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Action: 'create', calling method: .version_select at 0x7f318de4ee50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1605685927", "description": "tempest-description-1046391327"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:51.424125 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f82cdbc3-4096-47aa-bf57-c0b881a4ed12 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:51.446662 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f82cdbc3-4096-47aa-bf57-c0b881a4ed12 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1298 microversion: 2.1 time: 0.159616 Oct 10 18:53:51.449432 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 672/1179] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:51 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1298 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:51.456168 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-04cb1423-d8eb-4c73-bcf1-925ac1092a65 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:51.464279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04cb1423-d8eb-4c73-bcf1-925ac1092a65 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:51.468757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04cb1423-d8eb-4c73-bcf1-925ac1092a65 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:51.468757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04cb1423-d8eb-4c73-bcf1-925ac1092a65 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:51.468757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04cb1423-d8eb-4c73-bcf1-925ac1092a65 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:51.468757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04cb1423-d8eb-4c73-bcf1-925ac1092a65 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:51.468757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04cb1423-d8eb-4c73-bcf1-925ac1092a65 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:51.503747 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-04cb1423-d8eb-4c73-bcf1-925ac1092a65 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.052734 Oct 10 18:53:51.504730 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 673/1180] 10.222.0.43 () {58 vars in 1176 bytes} [Mon Oct 10 18:53:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:51.521458 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0044df7d-0283-4587-9506-6b897dc4d855 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860863-1", "block_migration": true, "disk_over_commit": false}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:51.525897 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0044df7d-0283-4587-9506-6b897dc4d855 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:51.534517 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0044df7d-0283-4587-9506-6b897dc4d855 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:51.535746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0044df7d-0283-4587-9506-6b897dc4d855 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:51.536495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0044df7d-0283-4587-9506-6b897dc4d855 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:51.537419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0044df7d-0283-4587-9506-6b897dc4d855 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:51.538061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0044df7d-0283-4587-9506-6b897dc4d855 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:51.538759 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0044df7d-0283-4587-9506-6b897dc4d855 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:51.661614 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-0044df7d-0283-4587-9506-6b897dc4d855 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Lazy-loading 'flavor' on Instance uuid 367f9726-b32e-4ce6-94f8-b4075d746833 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:53:51.714280 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-0044df7d-0283-4587-9506-6b897dc4d855 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 367f9726-b32e-4ce6-94f8-b4075d746833 while it is in vm_state suspended Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0044df7d-0283-4587-9506-6b897dc4d855 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Request method failure captured: Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833/action HTTP/1.1 Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 97 Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGoB1TRO6mlUvq00RMSvv8vTTwTbvSHdS7U4cnIMfEz6Ns87oENgSLjNr1bfYqS7AiUhVfr0GrO43toEPyCrQHCCl6Hxk8qyToD3qzw5hZFRB7L4QbwXAYzNGdg3gDjlg0-2jZx67lbj313s98Tnhadlg6OPoObHeZKunF0WeXqGdtc Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 9305118634e94837a22f67a3dc69b1bf Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-LiveMigrationNegativeTest-1036194896 Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9305118634e94837a22f67a3dc69b1bf", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9305118634e94837a22f67a3dc69b1bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9305118634e94837a22f67a3dc69b1bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9305118634e94837a22f67a3dc69b1bf"}]}] Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-LiveMigrationNegativeTest-1036194896 Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 9305118634e94837a22f67a3dc69b1bf Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1036194896 Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-LiveMigrationNegativeTest-1036194896-project-admin Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: d38d678d8e23415ea09e3eed3c616e08 Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-LiveMigrationNegativeTest-1036194896-project-admin Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: {"os-migrateLive": {"host": "n-h2-860863-1", "block_migration": true, "disk_over_commit": false}} Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: exception: Cannot 'os-migrateLive' instance 367f9726-b32e-4ce6-94f8-b4075d746833 while it is in vm_state suspended Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '367f9726-b32e-4ce6-94f8-b4075d746833', 'body': {'os-migrateLive': {'host': 'n-h2-860863-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 367f9726-b32e-4ce6-94f8-b4075d746833 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:51.718199 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 367f9726-b32e-4ce6-94f8-b4075d746833 while it is in vm_state suspended Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 367f9726-b32e-4ce6-94f8-b4075d746833 while it is in vm_state suspended Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0044df7d-0283-4587-9506-6b897dc4d855 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 367f9726-b32e-4ce6-94f8-b4075d746833 while it is in vm_state suspended {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0044df7d-0283-4587-9506-6b897dc4d855 tempest-LiveMigrationNegativeTest-1036194896 tempest-LiveMigrationNegativeTest-1036194896-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833/action" status: 409 len: 155 microversion: 2.1 time: 0.205459 Oct 10 18:53:51.724257 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 674/1181] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:53:51 2022] POST /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833/action => generated 155 bytes in 209 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:53:51.734632 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-eadef84b-3d24-4aa7-a8ff-3eff0f936021 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:51.734632 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-eadef84b-3d24-4aa7-a8ff-3eff0f936021 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:51.739513 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eadef84b-3d24-4aa7-a8ff-3eff0f936021 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:51.743077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eadef84b-3d24-4aa7-a8ff-3eff0f936021 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:51.743669 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eadef84b-3d24-4aa7-a8ff-3eff0f936021 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:51.745243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eadef84b-3d24-4aa7-a8ff-3eff0f936021 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:51.745943 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eadef84b-3d24-4aa7-a8ff-3eff0f936021 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:51.746720 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eadef84b-3d24-4aa7-a8ff-3eff0f936021 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:52.011632 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d0d8ef30-648a-4f47-8565-b76b446aa4d1 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.668639 Oct 10 18:53:52.012804 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 508/1182] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:53:51 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:52.021874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dc14a513-917a-4284-885e-97fb6df54476 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:52.022372 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-dc14a513-917a-4284-885e-97fb6df54476 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:52.040190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dc14a513-917a-4284-885e-97fb6df54476 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:52.041572 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dc14a513-917a-4284-885e-97fb6df54476 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:52.042176 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dc14a513-917a-4284-885e-97fb6df54476 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:52.043062 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dc14a513-917a-4284-885e-97fb6df54476 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:52.043904 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dc14a513-917a-4284-885e-97fb6df54476 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:52.044491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dc14a513-917a-4284-885e-97fb6df54476 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:52.055479 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-eadef84b-3d24-4aa7-a8ff-3eff0f936021 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:52.068697 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-eadef84b-3d24-4aa7-a8ff-3eff0f936021 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1315 microversion: 2.1 time: 0.338758 Oct 10 18:53:52.084183 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 675/1183] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:51 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:52.084183 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-02c15a9f-94d7-453a-9863-402d50b26bf1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:52.084183 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-02c15a9f-94d7-453a-9863-402d50b26bf1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:52.095879 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-02c15a9f-94d7-453a-9863-402d50b26bf1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:52.105575 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-02c15a9f-94d7-453a-9863-402d50b26bf1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:52.106228 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-02c15a9f-94d7-453a-9863-402d50b26bf1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:52.107177 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-02c15a9f-94d7-453a-9863-402d50b26bf1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:52.107827 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-02c15a9f-94d7-453a-9863-402d50b26bf1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:52.108447 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-02c15a9f-94d7-453a-9863-402d50b26bf1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:52.116524 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-dc14a513-917a-4284-885e-97fb6df54476 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:53:52.497743 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dc14a513-917a-4284-885e-97fb6df54476 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "DELETE /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 204 len: 0 microversion: 2.1 time: 0.479171 Oct 10 18:53:52.503644 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 509/1184] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:53:52 2022] DELETE /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:52.513131 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dc35cbb1-dd21-414d-8bf7-267fa82ec8c4 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Action: 'create', calling method: .version_select at 0x7f318dd4bc10>, body: {"security_group_rule": {"parent_group_id": "d20c1efa-0ba4-4b64-8c37-113486fa8867", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:52.558299 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-02c15a9f-94d7-453a-9863-402d50b26bf1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:52.570926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-02c15a9f-94d7-453a-9863-402d50b26bf1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:52.572974 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-02c15a9f-94d7-453a-9863-402d50b26bf1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:52.574164 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-02c15a9f-94d7-453a-9863-402d50b26bf1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1567 microversion: 2.25 time: 0.502653 Oct 10 18:53:52.575456 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 676/1185] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:52 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1567 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:52.583256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4cbc3eee-2686-475d-acc4-3dc71eb8e0d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:52.588495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4cbc3eee-2686-475d-acc4-3dc71eb8e0d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:52.597341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4cbc3eee-2686-475d-acc4-3dc71eb8e0d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:52.598717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4cbc3eee-2686-475d-acc4-3dc71eb8e0d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:52.600287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4cbc3eee-2686-475d-acc4-3dc71eb8e0d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:52.601236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4cbc3eee-2686-475d-acc4-3dc71eb8e0d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:52.601853 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4cbc3eee-2686-475d-acc4-3dc71eb8e0d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:52.602733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4cbc3eee-2686-475d-acc4-3dc71eb8e0d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:52.746720 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-dc35cbb1-dd21-414d-8bf7-267fa82ec8c4 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dc35cbb1-dd21-414d-8bf7-267fa82ec8c4 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Request method failure captured: Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 138 Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGo3H_y3mIWdbbnY-CK-yJDis3AlywJ9lJ263VJ43rKbhW4Per3riHRn9-yaiR7JI-3NkiSh3ODMLgVezFFy9CCpTJwVwJlQFCIxygQ1mgkcMo0aEMjfI014MiooJu4p6x72UYhe1HiNjqaJFcBLKW-C27GElI4eaI3Dm0y2-urBYKk Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_20f37e65bfc84d2781cc3782389f620b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}] Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 82b78e5887e34cfc9f1a15977fe683cc Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: {"security_group_rule": {"parent_group_id": "d20c1efa-0ba4-4b64-8c37-113486fa8867", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd20c1efa-0ba4-4b64-8c37-113486fa8867', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 18:53:52.748359 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:52.753461 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:52.753461 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:52.753461 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:52.753461 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:52.753461 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:52.753461 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:52.753461 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:52.753461 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 10 18:53:52.753461 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:52.755037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dc35cbb1-dd21-414d-8bf7-267fa82ec8c4 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:52.755901 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dc35cbb1-dd21-414d-8bf7-267fa82ec8c4 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.250634 Oct 10 18:53:52.756474 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 510/1186] 10.222.0.43 () {60 vars in 1195 bytes} [Mon Oct 10 18:53:52 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 252 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:53:52.761761 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-ece952e4-c98b-4f09-ab7e-6d2f10a99162 req-27b92cd3-f1b6-4447-b381-ab5c45a4e069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89b360b-2f7e-4f80-9247-559c3b0cf714", "tag": "1442dec7-2556-4073-a34d-d9c24dea3b48"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:52.786339 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-ece952e4-c98b-4f09-ab7e-6d2f10a99162 req-27b92cd3-f1b6-4447-b381-ab5c45a4e069 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:52.786829 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-ece952e4-c98b-4f09-ab7e-6d2f10a99162 req-27b92cd3-f1b6-4447-b381-ab5c45a4e069 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:52.787256 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-ece952e4-c98b-4f09-ab7e-6d2f10a99162 req-27b92cd3-f1b6-4447-b381-ab5c45a4e069 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:52.803521 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-ece952e4-c98b-4f09-ab7e-6d2f10a99162 req-27b92cd3-f1b6-4447-b381-ab5c45a4e069 service nova] Creating event network-changed:1442dec7-2556-4073-a34d-d9c24dea3b48 for instance d89b360b-2f7e-4f80-9247-559c3b0cf714 on n-h1-860863-1 Oct 10 18:53:52.814647 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-ece952e4-c98b-4f09-ab7e-6d2f10a99162 req-27b92cd3-f1b6-4447-b381-ab5c45a4e069 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054035 Oct 10 18:53:52.815936 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 511/1187] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:52.831932 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-04142aab-1ce5-411f-87d0-5065a9423cfe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:52.833177 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-04142aab-1ce5-411f-87d0-5065a9423cfe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:52.850034 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04142aab-1ce5-411f-87d0-5065a9423cfe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:52.850575 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04142aab-1ce5-411f-87d0-5065a9423cfe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:52.854406 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04142aab-1ce5-411f-87d0-5065a9423cfe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:52.854406 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04142aab-1ce5-411f-87d0-5065a9423cfe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:52.854406 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04142aab-1ce5-411f-87d0-5065a9423cfe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:52.854900 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-04142aab-1ce5-411f-87d0-5065a9423cfe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:52.915327 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4cbc3eee-2686-475d-acc4-3dc71eb8e0d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:52.923328 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4cbc3eee-2686-475d-acc4-3dc71eb8e0d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1317 microversion: 2.1 time: 0.343887 Oct 10 18:53:52.927126 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 677/1188] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:52 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:52.939542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d2015ed0-5aeb-49e0-9dd8-e25b08007e65 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:52.940217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d2015ed0-5aeb-49e0-9dd8-e25b08007e65 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:52.946520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d2015ed0-5aeb-49e0-9dd8-e25b08007e65 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:52.947007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d2015ed0-5aeb-49e0-9dd8-e25b08007e65 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:52.948010 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d2015ed0-5aeb-49e0-9dd8-e25b08007e65 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:52.948750 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d2015ed0-5aeb-49e0-9dd8-e25b08007e65 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:52.949198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d2015ed0-5aeb-49e0-9dd8-e25b08007e65 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:52.950022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d2015ed0-5aeb-49e0-9dd8-e25b08007e65 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:53.250941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d2015ed0-5aeb-49e0-9dd8-e25b08007e65 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:53.259194 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d2015ed0-5aeb-49e0-9dd8-e25b08007e65 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1366 microversion: 2.1 time: 0.330558 Oct 10 18:53:53.272962 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 678/1189] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:52 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1366 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:53.285809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3d464a57-dfc5-40d9-9ef5-d50afe29393f tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:53.291561 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3d464a57-dfc5-40d9-9ef5-d50afe29393f tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:53.293312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d464a57-dfc5-40d9-9ef5-d50afe29393f tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:53.293979 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d464a57-dfc5-40d9-9ef5-d50afe29393f tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:53.294603 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d464a57-dfc5-40d9-9ef5-d50afe29393f tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:53.295465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d464a57-dfc5-40d9-9ef5-d50afe29393f tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:53.296074 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d464a57-dfc5-40d9-9ef5-d50afe29393f tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:53.296865 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d464a57-dfc5-40d9-9ef5-d50afe29393f tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:53.313071 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-04142aab-1ce5-411f-87d0-5065a9423cfe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:53.327219 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-04142aab-1ce5-411f-87d0-5065a9423cfe tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.509725 Oct 10 18:53:53.328258 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 512/1190] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:52 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:53.339855 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-fa018f78-4d7a-4cd1-be27-97ac85857746 req-3afef095-cbb7-49fc-b0de-0517d9d589a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4812966e-0f45-4261-bf1d-99e46ebab1ac", "name": "network-vif-plugged", "status": "completed", "tag": "a67b1ca6-1605-4592-8d8e-0973c5d12f86"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:53.358858 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-fa018f78-4d7a-4cd1-be27-97ac85857746 req-3afef095-cbb7-49fc-b0de-0517d9d589a9 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:53.359439 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-fa018f78-4d7a-4cd1-be27-97ac85857746 req-3afef095-cbb7-49fc-b0de-0517d9d589a9 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:53.359944 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-fa018f78-4d7a-4cd1-be27-97ac85857746 req-3afef095-cbb7-49fc-b0de-0517d9d589a9 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:53.413573 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-fa018f78-4d7a-4cd1-be27-97ac85857746 req-3afef095-cbb7-49fc-b0de-0517d9d589a9 service nova] Creating event network-vif-plugged:a67b1ca6-1605-4592-8d8e-0973c5d12f86 for instance 4812966e-0f45-4261-bf1d-99e46ebab1ac on n-h2-860863-1 Oct 10 18:53:53.422180 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-fa018f78-4d7a-4cd1-be27-97ac85857746 req-3afef095-cbb7-49fc-b0de-0517d9d589a9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092224 Oct 10 18:53:53.426445 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 513/1191] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:53.443763 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a62b092c-83cd-4b63-bf85-7006adc35b1e tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Action: 'create', calling method: .version_select at 0x7f318dd725e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2117953000", "description": "tempest-description-555904116"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:53.697510 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3d464a57-dfc5-40d9-9ef5-d50afe29393f tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:53.708285 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3d464a57-dfc5-40d9-9ef5-d50afe29393f tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1465 microversion: 2.1 time: 0.427054 Oct 10 18:53:53.709152 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 679/1192] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:53 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1465 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:53.715732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f7dfa0e9-278c-4b41-a855-0aa796470a91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:53.716908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f7dfa0e9-278c-4b41-a855-0aa796470a91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:53.722929 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7dfa0e9-278c-4b41-a855-0aa796470a91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:53.723493 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7dfa0e9-278c-4b41-a855-0aa796470a91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:53.724112 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7dfa0e9-278c-4b41-a855-0aa796470a91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:53.725053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7dfa0e9-278c-4b41-a855-0aa796470a91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:53.725730 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7dfa0e9-278c-4b41-a855-0aa796470a91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:53.726250 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7dfa0e9-278c-4b41-a855-0aa796470a91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:53.964269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f7dfa0e9-278c-4b41-a855-0aa796470a91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:53.979665 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f7dfa0e9-278c-4b41-a855-0aa796470a91 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1315 microversion: 2.1 time: 0.269181 Oct 10 18:53:53.997010 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 680/1193] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:53 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:54.003418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f17538d4-5e60-4b03-81a1-bd95a807d17b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:54.004035 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f17538d4-5e60-4b03-81a1-bd95a807d17b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:54.012174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f17538d4-5e60-4b03-81a1-bd95a807d17b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:54.012707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f17538d4-5e60-4b03-81a1-bd95a807d17b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:54.013139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f17538d4-5e60-4b03-81a1-bd95a807d17b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:54.013992 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f17538d4-5e60-4b03-81a1-bd95a807d17b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:54.014301 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f17538d4-5e60-4b03-81a1-bd95a807d17b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:54.014721 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f17538d4-5e60-4b03-81a1-bd95a807d17b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:54.206278 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f17538d4-5e60-4b03-81a1-bd95a807d17b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:54.218974 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f17538d4-5e60-4b03-81a1-bd95a807d17b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:54.221369 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f17538d4-5e60-4b03-81a1-bd95a807d17b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:54.222951 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a62b092c-83cd-4b63-bf85-7006adc35b1e tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.793916 Oct 10 18:53:54.223555 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 514/1194] 10.222.0.43 () {60 vars in 1180 bytes} [Mon Oct 10 18:53:53 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:54.223814 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f17538d4-5e60-4b03-81a1-bd95a807d17b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1567 microversion: 2.25 time: 0.224684 Oct 10 18:53:54.225292 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 681/1195] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:53 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:54.228467 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dfdf4739-cb16-4115-8c12-c5c5fd5b17e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:54.229393 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-dfdf4739-cb16-4115-8c12-c5c5fd5b17e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:54.232411 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-5fec4165-8b25-47d3-8237-d5ee0d7a64cc req-c8859775-ee2d-4d82-b96b-59ee0476b704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92880065-c226-4118-9326-529eff171df0", "tag": "887bde6f-cc1f-4045-9db8-fd17432c6ed5"}, {"name": "network-changed", "server_uuid": "bc84705b-369f-4b67-a7ad-4cb62ba09d40", "tag": "7fa49e0d-3a83-4a67-b0a9-cfc6f8f332ef"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:54.245000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dfdf4739-cb16-4115-8c12-c5c5fd5b17e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:54.245809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dfdf4739-cb16-4115-8c12-c5c5fd5b17e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:54.246408 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dfdf4739-cb16-4115-8c12-c5c5fd5b17e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:54.248327 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dfdf4739-cb16-4115-8c12-c5c5fd5b17e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:54.248987 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dfdf4739-cb16-4115-8c12-c5c5fd5b17e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:54.249580 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dfdf4739-cb16-4115-8c12-c5c5fd5b17e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:54.251861 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5fec4165-8b25-47d3-8237-d5ee0d7a64cc req-c8859775-ee2d-4d82-b96b-59ee0476b704 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:54.252344 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5fec4165-8b25-47d3-8237-d5ee0d7a64cc req-c8859775-ee2d-4d82-b96b-59ee0476b704 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:54.252988 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5fec4165-8b25-47d3-8237-d5ee0d7a64cc req-c8859775-ee2d-4d82-b96b-59ee0476b704 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:54.273280 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-5fec4165-8b25-47d3-8237-d5ee0d7a64cc req-c8859775-ee2d-4d82-b96b-59ee0476b704 service nova] Creating event network-changed:887bde6f-cc1f-4045-9db8-fd17432c6ed5 for instance 92880065-c226-4118-9326-529eff171df0 on n-h1-860863-1 Oct 10 18:53:54.273784 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-5fec4165-8b25-47d3-8237-d5ee0d7a64cc req-c8859775-ee2d-4d82-b96b-59ee0476b704 service nova] Creating event network-changed:7fa49e0d-3a83-4a67-b0a9-cfc6f8f332ef for instance bc84705b-369f-4b67-a7ad-4cb62ba09d40 on n-h2-860863-1 Oct 10 18:53:54.294640 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-5fec4165-8b25-47d3-8237-d5ee0d7a64cc req-c8859775-ee2d-4d82-b96b-59ee0476b704 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066818 Oct 10 18:53:54.295246 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 682/1196] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:54.301638 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5bc3bbec-2d54-411a-9d61-1d48c40a88de tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Action: 'create', calling method: .version_select at 0x7f319227e3a0>, body: {"security_group_rule": {"parent_group_id": "4223f1ea-bd26-440f-8e4e-b2a30e77d760", "ip_protocol": "tcp", "from_port": 22, "to_port": 612547180}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:54.468799 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-5bc3bbec-2d54-411a-9d61-1d48c40a88de tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] HTTP exception thrown: Invalid port range 22:612547180. Valid TCP ports should be between 1-65535 Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5bc3bbec-2d54-411a-9d61-1d48c40a88de tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Request method failure captured: Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 145 Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGo3H_y3mIWdbbnY-CK-yJDis3AlywJ9lJ263VJ43rKbhW4Per3riHRn9-yaiR7JI-3NkiSh3ODMLgVezFFy9CCpTJwVwJlQFCIxygQ1mgkcMo0aEMjfI014MiooJu4p6x72UYhe1HiNjqaJFcBLKW-C27GElI4eaI3Dm0y2-urBYKk Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_20f37e65bfc84d2781cc3782389f620b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}] Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 82b78e5887e34cfc9f1a15977fe683cc Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: {"security_group_rule": {"parent_group_id": "4223f1ea-bd26-440f-8e4e-b2a30e77d760", "ip_protocol": "tcp", "from_port": 22, "to_port": 612547180}} Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: exception: Invalid port range 22:612547180. Valid TCP ports should be between 1-65535 Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4223f1ea-bd26-440f-8e4e-b2a30e77d760', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 612547180}}} Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:612547180. Valid TCP ports should be between 1-65535 Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:612547180. Valid TCP ports should be between 1-65535 Oct 10 18:53:54.470439 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:54.479066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:54.479066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:54.479066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:54.479066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:54.479066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:54.479066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:54.479066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:54.479066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:612547180. Valid TCP ports should be between 1-65535 Oct 10 18:53:54.479066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:54.479066 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5bc3bbec-2d54-411a-9d61-1d48c40a88de tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Returning 400 to user: Invalid port range 22:612547180. Valid TCP ports should be between 1-65535 {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:54.479066 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5bc3bbec-2d54-411a-9d61-1d48c40a88de tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.175429 Oct 10 18:53:54.479066 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 683/1197] 10.222.0.43 () {60 vars in 1195 bytes} [Mon Oct 10 18:53:54 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:53:54.479066 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ca969a2d-dfc5-4405-b3f6-71968df1acdf tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:54.479066 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ca969a2d-dfc5-4405-b3f6-71968df1acdf tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:54.502750 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca969a2d-dfc5-4405-b3f6-71968df1acdf tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:54.503250 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca969a2d-dfc5-4405-b3f6-71968df1acdf tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:54.503767 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca969a2d-dfc5-4405-b3f6-71968df1acdf tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:54.504382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca969a2d-dfc5-4405-b3f6-71968df1acdf tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:54.504854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca969a2d-dfc5-4405-b3f6-71968df1acdf tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:54.505279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca969a2d-dfc5-4405-b3f6-71968df1acdf tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:55.047925 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-dfdf4739-cb16-4115-8c12-c5c5fd5b17e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:55.067878 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dfdf4739-cb16-4115-8c12-c5c5fd5b17e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1317 microversion: 2.1 time: 0.843049 Oct 10 18:53:55.073685 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 515/1198] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:54 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1317 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:55.073845 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ca969a2d-dfc5-4405-b3f6-71968df1acdf tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:55.075877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3f1feb81-9d8a-4986-b39c-758b924e95f8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:55.077118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3f1feb81-9d8a-4986-b39c-758b924e95f8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:55.088982 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ca969a2d-dfc5-4405-b3f6-71968df1acdf tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1366 microversion: 2.1 time: 0.602809 Oct 10 18:53:55.089751 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 684/1199] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:54 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1366 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:55.090150 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f1feb81-9d8a-4986-b39c-758b924e95f8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:55.091515 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f1feb81-9d8a-4986-b39c-758b924e95f8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:55.093558 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f1feb81-9d8a-4986-b39c-758b924e95f8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:55.097710 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f1feb81-9d8a-4986-b39c-758b924e95f8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:55.097862 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-61733dc0-7032-41fe-8e9e-9a59facd3849 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Action: 'create', calling method: .version_select at 0x7f319223de50>, body: {"security_group_rule": {"parent_group_id": "d2b1f02f-91f9-4602-82d6-fda326b9bac4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:55.097983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f1feb81-9d8a-4986-b39c-758b924e95f8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:55.097983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f1feb81-9d8a-4986-b39c-758b924e95f8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:55.562221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG neutronclient.v2_0.client [None req-61733dc0-7032-41fe-8e9e-9a59facd3849 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d2b1f02f-91f9-4602-82d6-fda326b9bac4 does not exist", "detail": ""}} {{(pid=127288) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:53:55.563020 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.security_group_api [None req-61733dc0-7032-41fe-8e9e-9a59facd3849 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Neutron security group d2b1f02f-91f9-4602-82d6-fda326b9bac4 not found {{(pid=127288) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:53:55.564265 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-61733dc0-7032-41fe-8e9e-9a59facd3849 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] HTTP exception thrown: Security group d2b1f02f-91f9-4602-82d6-fda326b9bac4 does not exist Oct 10 18:53:55.564265 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-20360c6d-ddd0-4a9f-8efb-a11e7b535d86'] Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-61733dc0-7032-41fe-8e9e-9a59facd3849 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Request method failure captured: Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 138 Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGo3H_y3mIWdbbnY-CK-yJDis3AlywJ9lJ263VJ43rKbhW4Per3riHRn9-yaiR7JI-3NkiSh3ODMLgVezFFy9CCpTJwVwJlQFCIxygQ1mgkcMo0aEMjfI014MiooJu4p6x72UYhe1HiNjqaJFcBLKW-C27GElI4eaI3Dm0y2-urBYKk Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_20f37e65bfc84d2781cc3782389f620b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}] Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 82b78e5887e34cfc9f1a15977fe683cc Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: {"security_group_rule": {"parent_group_id": "d2b1f02f-91f9-4602-82d6-fda326b9bac4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: exception: Security group d2b1f02f-91f9-4602-82d6-fda326b9bac4 does not exist Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-20360c6d-ddd0-4a9f-8efb-a11e7b535d86'] Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd2b1f02f-91f9-4602-82d6-fda326b9bac4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:53:55.568761 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d2b1f02f-91f9-4602-82d6-fda326b9bac4 does not exist Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20360c6d-ddd0-4a9f-8efb-a11e7b535d86'] Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d2b1f02f-91f9-4602-82d6-fda326b9bac4 does not exist Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20360c6d-ddd0-4a9f-8efb-a11e7b535d86'] Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d2b1f02f-91f9-4602-82d6-fda326b9bac4 does not exist Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20360c6d-ddd0-4a9f-8efb-a11e7b535d86'] Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d2b1f02f-91f9-4602-82d6-fda326b9bac4 does not exist Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20360c6d-ddd0-4a9f-8efb-a11e7b535d86'] Oct 10 18:53:55.575301 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:53:55.581242 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-61733dc0-7032-41fe-8e9e-9a59facd3849 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Returning 404 to user: Security group d2b1f02f-91f9-4602-82d6-fda326b9bac4 does not exist Oct 10 18:53:55.581242 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-20360c6d-ddd0-4a9f-8efb-a11e7b535d86'] {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:55.582490 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-61733dc0-7032-41fe-8e9e-9a59facd3849 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.491685 Oct 10 18:53:55.583624 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 685/1200] 10.222.0.43 () {60 vars in 1195 bytes} [Mon Oct 10 18:53:55 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 493 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:53:55.590945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-da82718c-ca40-4c86-a3d5-e82f8e1241b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:55.591777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-da82718c-ca40-4c86-a3d5-e82f8e1241b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:55.599629 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da82718c-ca40-4c86-a3d5-e82f8e1241b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:55.600449 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da82718c-ca40-4c86-a3d5-e82f8e1241b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:55.600944 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da82718c-ca40-4c86-a3d5-e82f8e1241b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:55.601642 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da82718c-ca40-4c86-a3d5-e82f8e1241b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:55.602091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da82718c-ca40-4c86-a3d5-e82f8e1241b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:55.602559 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da82718c-ca40-4c86-a3d5-e82f8e1241b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:55.649494 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3f1feb81-9d8a-4986-b39c-758b924e95f8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:55.660068 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3f1feb81-9d8a-4986-b39c-758b924e95f8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.590007 Oct 10 18:53:55.661120 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 516/1201] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:55 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:55.667478 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c4634981-9b8e-4133-bafd-7f21de85f05f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:55.671531 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c4634981-9b8e-4133-bafd-7f21de85f05f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:55.680218 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c4634981-9b8e-4133-bafd-7f21de85f05f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:55.680919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c4634981-9b8e-4133-bafd-7f21de85f05f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:55.681538 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c4634981-9b8e-4133-bafd-7f21de85f05f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:55.682795 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c4634981-9b8e-4133-bafd-7f21de85f05f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:55.683412 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c4634981-9b8e-4133-bafd-7f21de85f05f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:55.684045 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c4634981-9b8e-4133-bafd-7f21de85f05f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:56.039812 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-da82718c-ca40-4c86-a3d5-e82f8e1241b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:56.064635 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c4634981-9b8e-4133-bafd-7f21de85f05f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:56.067013 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-da82718c-ca40-4c86-a3d5-e82f8e1241b6 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1465 microversion: 2.1 time: 0.481180 Oct 10 18:53:56.070362 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 686/1202] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:55 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1465 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:56.074248 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c4634981-9b8e-4133-bafd-7f21de85f05f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1503 microversion: 2.1 time: 0.411534 Oct 10 18:53:56.077651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e3dd4ebc-5acc-44fc-bc61-17d37e851b62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:56.079282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e3dd4ebc-5acc-44fc-bc61-17d37e851b62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:56.087356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e3dd4ebc-5acc-44fc-bc61-17d37e851b62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:56.088971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e3dd4ebc-5acc-44fc-bc61-17d37e851b62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:56.089615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e3dd4ebc-5acc-44fc-bc61-17d37e851b62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:56.091091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e3dd4ebc-5acc-44fc-bc61-17d37e851b62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:56.091762 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e3dd4ebc-5acc-44fc-bc61-17d37e851b62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:56.092394 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e3dd4ebc-5acc-44fc-bc61-17d37e851b62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:56.109737 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 517/1203] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:55 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1503 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:56.122725 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7d8d3c22-bd16-44dc-8efc-41a3b1064fc0 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Calling method '.version_select at 0x7f318de6df70>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:56.302556 n-d-860863-1 devstack@n-api.service[127289]: DEBUG neutronclient.v2_0.client [None req-7d8d3c22-bd16-44dc-8efc-41a3b1064fc0 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 3e4c7a10-e9ff-418a-8738-7dadbb5dcadb does not exist", "detail": ""}} {{(pid=127289) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:53:56.304333 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.security_group_api [None req-7d8d3c22-bd16-44dc-8efc-41a3b1064fc0 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Neutron security group rule 3e4c7a10-e9ff-418a-8738-7dadbb5dcadb not found {{(pid=127289) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 10 18:53:56.305079 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-7d8d3c22-bd16-44dc-8efc-41a3b1064fc0 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] HTTP exception thrown: Security group rule 3e4c7a10-e9ff-418a-8738-7dadbb5dcadb does not exist Oct 10 18:53:56.305079 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-135cafe0-42ae-4f9d-b8f2-ff529123c2f4'] Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7d8d3c22-bd16-44dc-8efc-41a3b1064fc0 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Request method failure captured: Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/os-security-group-rules/3e4c7a10-e9ff-418a-8738-7dadbb5dcadb HTTP/1.1 Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGo3H_y3mIWdbbnY-CK-yJDis3AlywJ9lJ263VJ43rKbhW4Per3riHRn9-yaiR7JI-3NkiSh3ODMLgVezFFy9CCpTJwVwJlQFCIxygQ1mgkcMo0aEMjfI014MiooJu4p6x72UYhe1HiNjqaJFcBLKW-C27GElI4eaI3Dm0y2-urBYKk Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_20f37e65bfc84d2781cc3782389f620b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/20f37e65bfc84d2781cc3782389f620b"}]}] Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 20f37e65bfc84d2781cc3782389f620b Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612 Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 82b78e5887e34cfc9f1a15977fe683cc Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: exception: Security group rule 3e4c7a10-e9ff-418a-8738-7dadbb5dcadb does not exist Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-135cafe0-42ae-4f9d-b8f2-ff529123c2f4'] Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '3e4c7a10-e9ff-418a-8738-7dadbb5dcadb'} Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:53:56.308200 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 3e4c7a10-e9ff-418a-8738-7dadbb5dcadb does not exist Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-135cafe0-42ae-4f9d-b8f2-ff529123c2f4'] Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 3e4c7a10-e9ff-418a-8738-7dadbb5dcadb does not exist Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-135cafe0-42ae-4f9d-b8f2-ff529123c2f4'] Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 3e4c7a10-e9ff-418a-8738-7dadbb5dcadb does not exist Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-135cafe0-42ae-4f9d-b8f2-ff529123c2f4'] Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 3e4c7a10-e9ff-418a-8738-7dadbb5dcadb does not exist Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-135cafe0-42ae-4f9d-b8f2-ff529123c2f4'] Oct 10 18:53:56.313064 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:56.317410 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7d8d3c22-bd16-44dc-8efc-41a3b1064fc0 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Returning 404 to user: Security group rule 3e4c7a10-e9ff-418a-8738-7dadbb5dcadb does not exist Oct 10 18:53:56.317410 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-135cafe0-42ae-4f9d-b8f2-ff529123c2f4'] {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:56.318525 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7d8d3c22-bd16-44dc-8efc-41a3b1064fc0 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/3e4c7a10-e9ff-418a-8738-7dadbb5dcadb" status: 404 len: 199 microversion: 2.1 time: 0.207532 Oct 10 18:53:56.319599 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 518/1204] 10.222.0.43 () {58 vars in 1287 bytes} [Mon Oct 10 18:53:56 2022] DELETE /compute/v2.1/os-security-group-rules/3e4c7a10-e9ff-418a-8738-7dadbb5dcadb => generated 199 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:53:56.335898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-deac975f-4d08-4223-9b20-a9fc0674e759 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:56.337133 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-deac975f-4d08-4223-9b20-a9fc0674e759 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:56.357636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-deac975f-4d08-4223-9b20-a9fc0674e759 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:56.358303 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-deac975f-4d08-4223-9b20-a9fc0674e759 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:56.359070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-deac975f-4d08-4223-9b20-a9fc0674e759 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:56.359955 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-deac975f-4d08-4223-9b20-a9fc0674e759 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:56.362758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-deac975f-4d08-4223-9b20-a9fc0674e759 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:56.363395 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-deac975f-4d08-4223-9b20-a9fc0674e759 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:56.396159 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=4 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:56.431058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=22 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:56.517210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e3dd4ebc-5acc-44fc-bc61-17d37e851b62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:56.526511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e3dd4ebc-5acc-44fc-bc61-17d37e851b62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:56.528185 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e3dd4ebc-5acc-44fc-bc61-17d37e851b62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:56.530342 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e3dd4ebc-5acc-44fc-bc61-17d37e851b62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1567 microversion: 2.25 time: 0.457525 Oct 10 18:53:56.531760 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 687/1205] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:56 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1567 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:56.538140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5783107e-b5c3-4641-bfa3-256227342878 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:56.539067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5783107e-b5c3-4641-bfa3-256227342878 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:56.546394 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5783107e-b5c3-4641-bfa3-256227342878 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:56.547066 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5783107e-b5c3-4641-bfa3-256227342878 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:56.547813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5783107e-b5c3-4641-bfa3-256227342878 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:56.548840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5783107e-b5c3-4641-bfa3-256227342878 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:56.549528 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5783107e-b5c3-4641-bfa3-256227342878 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:56.550201 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5783107e-b5c3-4641-bfa3-256227342878 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:56.575712 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:56.670900 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-deac975f-4d08-4223-9b20-a9fc0674e759 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:56.683863 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-deac975f-4d08-4223-9b20-a9fc0674e759 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1317 microversion: 2.1 time: 0.361688 Oct 10 18:53:56.685227 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 519/1206] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:56 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:56.691058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5a1c9b4c-2891-44e8-af3c-a20499e15647 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Calling method '.version_select at 0x7f318dd4baf0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:56.858279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5783107e-b5c3-4641-bfa3-256227342878 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:56.880751 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5783107e-b5c3-4641-bfa3-256227342878 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1366 microversion: 2.1 time: 0.337547 Oct 10 18:53:56.880751 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 688/1207] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:56 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:56.880751 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-d53dcfd3-6420-4d8f-a09a-34f0c33f53c3 req-37a72cf8-78ff-4e3e-b60b-d9f421d58e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367f9726-b32e-4ce6-94f8-b4075d746833", "name": "network-vif-deleted", "tag": "78998a37-aff7-4723-9b60-bfb50a9adb5d"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:53:56.891475 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d53dcfd3-6420-4d8f-a09a-34f0c33f53c3 req-37a72cf8-78ff-4e3e-b60b-d9f421d58e47 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:56.892686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d53dcfd3-6420-4d8f-a09a-34f0c33f53c3 req-37a72cf8-78ff-4e3e-b60b-d9f421d58e47 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:56.893548 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d53dcfd3-6420-4d8f-a09a-34f0c33f53c3 req-37a72cf8-78ff-4e3e-b60b-d9f421d58e47 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:56.911735 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-d53dcfd3-6420-4d8f-a09a-34f0c33f53c3 req-37a72cf8-78ff-4e3e-b60b-d9f421d58e47 service nova] Creating event network-vif-deleted:78998a37-aff7-4723-9b60-bfb50a9adb5d for instance 367f9726-b32e-4ce6-94f8-b4075d746833 on n-h1-860863-1 Oct 10 18:53:56.917911 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-d53dcfd3-6420-4d8f-a09a-34f0c33f53c3 req-37a72cf8-78ff-4e3e-b60b-d9f421d58e47 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044218 Oct 10 18:53:56.919103 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 689/1208] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:53:56.941783 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-50352d70-f93f-496f-a2c9-454a0ec4a8b0 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:56.947047 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-50352d70-f93f-496f-a2c9-454a0ec4a8b0 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:56.983199 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50352d70-f93f-496f-a2c9-454a0ec4a8b0 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:56.984384 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50352d70-f93f-496f-a2c9-454a0ec4a8b0 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:56.985068 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50352d70-f93f-496f-a2c9-454a0ec4a8b0 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:56.986477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50352d70-f93f-496f-a2c9-454a0ec4a8b0 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:56.987677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50352d70-f93f-496f-a2c9-454a0ec4a8b0 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:56.990434 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50352d70-f93f-496f-a2c9-454a0ec4a8b0 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:57.137938 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5a1c9b4c-2891-44e8-af3c-a20499e15647 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/4223f1ea-bd26-440f-8e4e-b2a30e77d760" status: 202 len: 0 microversion: 2.1 time: 0.451104 Oct 10 18:53:57.142770 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 520/1209] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:56 2022] DELETE /compute/v2.1/os-security-groups/4223f1ea-bd26-440f-8e4e-b2a30e77d760 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:57.162328 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ee549613-ca97-45d2-9f21-deb674ca4c71 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:57.163212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ee549613-ca97-45d2-9f21-deb674ca4c71 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:57.171771 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ee549613-ca97-45d2-9f21-deb674ca4c71 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:57.172317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ee549613-ca97-45d2-9f21-deb674ca4c71 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:57.173085 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ee549613-ca97-45d2-9f21-deb674ca4c71 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:57.173790 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ee549613-ca97-45d2-9f21-deb674ca4c71 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:57.175009 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ee549613-ca97-45d2-9f21-deb674ca4c71 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:57.175982 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ee549613-ca97-45d2-9f21-deb674ca4c71 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:57.219625 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-50352d70-f93f-496f-a2c9-454a0ec4a8b0 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:57.231738 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-50352d70-f93f-496f-a2c9-454a0ec4a8b0 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.311005 Oct 10 18:53:57.232406 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 690/1210] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:56 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:57.237896 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-84762b82-6bb3-4452-a5f8-678e18e2eac4 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Calling method '.version_select at 0x7f31922b2040>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:57.246866 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ee549613-ca97-45d2-9f21-deb674ca4c71 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:57.254723 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ee549613-ca97-45d2-9f21-deb674ca4c71 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 200 len: 1423 microversion: 2.1 time: 0.109692 Oct 10 18:53:57.268929 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 521/1211] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:57 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 1423 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:57.561374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8dcc09fd-0ee6-4596-84c8-b6a406a5b2b7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:57.562249 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8dcc09fd-0ee6-4596-84c8-b6a406a5b2b7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:57.568976 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8dcc09fd-0ee6-4596-84c8-b6a406a5b2b7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:57.569682 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8dcc09fd-0ee6-4596-84c8-b6a406a5b2b7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:57.575222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8dcc09fd-0ee6-4596-84c8-b6a406a5b2b7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:57.576397 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8dcc09fd-0ee6-4596-84c8-b6a406a5b2b7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:57.577047 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8dcc09fd-0ee6-4596-84c8-b6a406a5b2b7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:57.577658 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8dcc09fd-0ee6-4596-84c8-b6a406a5b2b7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:57.741606 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=4 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:53:57.839495 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8dcc09fd-0ee6-4596-84c8-b6a406a5b2b7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:57.850458 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8dcc09fd-0ee6-4596-84c8-b6a406a5b2b7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:57.852005 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8dcc09fd-0ee6-4596-84c8-b6a406a5b2b7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:57.863703 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-84762b82-6bb3-4452-a5f8-678e18e2eac4 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/d20c1efa-0ba4-4b64-8c37-113486fa8867" status: 202 len: 0 microversion: 2.1 time: 0.629770 Oct 10 18:53:57.864157 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 691/1212] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:57 2022] DELETE /compute/v2.1/os-security-groups/d20c1efa-0ba4-4b64-8c37-113486fa8867 => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:57.866755 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8dcc09fd-0ee6-4596-84c8-b6a406a5b2b7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1567 microversion: 2.25 time: 0.309705 Oct 10 18:53:57.869709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d9c795ed-c469-4271-8321-76cdc6553bac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:57.870319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d9c795ed-c469-4271-8321-76cdc6553bac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:57.870746 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 522/1213] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:57 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1567 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:57.890299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-04af3086-32ae-46a9-a1f1-3b3745a59cc3 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Calling method '.version_select at 0x7f318dd2be50>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:57.908115 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d9c795ed-c469-4271-8321-76cdc6553bac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:57.908866 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d9c795ed-c469-4271-8321-76cdc6553bac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:57.909073 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d9c795ed-c469-4271-8321-76cdc6553bac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:57.909793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d9c795ed-c469-4271-8321-76cdc6553bac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:57.926730 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d9c795ed-c469-4271-8321-76cdc6553bac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:57.928877 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d9c795ed-c469-4271-8321-76cdc6553bac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:58.347382 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-04af3086-32ae-46a9-a1f1-3b3745a59cc3 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/1a420a78-6604-43ef-9182-1122013946d4" status: 202 len: 0 microversion: 2.1 time: 0.475230 Oct 10 18:53:58.355559 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 523/1214] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:57 2022] DELETE /compute/v2.1/os-security-groups/1a420a78-6604-43ef-9182-1122013946d4 => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:53:58.360240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6019c7df-f3f7-4355-b9cc-2c9bbc8a8cad tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:58.360893 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6019c7df-f3f7-4355-b9cc-2c9bbc8a8cad tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:58.370244 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d9c795ed-c469-4271-8321-76cdc6553bac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:58.371853 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6019c7df-f3f7-4355-b9cc-2c9bbc8a8cad tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:58.372357 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6019c7df-f3f7-4355-b9cc-2c9bbc8a8cad tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:58.375976 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6019c7df-f3f7-4355-b9cc-2c9bbc8a8cad tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:58.377166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6019c7df-f3f7-4355-b9cc-2c9bbc8a8cad tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:58.377658 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6019c7df-f3f7-4355-b9cc-2c9bbc8a8cad tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:58.378101 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6019c7df-f3f7-4355-b9cc-2c9bbc8a8cad tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:58.430198 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d9c795ed-c469-4271-8321-76cdc6553bac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1317 microversion: 2.1 time: 0.564529 Oct 10 18:53:58.451035 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 692/1215] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:57 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:58.464863 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3cb01165-15d8-4c5f-9ae6-9b9b110299a8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:58.464863 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3cb01165-15d8-4c5f-9ae6-9b9b110299a8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:58.494292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3cb01165-15d8-4c5f-9ae6-9b9b110299a8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:58.494292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3cb01165-15d8-4c5f-9ae6-9b9b110299a8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:58.495300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3cb01165-15d8-4c5f-9ae6-9b9b110299a8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:58.496622 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3cb01165-15d8-4c5f-9ae6-9b9b110299a8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:58.498973 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3cb01165-15d8-4c5f-9ae6-9b9b110299a8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:58.500999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3cb01165-15d8-4c5f-9ae6-9b9b110299a8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:58.823679 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6019c7df-f3f7-4355-b9cc-2c9bbc8a8cad tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:58.836345 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6019c7df-f3f7-4355-b9cc-2c9bbc8a8cad tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1366 microversion: 2.1 time: 0.484768 Oct 10 18:53:58.845670 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 524/1216] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:58 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1366 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:58.851204 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f4410e96-0af6-4dee-b8d2-168c06b00841 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:58.852112 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f4410e96-0af6-4dee-b8d2-168c06b00841 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: 367f9726-b32e-4ce6-94f8-b4075d746833] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:58.869371 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4410e96-0af6-4dee-b8d2-168c06b00841 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:58.870194 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4410e96-0af6-4dee-b8d2-168c06b00841 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:58.873489 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4410e96-0af6-4dee-b8d2-168c06b00841 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:58.875610 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4410e96-0af6-4dee-b8d2-168c06b00841 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:58.877525 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4410e96-0af6-4dee-b8d2-168c06b00841 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:58.878146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4410e96-0af6-4dee-b8d2-168c06b00841 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:58.911190 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-f4410e96-0af6-4dee-b8d2-168c06b00841 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] HTTP exception thrown: Instance 367f9726-b32e-4ce6-94f8-b4075d746833 could not be found. Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f4410e96-0af6-4dee-b8d2-168c06b00841 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Request method failure captured: Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 HTTP/1.1 Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGn_0vXSyV8dxNeLA6P5DGwdq0HWvlskw21asQH56ago3WlRS3HEAxgTfzCRIqNJXLudKX4biC9d2wl3Va9TzLbEd_QlJhvc0lgy77skuScvEWm-JWGg2CgbhMVQmVAuTw-VUiy2gS9EOY8kABX4-4rfP4jTks09mXzdLEvhv2Ie8DI Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 9fedc5f489634425b4bbae61ab3897bd Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-LiveMigrationNegativeTest-1066962994 Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9fedc5f489634425b4bbae61ab3897bd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9fedc5f489634425b4bbae61ab3897bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9fedc5f489634425b4bbae61ab3897bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9fedc5f489634425b4bbae61ab3897bd"}]}] Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-LiveMigrationNegativeTest-1066962994 Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 9fedc5f489634425b4bbae61ab3897bd Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1066962994 Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-LiveMigrationNegativeTest-1066962994-project Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 7f32dfaf09884d848804aed1ed5a2be4 Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-LiveMigrationNegativeTest-1066962994-project Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 367f9726-b32e-4ce6-94f8-b4075d746833 could not be found. Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '367f9726-b32e-4ce6-94f8-b4075d746833'} Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 367f9726-b32e-4ce6-94f8-b4075d746833 could not be found. Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 367f9726-b32e-4ce6-94f8-b4075d746833 could not be found. Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:53:58.916920 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:58.922666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:53:58.922666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:53:58.922666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:53:58.922666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:53:58.922666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:53:58.922666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 367f9726-b32e-4ce6-94f8-b4075d746833 could not be found. Oct 10 18:53:58.922666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:53:58.923911 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3cb01165-15d8-4c5f-9ae6-9b9b110299a8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:58.925242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f4410e96-0af6-4dee-b8d2-168c06b00841 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Returning 404 to user: Instance 367f9726-b32e-4ce6-94f8-b4075d746833 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:53:58.926928 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f4410e96-0af6-4dee-b8d2-168c06b00841 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833" status: 404 len: 111 microversion: 2.1 time: 0.088836 Oct 10 18:53:58.929498 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 525/1217] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:58 2022] GET /compute/v2.1/servers/367f9726-b32e-4ce6-94f8-b4075d746833 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:53:58.943466 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0877c039-7fed-4244-8eee-ec221596fa5a tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Calling method '.version_select at 0x7f318de4e790>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:58.943994 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3cb01165-15d8-4c5f-9ae6-9b9b110299a8 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.491727 Oct 10 18:53:58.947762 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 693/1218] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:58 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:53:58.963373 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-89518ff5-2098-4155-b186-241834838d8d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:58.963373 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-89518ff5-2098-4155-b186-241834838d8d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:58.968478 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-89518ff5-2098-4155-b186-241834838d8d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:58.968995 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-89518ff5-2098-4155-b186-241834838d8d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:58.969429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-89518ff5-2098-4155-b186-241834838d8d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:58.970140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-89518ff5-2098-4155-b186-241834838d8d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:58.970590 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-89518ff5-2098-4155-b186-241834838d8d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:58.971162 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-89518ff5-2098-4155-b186-241834838d8d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:59.280508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-89518ff5-2098-4155-b186-241834838d8d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:59.292048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-89518ff5-2098-4155-b186-241834838d8d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:59.294872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-89518ff5-2098-4155-b186-241834838d8d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:53:59.301161 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-89518ff5-2098-4155-b186-241834838d8d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1567 microversion: 2.25 time: 0.351727 Oct 10 18:53:59.302894 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 694/1219] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:53:58 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1567 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:53:59.312371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1d9ea9a4-95c0-4fce-aaae-b8405399adc0 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:59.313029 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1d9ea9a4-95c0-4fce-aaae-b8405399adc0 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:59.321394 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d9ea9a4-95c0-4fce-aaae-b8405399adc0 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:59.322383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d9ea9a4-95c0-4fce-aaae-b8405399adc0 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:59.327830 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d9ea9a4-95c0-4fce-aaae-b8405399adc0 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:59.328499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d9ea9a4-95c0-4fce-aaae-b8405399adc0 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:59.328984 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d9ea9a4-95c0-4fce-aaae-b8405399adc0 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:59.329435 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d9ea9a4-95c0-4fce-aaae-b8405399adc0 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:59.374346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1d9ea9a4-95c0-4fce-aaae-b8405399adc0 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:53:59.904971 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1d9ea9a4-95c0-4fce-aaae-b8405399adc0 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 204 len: 0 microversion: 2.1 time: 0.599996 Oct 10 18:53:59.909787 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 695/1220] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:53:59 2022] DELETE /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:53:59.919578 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bf59a759-47e3-4dd2-bfe7-a8f9c91212c5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:53:59.923178 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bf59a759-47e3-4dd2-bfe7-a8f9c91212c5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:53:59.943180 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bf59a759-47e3-4dd2-bfe7-a8f9c91212c5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:59.943685 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bf59a759-47e3-4dd2-bfe7-a8f9c91212c5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:59.944144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bf59a759-47e3-4dd2-bfe7-a8f9c91212c5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:53:59.944953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bf59a759-47e3-4dd2-bfe7-a8f9c91212c5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:53:59.946705 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bf59a759-47e3-4dd2-bfe7-a8f9c91212c5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:53:59.947381 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bf59a759-47e3-4dd2-bfe7-a8f9c91212c5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:00.079725 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0877c039-7fed-4244-8eee-ec221596fa5a tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/6a038e47-a941-4a59-bd76-885db1d34e3e" status: 202 len: 0 microversion: 2.1 time: 1.146569 Oct 10 18:54:00.080576 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 526/1221] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:53:58 2022] DELETE /compute/v2.1/os-security-groups/6a038e47-a941-4a59-bd76-885db1d34e3e => generated 0 bytes in 1150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:54:00.092300 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ffc3e17e-24d3-450d-91ac-194bda70c2b3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:00.093138 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ffc3e17e-24d3-450d-91ac-194bda70c2b3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:00.111936 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffc3e17e-24d3-450d-91ac-194bda70c2b3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:00.120740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffc3e17e-24d3-450d-91ac-194bda70c2b3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:00.120740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffc3e17e-24d3-450d-91ac-194bda70c2b3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:00.120740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffc3e17e-24d3-450d-91ac-194bda70c2b3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:00.120740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffc3e17e-24d3-450d-91ac-194bda70c2b3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:00.123611 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffc3e17e-24d3-450d-91ac-194bda70c2b3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:00.141930 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bf59a759-47e3-4dd2-bfe7-a8f9c91212c5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:00.158829 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bf59a759-47e3-4dd2-bfe7-a8f9c91212c5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1317 microversion: 2.1 time: 0.247432 Oct 10 18:54:00.177212 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 696/1222] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:53:59 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:00.186965 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-52390248-acd8-4108-a26a-7e79355a60a3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:00.187574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-52390248-acd8-4108-a26a-7e79355a60a3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:00.199012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:00.200723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-52390248-acd8-4108-a26a-7e79355a60a3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:00.201756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-52390248-acd8-4108-a26a-7e79355a60a3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:00.202341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-52390248-acd8-4108-a26a-7e79355a60a3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:00.203198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-52390248-acd8-4108-a26a-7e79355a60a3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:00.203811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-52390248-acd8-4108-a26a-7e79355a60a3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:00.204391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-52390248-acd8-4108-a26a-7e79355a60a3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:00.448584 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ffc3e17e-24d3-450d-91ac-194bda70c2b3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:00.457651 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ffc3e17e-24d3-450d-91ac-194bda70c2b3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1366 microversion: 2.1 time: 0.375903 Oct 10 18:54:00.458776 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 527/1223] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:00 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:00.484419 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-61f6e2dc-3446-446c-a8f0-27f3ba9d868f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:00.485390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-61f6e2dc-3446-446c-a8f0-27f3ba9d868f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:00.494475 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-61f6e2dc-3446-446c-a8f0-27f3ba9d868f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:00.495175 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-61f6e2dc-3446-446c-a8f0-27f3ba9d868f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:00.495964 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-61f6e2dc-3446-446c-a8f0-27f3ba9d868f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:00.496984 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-61f6e2dc-3446-446c-a8f0-27f3ba9d868f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:00.497608 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-61f6e2dc-3446-446c-a8f0-27f3ba9d868f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:00.498220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-61f6e2dc-3446-446c-a8f0-27f3ba9d868f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:00.705191 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-61f6e2dc-3446-446c-a8f0-27f3ba9d868f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:00.722103 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-61f6e2dc-3446-446c-a8f0-27f3ba9d868f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.243652 Oct 10 18:54:00.723553 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 528/1224] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:00 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:00.856411 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-52390248-acd8-4108-a26a-7e79355a60a3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:00.866828 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-52390248-acd8-4108-a26a-7e79355a60a3 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1473 microversion: 2.1 time: 0.688469 Oct 10 18:54:00.867609 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 697/1225] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:00 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1473 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:00.872940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b26a02da-43ec-4a13-92dd-44172d297541 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] Calling method '.version_select at 0x7f319225e9d0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:00.906530 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-02a24f03-710e-4dfa-8782-9facd5a8b68e tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Action: 'create', calling method: .version_select at 0x7f318de4edc0>, body: {"keypair": {"name": "tempest-keypair-519925193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKciFeRFY3iJ/IpXzjt8a/scUdXsto7RdvTQGWr3L1hMoY+nLVtZVZ0DhOMGcGdjKkNnG+WaaITMqQxv6xWW6oVIsUcsVxr1/qjSvFa4Ubm5Wvv/2sq0F/LO5MmoqP0S8A=="}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:00.923355 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-02a24f03-710e-4dfa-8782-9facd5a8b68e tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Getting quotas for project 66d3b0a2007b41e59c5006778d1b5d76. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:54:00.928574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-02a24f03-710e-4dfa-8782-9facd5a8b68e tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Getting quotas for user 2092dd5ed84e414ba0000c3816b7b6f6 and project 66d3b0a2007b41e59c5006778d1b5d76. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:54:00.995537 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-02a24f03-710e-4dfa-8782-9facd5a8b68e tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.270669 Oct 10 18:54:00.996428 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 529/1226] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:54:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:01.008797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-39d91511-dfcf-463f-94db-918d8640d1be tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:01.010628 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-39d91511-dfcf-463f-94db-918d8640d1be tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:01.024266 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39d91511-dfcf-463f-94db-918d8640d1be tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:01.025717 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39d91511-dfcf-463f-94db-918d8640d1be tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:01.026908 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39d91511-dfcf-463f-94db-918d8640d1be tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:01.027863 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39d91511-dfcf-463f-94db-918d8640d1be tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:01.029065 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39d91511-dfcf-463f-94db-918d8640d1be tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:01.029934 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-39d91511-dfcf-463f-94db-918d8640d1be tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:01.225090 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b26a02da-43ec-4a13-92dd-44172d297541 tempest-SecurityGroupRulesNegativeTestJSON-1680406612 tempest-SecurityGroupRulesNegativeTestJSON-1680406612-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/b16d63a5-3297-428b-9300-18019b906ab2" status: 202 len: 0 microversion: 2.1 time: 0.356256 Oct 10 18:54:01.226284 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 698/1227] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:54:00 2022] DELETE /compute/v2.1/os-security-groups/b16d63a5-3297-428b-9300-18019b906ab2 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:54:01.237610 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-39d91511-dfcf-463f-94db-918d8640d1be tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:01.239206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fd05e20b-0932-4573-8639-edb5987fee4a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "752ecc79-3e91-46d4-b378-aaf2a8d344fc"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:01.246224 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fd05e20b-0932-4573-8639-edb5987fee4a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:01.249825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-39d91511-dfcf-463f-94db-918d8640d1be tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:01.249825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-39d91511-dfcf-463f-94db-918d8640d1be tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:01.250717 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-39d91511-dfcf-463f-94db-918d8640d1be tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1567 microversion: 2.25 time: 0.253619 Oct 10 18:54:01.251467 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 530/1228] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:00 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:01.255920 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-85714cd4-8e33-4a2c-930d-3294c9012884 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:01.257103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-85714cd4-8e33-4a2c-930d-3294c9012884 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:01.260562 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd05e20b-0932-4573-8639-edb5987fee4a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:01.263269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85714cd4-8e33-4a2c-930d-3294c9012884 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:01.263744 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85714cd4-8e33-4a2c-930d-3294c9012884 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:01.263904 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd05e20b-0932-4573-8639-edb5987fee4a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:01.264170 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85714cd4-8e33-4a2c-930d-3294c9012884 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:01.264463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd05e20b-0932-4573-8639-edb5987fee4a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:01.264882 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85714cd4-8e33-4a2c-930d-3294c9012884 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:01.265326 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd05e20b-0932-4573-8639-edb5987fee4a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:01.265533 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85714cd4-8e33-4a2c-930d-3294c9012884 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:01.265909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd05e20b-0932-4573-8639-edb5987fee4a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:01.266026 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85714cd4-8e33-4a2c-930d-3294c9012884 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:01.278145 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd05e20b-0932-4573-8639-edb5987fee4a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:01.295493 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:01.482644 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=8 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:01.619838 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-85714cd4-8e33-4a2c-930d-3294c9012884 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:01.644639 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-85714cd4-8e33-4a2c-930d-3294c9012884 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1317 microversion: 2.1 time: 0.392094 Oct 10 18:54:01.645170 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 531/1229] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:01 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:01.660512 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1a34eec0-9e31-49aa-baab-df7bdd6de14e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:01.666374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1a34eec0-9e31-49aa-baab-df7bdd6de14e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:01.675594 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a34eec0-9e31-49aa-baab-df7bdd6de14e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:01.676351 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a34eec0-9e31-49aa-baab-df7bdd6de14e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:01.677029 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a34eec0-9e31-49aa-baab-df7bdd6de14e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:01.677967 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a34eec0-9e31-49aa-baab-df7bdd6de14e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:01.681926 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a34eec0-9e31-49aa-baab-df7bdd6de14e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:01.682633 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a34eec0-9e31-49aa-baab-df7bdd6de14e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:01.948003 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1a34eec0-9e31-49aa-baab-df7bdd6de14e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:01.969375 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1a34eec0-9e31-49aa-baab-df7bdd6de14e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1366 microversion: 2.1 time: 0.321058 Oct 10 18:54:01.970341 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 532/1230] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:01 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:01.975226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-a44bff7b-1f0c-4564-a75b-941e0baa8e31 req-8ce3c78d-5aa1-48a8-a108-5cf7e4830559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92880065-c226-4118-9326-529eff171df0", "name": "network-vif-plugged", "status": "completed", "tag": "887bde6f-cc1f-4045-9db8-fd17432c6ed5"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:02.011845 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-a44bff7b-1f0c-4564-a75b-941e0baa8e31 req-8ce3c78d-5aa1-48a8-a108-5cf7e4830559 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:02.013459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-a44bff7b-1f0c-4564-a75b-941e0baa8e31 req-8ce3c78d-5aa1-48a8-a108-5cf7e4830559 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:02.014104 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-a44bff7b-1f0c-4564-a75b-941e0baa8e31 req-8ce3c78d-5aa1-48a8-a108-5cf7e4830559 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:02.036819 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-a44bff7b-1f0c-4564-a75b-941e0baa8e31 req-8ce3c78d-5aa1-48a8-a108-5cf7e4830559 service nova] Creating event network-vif-plugged:887bde6f-cc1f-4045-9db8-fd17432c6ed5 for instance 92880065-c226-4118-9326-529eff171df0 on n-h1-860863-1 Oct 10 18:54:02.041982 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-a44bff7b-1f0c-4564-a75b-941e0baa8e31 req-8ce3c78d-5aa1-48a8-a108-5cf7e4830559 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070515 Oct 10 18:54:02.042706 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 533/1231] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:02.048393 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-795e2714-ff31-4398-afbf-42f4b3ae92dd tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:02.049222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-795e2714-ff31-4398-afbf-42f4b3ae92dd tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:02.068885 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-795e2714-ff31-4398-afbf-42f4b3ae92dd tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:02.069487 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-795e2714-ff31-4398-afbf-42f4b3ae92dd tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:02.070034 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-795e2714-ff31-4398-afbf-42f4b3ae92dd tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:02.070923 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-795e2714-ff31-4398-afbf-42f4b3ae92dd tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:02.078973 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-795e2714-ff31-4398-afbf-42f4b3ae92dd tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:02.082441 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-795e2714-ff31-4398-afbf-42f4b3ae92dd tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:02.287453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-795e2714-ff31-4398-afbf-42f4b3ae92dd tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:02.310502 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-795e2714-ff31-4398-afbf-42f4b3ae92dd tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.266311 Oct 10 18:54:02.331342 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 534/1232] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:02 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:02.337126 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4b65650b-49db-4154-89e0-4613dae8be27 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:02.337784 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4b65650b-49db-4154-89e0-4613dae8be27 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:02.346087 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4b65650b-49db-4154-89e0-4613dae8be27 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:02.347226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4b65650b-49db-4154-89e0-4613dae8be27 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:02.348066 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4b65650b-49db-4154-89e0-4613dae8be27 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:02.348347 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4b65650b-49db-4154-89e0-4613dae8be27 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:02.348910 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4b65650b-49db-4154-89e0-4613dae8be27 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:02.349389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4b65650b-49db-4154-89e0-4613dae8be27 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:02.388239 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fd05e20b-0932-4573-8639-edb5987fee4a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "POST /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.160087 Oct 10 18:54:02.395685 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 699/1233] 10.222.0.43 () {60 vars in 1323 bytes} [Mon Oct 10 18:54:01 2022] POST /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac/os-volume_attachments => generated 194 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:02.403337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-63f19f79-5539-4ad4-bebe-e9c20406051e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:02.410945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-63f19f79-5539-4ad4-bebe-e9c20406051e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:02.413537 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-63f19f79-5539-4ad4-bebe-e9c20406051e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:02.414281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-63f19f79-5539-4ad4-bebe-e9c20406051e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:02.414962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-63f19f79-5539-4ad4-bebe-e9c20406051e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:02.417014 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-63f19f79-5539-4ad4-bebe-e9c20406051e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:02.417713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-63f19f79-5539-4ad4-bebe-e9c20406051e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:02.420784 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-63f19f79-5539-4ad4-bebe-e9c20406051e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:02.454665 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4b65650b-49db-4154-89e0-4613dae8be27 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:02.463956 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4b65650b-49db-4154-89e0-4613dae8be27 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1431 microversion: 2.1 time: 0.131384 Oct 10 18:54:02.465782 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 535/1234] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:02 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1431 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:02.471260 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-c5b35873-69d5-4e4f-986c-dd7813f89ef8 req-aaf0c35b-d8cb-4017-bfb6-48fefdddc671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed92d033-c393-4d15-9e85-dd766e282c93", "name": "network-vif-deleted", "tag": "c0c929a1-c74e-4013-8143-77bc81c7d571"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:02.482974 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:02.485114 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-c5b35873-69d5-4e4f-986c-dd7813f89ef8 req-aaf0c35b-d8cb-4017-bfb6-48fefdddc671 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:02.485592 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-c5b35873-69d5-4e4f-986c-dd7813f89ef8 req-aaf0c35b-d8cb-4017-bfb6-48fefdddc671 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:02.486070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-c5b35873-69d5-4e4f-986c-dd7813f89ef8 req-aaf0c35b-d8cb-4017-bfb6-48fefdddc671 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:02.524975 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-c5b35873-69d5-4e4f-986c-dd7813f89ef8 req-aaf0c35b-d8cb-4017-bfb6-48fefdddc671 service nova] Creating event network-vif-deleted:c0c929a1-c74e-4013-8143-77bc81c7d571 for instance ed92d033-c393-4d15-9e85-dd766e282c93 on n-h2-860863-1 Oct 10 18:54:02.536299 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-c5b35873-69d5-4e4f-986c-dd7813f89ef8 req-aaf0c35b-d8cb-4017-bfb6-48fefdddc671 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069087 Oct 10 18:54:02.537213 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 536/1235] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:02.671923 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6fc305a3-3a13-40f8-a353-627b7df5e386 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:02.672763 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6fc305a3-3a13-40f8-a353-627b7df5e386 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:02.686864 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6fc305a3-3a13-40f8-a353-627b7df5e386 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:02.687685 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6fc305a3-3a13-40f8-a353-627b7df5e386 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:02.688780 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6fc305a3-3a13-40f8-a353-627b7df5e386 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:02.693235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6fc305a3-3a13-40f8-a353-627b7df5e386 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:02.693235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6fc305a3-3a13-40f8-a353-627b7df5e386 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:02.693235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6fc305a3-3a13-40f8-a353-627b7df5e386 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:02.902315 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-63f19f79-5539-4ad4-bebe-e9c20406051e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:02.914631 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-63f19f79-5539-4ad4-bebe-e9c20406051e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:02.917945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-63f19f79-5539-4ad4-bebe-e9c20406051e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:02.919443 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-63f19f79-5539-4ad4-bebe-e9c20406051e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1542 microversion: 2.25 time: 0.522455 Oct 10 18:54:02.920727 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 700/1236] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:02 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1542 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:02.946964 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-39acd3a6-d4a8-49a3-ab71-7a30f251d41c tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '.version_select at 0x7f31921b80d0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:02.953477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39acd3a6-d4a8-49a3-ab71-7a30f251d41c tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:02.957181 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39acd3a6-d4a8-49a3-ab71-7a30f251d41c tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:02.957181 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39acd3a6-d4a8-49a3-ab71-7a30f251d41c tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:02.979432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6fc305a3-3a13-40f8-a353-627b7df5e386 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:02.988203 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6fc305a3-3a13-40f8-a353-627b7df5e386 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1317 microversion: 2.1 time: 0.321721 Oct 10 18:54:03.005225 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 537/1237] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:02 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:03.005225 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f6f79494-2612-4494-b00d-50323cb87787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:03.005225 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f6f79494-2612-4494-b00d-50323cb87787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:03.024642 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6f79494-2612-4494-b00d-50323cb87787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:03.024642 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6f79494-2612-4494-b00d-50323cb87787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:03.024642 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6f79494-2612-4494-b00d-50323cb87787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:03.024642 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6f79494-2612-4494-b00d-50323cb87787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:03.024642 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6f79494-2612-4494-b00d-50323cb87787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:03.024642 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6f79494-2612-4494-b00d-50323cb87787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:03.030593 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-39acd3a6-d4a8-49a3-ab71-7a30f251d41c tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1100 microversion: 2.25 time: 0.084011 Oct 10 18:54:03.043297 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 701/1238] 10.222.0.43 () {60 vars in 1184 bytes} [Mon Oct 10 18:54:02 2022] GET /compute/v2.1/os-migrations => generated 1100 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:03.063848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f7625d09-ead9-4b0b-aa36-99ff07d6419e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:03.069285 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f7625d09-ead9-4b0b-aa36-99ff07d6419e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:03.092239 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7625d09-ead9-4b0b-aa36-99ff07d6419e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:03.094099 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7625d09-ead9-4b0b-aa36-99ff07d6419e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:03.096903 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7625d09-ead9-4b0b-aa36-99ff07d6419e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:03.099195 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7625d09-ead9-4b0b-aa36-99ff07d6419e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:03.102240 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7625d09-ead9-4b0b-aa36-99ff07d6419e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:03.103077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7625d09-ead9-4b0b-aa36-99ff07d6419e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:03.274630 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f6f79494-2612-4494-b00d-50323cb87787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:03.282750 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f6f79494-2612-4494-b00d-50323cb87787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1366 microversion: 2.1 time: 0.284621 Oct 10 18:54:03.283328 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 538/1239] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:02 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:03.337767 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e717bd0e-7f67-401c-b338-e01f7d3ffd08 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:03.339042 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e717bd0e-7f67-401c-b338-e01f7d3ffd08 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:03.351219 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e717bd0e-7f67-401c-b338-e01f7d3ffd08 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:03.354185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e717bd0e-7f67-401c-b338-e01f7d3ffd08 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:03.354185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e717bd0e-7f67-401c-b338-e01f7d3ffd08 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:03.354185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e717bd0e-7f67-401c-b338-e01f7d3ffd08 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:03.355908 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e717bd0e-7f67-401c-b338-e01f7d3ffd08 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:03.357157 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e717bd0e-7f67-401c-b338-e01f7d3ffd08 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:03.457576 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-f7625d09-ead9-4b0b-aa36-99ff07d6419e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid d89b360b-2f7e-4f80-9247-559c3b0cf714 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:54:03.490122 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f7625d09-ead9-4b0b-aa36-99ff07d6419e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 2035 microversion: 2.25 time: 0.444736 Oct 10 18:54:03.491147 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 702/1240] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:03 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 2035 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:03.497780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-27b4f7e2-123b-49b0-af75-481d73d96a45 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:03.498747 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-27b4f7e2-123b-49b0-af75-481d73d96a45 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:03.505439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27b4f7e2-123b-49b0-af75-481d73d96a45 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:03.506268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27b4f7e2-123b-49b0-af75-481d73d96a45 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:03.506882 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27b4f7e2-123b-49b0-af75-481d73d96a45 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:03.508243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27b4f7e2-123b-49b0-af75-481d73d96a45 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:03.509029 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27b4f7e2-123b-49b0-af75-481d73d96a45 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:03.509654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27b4f7e2-123b-49b0-af75-481d73d96a45 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:03.633142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27b4f7e2-123b-49b0-af75-481d73d96a45 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:03.633142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27b4f7e2-123b-49b0-af75-481d73d96a45 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:03.633142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27b4f7e2-123b-49b0-af75-481d73d96a45 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:03.633142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-27b4f7e2-123b-49b0-af75-481d73d96a45 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lazy-loading 'fault' on Instance uuid ed92d033-c393-4d15-9e85-dd766e282c93 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:54:03.699455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-27b4f7e2-123b-49b0-af75-481d73d96a45 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f32dfaf09884d848804aed1ed5a2be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fedc5f489634425b4bbae61ab3897bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:03.709501 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-27b4f7e2-123b-49b0-af75-481d73d96a45 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 200 len: 1308 microversion: 2.1 time: 0.216537 Oct 10 18:54:03.714307 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 703/1241] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:03 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:03.733277 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e717bd0e-7f67-401c-b338-e01f7d3ffd08 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:03.741096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5b02e81f-4de4-4aeb-897b-c84ed1299f3d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Action: 'create', calling method: .version_select at 0x7f3192357160>, body: {"keypair": {"name": "tempest-keypair-292837945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+sKznTOLZlBuqhEC9/iZ+5S7LyO/icBkWlMjfp3rKYh8l45kIMRe/wVKx56amDPDDuJX+HNriz3dBU4iX9t3+4R9KUFnSkA/ZMJXnntnndkYWZdyk+xTycjrNPOsHqnA=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:03.749382 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e717bd0e-7f67-401c-b338-e01f7d3ffd08 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.411831 Oct 10 18:54:03.750016 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 539/1242] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:03 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:03.769265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-5b02e81f-4de4-4aeb-897b-c84ed1299f3d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Getting quotas for project 8ca11fe18cc64adfbc06166601106c7c. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:54:03.778715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-5b02e81f-4de4-4aeb-897b-c84ed1299f3d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Getting quotas for user 789ef7a66ff042b9abebe36823008f8f and project 8ca11fe18cc64adfbc06166601106c7c. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:54:03.924839 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5b02e81f-4de4-4aeb-897b-c84ed1299f3d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.205450 Oct 10 18:54:03.924839 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 704/1243] 10.222.0.43 () {62 vars in 1200 bytes} [Mon Oct 10 18:54:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 209 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 18:54:04.017379 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-30d8ac7e-1a58-40c3-b9c9-5f8b39f08319 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:04.018287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-30d8ac7e-1a58-40c3-b9c9-5f8b39f08319 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:04.032818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-30d8ac7e-1a58-40c3-b9c9-5f8b39f08319 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:04.036051 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-30d8ac7e-1a58-40c3-b9c9-5f8b39f08319 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:04.036797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-30d8ac7e-1a58-40c3-b9c9-5f8b39f08319 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:04.037773 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-30d8ac7e-1a58-40c3-b9c9-5f8b39f08319 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:04.038459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-30d8ac7e-1a58-40c3-b9c9-5f8b39f08319 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:04.039146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-30d8ac7e-1a58-40c3-b9c9-5f8b39f08319 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:04.066709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-2b46c0e9-ce1c-47fe-af70-d5c22d90da28 req-27791314-f1d0-42ab-967f-dfab50bef7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc84705b-369f-4b67-a7ad-4cb62ba09d40", "name": "network-vif-plugged", "status": "completed", "tag": "7fa49e0d-3a83-4a67-b0a9-cfc6f8f332ef"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:04.103962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-2b46c0e9-ce1c-47fe-af70-d5c22d90da28 req-27791314-f1d0-42ab-967f-dfab50bef7a0 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:04.104442 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-2b46c0e9-ce1c-47fe-af70-d5c22d90da28 req-27791314-f1d0-42ab-967f-dfab50bef7a0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:04.104909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-2b46c0e9-ce1c-47fe-af70-d5c22d90da28 req-27791314-f1d0-42ab-967f-dfab50bef7a0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:04.127217 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-2b46c0e9-ce1c-47fe-af70-d5c22d90da28 req-27791314-f1d0-42ab-967f-dfab50bef7a0 service nova] Creating event network-vif-plugged:7fa49e0d-3a83-4a67-b0a9-cfc6f8f332ef for instance bc84705b-369f-4b67-a7ad-4cb62ba09d40 on n-h2-860863-1 Oct 10 18:54:04.133785 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-2b46c0e9-ce1c-47fe-af70-d5c22d90da28 req-27791314-f1d0-42ab-967f-dfab50bef7a0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073212 Oct 10 18:54:04.135736 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 705/1244] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:04.278061 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-30d8ac7e-1a58-40c3-b9c9-5f8b39f08319 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:04.288999 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-30d8ac7e-1a58-40c3-b9c9-5f8b39f08319 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1467 microversion: 2.1 time: 0.275285 Oct 10 18:54:04.291161 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 540/1245] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:04 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1467 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:04.320154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-384c1c6c-5b61-4be8-89b5-24aa9c4fd5de tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:04.320916 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-384c1c6c-5b61-4be8-89b5-24aa9c4fd5de tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:04.323171 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-07408acc-cbf3-4cb0-b41a-a41e1976648f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:04.323843 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-07408acc-cbf3-4cb0-b41a-a41e1976648f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:04.338892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07408acc-cbf3-4cb0-b41a-a41e1976648f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:04.338892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07408acc-cbf3-4cb0-b41a-a41e1976648f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:04.338892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07408acc-cbf3-4cb0-b41a-a41e1976648f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:04.339657 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07408acc-cbf3-4cb0-b41a-a41e1976648f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:04.340119 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07408acc-cbf3-4cb0-b41a-a41e1976648f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:04.340489 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-384c1c6c-5b61-4be8-89b5-24aa9c4fd5de tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:04.341200 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-384c1c6c-5b61-4be8-89b5-24aa9c4fd5de tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:04.342131 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-384c1c6c-5b61-4be8-89b5-24aa9c4fd5de tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:04.343360 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-384c1c6c-5b61-4be8-89b5-24aa9c4fd5de tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:04.344329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07408acc-cbf3-4cb0-b41a-a41e1976648f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:04.346388 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-384c1c6c-5b61-4be8-89b5-24aa9c4fd5de tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:04.347044 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-384c1c6c-5b61-4be8-89b5-24aa9c4fd5de tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:04.363767 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:04.607163 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-07408acc-cbf3-4cb0-b41a-a41e1976648f tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1618 microversion: 2.1 time: 0.293972 Oct 10 18:54:04.608365 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 541/1246] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:04 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1618 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:04.682452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-384c1c6c-5b61-4be8-89b5-24aa9c4fd5de tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:04.699637 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-384c1c6c-5b61-4be8-89b5-24aa9c4fd5de tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1366 microversion: 2.1 time: 0.388203 Oct 10 18:54:04.701627 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 706/1247] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:04 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:04.749645 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-720e69e2-3ccd-4717-9df6-433e0d142931 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:04.750272 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-720e69e2-3ccd-4717-9df6-433e0d142931 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] [instance: ed92d033-c393-4d15-9e85-dd766e282c93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:04.756773 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-720e69e2-3ccd-4717-9df6-433e0d142931 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:04.757269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-720e69e2-3ccd-4717-9df6-433e0d142931 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:04.761331 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-720e69e2-3ccd-4717-9df6-433e0d142931 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:04.761331 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-720e69e2-3ccd-4717-9df6-433e0d142931 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:04.761331 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-720e69e2-3ccd-4717-9df6-433e0d142931 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:04.761331 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-720e69e2-3ccd-4717-9df6-433e0d142931 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:04.773883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-00459e63-16b5-4d1c-a30a-aa3ba0d3dcec tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:04.774776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-00459e63-16b5-4d1c-a30a-aa3ba0d3dcec tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:04.786706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00459e63-16b5-4d1c-a30a-aa3ba0d3dcec tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:04.790037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00459e63-16b5-4d1c-a30a-aa3ba0d3dcec tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:04.790037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00459e63-16b5-4d1c-a30a-aa3ba0d3dcec tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:04.790037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00459e63-16b5-4d1c-a30a-aa3ba0d3dcec tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:04.791824 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00459e63-16b5-4d1c-a30a-aa3ba0d3dcec tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:04.793022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00459e63-16b5-4d1c-a30a-aa3ba0d3dcec tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:04.813875 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-720e69e2-3ccd-4717-9df6-433e0d142931 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] HTTP exception thrown: Instance ed92d033-c393-4d15-9e85-dd766e282c93 could not be found. Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-720e69e2-3ccd-4717-9df6-433e0d142931 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Request method failure captured: Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 HTTP/1.1 Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGn_0vXSyV8dxNeLA6P5DGwdq0HWvlskw21asQH56ago3WlRS3HEAxgTfzCRIqNJXLudKX4biC9d2wl3Va9TzLbEd_QlJhvc0lgy77skuScvEWm-JWGg2CgbhMVQmVAuTw-VUiy2gS9EOY8kABX4-4rfP4jTks09mXzdLEvhv2Ie8DI Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 9fedc5f489634425b4bbae61ab3897bd Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-LiveMigrationNegativeTest-1066962994 Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9fedc5f489634425b4bbae61ab3897bd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9fedc5f489634425b4bbae61ab3897bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9fedc5f489634425b4bbae61ab3897bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9fedc5f489634425b4bbae61ab3897bd"}]}] Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-LiveMigrationNegativeTest-1066962994 Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 9fedc5f489634425b4bbae61ab3897bd Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1066962994 Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-LiveMigrationNegativeTest-1066962994-project Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 7f32dfaf09884d848804aed1ed5a2be4 Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-LiveMigrationNegativeTest-1066962994-project Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance ed92d033-c393-4d15-9e85-dd766e282c93 could not be found. Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'ed92d033-c393-4d15-9e85-dd766e282c93'} Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed92d033-c393-4d15-9e85-dd766e282c93 could not be found. Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed92d033-c393-4d15-9e85-dd766e282c93 could not be found. Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:04.829587 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:04.834493 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:04.834493 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:04.834493 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:04.834493 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:04.834493 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:04.834493 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed92d033-c393-4d15-9e85-dd766e282c93 could not be found. Oct 10 18:54:04.834493 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:04.834493 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-720e69e2-3ccd-4717-9df6-433e0d142931 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] Returning 404 to user: Instance ed92d033-c393-4d15-9e85-dd766e282c93 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:04.834493 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-720e69e2-3ccd-4717-9df6-433e0d142931 tempest-LiveMigrationNegativeTest-1066962994 tempest-LiveMigrationNegativeTest-1066962994-project] 10.222.0.43 "GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93" status: 404 len: 111 microversion: 2.1 time: 0.094923 Oct 10 18:54:04.835239 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 542/1248] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:04 2022] GET /compute/v2.1/servers/ed92d033-c393-4d15-9e85-dd766e282c93 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:54:04.857623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1343908992", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1bbc9663-3d8f-4bdf-a8a3-9398530d7415"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:04.952049 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] validate_networks() for None {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:54:05.214087 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-00459e63-16b5-4d1c-a30a-aa3ba0d3dcec tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:05.224083 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-00459e63-16b5-4d1c-a30a-aa3ba0d3dcec tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.454168 Oct 10 18:54:05.238708 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 707/1249] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:04 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:05.355058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:54:05.356038 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:54:05.361878 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:54:05.361878 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:54:05.361878 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:54:05.385186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:05.385186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:05.385186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:05.385186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:05.385916 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:05.386499 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:05.426201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for project f536cb88016b414298031238fb251097. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:54:05.431441 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Getting quotas for user c62f3c2582904aa2894aa339e7bb882d and project f536cb88016b414298031238fb251097. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:54:05.463510 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:54:05.466263 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:54:05.644464 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c0e6d080-5644-4d00-8f46-6b86596abe65 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791950 Oct 10 18:54:05.646345 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 543/1250] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:54:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 18:54:05.663197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9a6ffb3c-c509-42f5-bde2-f3fb6fd4c9aa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:05.664211 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9a6ffb3c-c509-42f5-bde2-f3fb6fd4c9aa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:05.727035 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a7de289e-f99a-4877-9118-cc28ff338d4c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:05.728983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a7de289e-f99a-4877-9118-cc28ff338d4c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:05.748864 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7de289e-f99a-4877-9118-cc28ff338d4c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:05.755894 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7de289e-f99a-4877-9118-cc28ff338d4c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:05.755894 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7de289e-f99a-4877-9118-cc28ff338d4c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:05.755894 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7de289e-f99a-4877-9118-cc28ff338d4c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:05.755894 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7de289e-f99a-4877-9118-cc28ff338d4c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:05.755894 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7de289e-f99a-4877-9118-cc28ff338d4c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:05.923518 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9a6ffb3c-c509-42f5-bde2-f3fb6fd4c9aa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:05.934977 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9a6ffb3c-c509-42f5-bde2-f3fb6fd4c9aa tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1217 microversion: 2.1 time: 0.281257 Oct 10 18:54:05.943196 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 708/1251] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:05 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1217 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:05.950859 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-632422298", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "52fc5bd3-7612-4e1e-b951-3051253ea204"}], "security_groups": [{"name": "tempest-securitygroup--122299901"}], "key_name": "tempest-keypair-519925193", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:06.196677 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a7de289e-f99a-4877-9118-cc28ff338d4c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:06.207095 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a7de289e-f99a-4877-9118-cc28ff338d4c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1366 microversion: 2.1 time: 0.487448 Oct 10 18:54:06.225669 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 544/1252] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:05 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1366 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:06.251481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ab97b7b2-83b1-4611-8aab-6a526a92ace9 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:06.252735 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ab97b7b2-83b1-4611-8aab-6a526a92ace9 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:06.259271 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab97b7b2-83b1-4611-8aab-6a526a92ace9 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:06.260068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab97b7b2-83b1-4611-8aab-6a526a92ace9 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:06.260733 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab97b7b2-83b1-4611-8aab-6a526a92ace9 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:06.261606 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab97b7b2-83b1-4611-8aab-6a526a92ace9 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:06.262387 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab97b7b2-83b1-4611-8aab-6a526a92ace9 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:06.263019 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab97b7b2-83b1-4611-8aab-6a526a92ace9 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:06.331204 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] validate_networks() for [('52fc5bd3-7612-4e1e-b951-3051253ea204', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:54:06.455335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ab97b7b2-83b1-4611-8aab-6a526a92ace9 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:06.474895 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ab97b7b2-83b1-4611-8aab-6a526a92ace9 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1473 microversion: 2.1 time: 0.226077 Oct 10 18:54:06.476272 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 545/1253] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:06 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1473 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:06.964284 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2fcb242a-957c-4ca8-9bbf-50dd9d94b1d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:06.964929 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2fcb242a-957c-4ca8-9bbf-50dd9d94b1d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:06.980289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fcb242a-957c-4ca8-9bbf-50dd9d94b1d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:06.981082 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fcb242a-957c-4ca8-9bbf-50dd9d94b1d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:06.983692 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fcb242a-957c-4ca8-9bbf-50dd9d94b1d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:06.983692 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fcb242a-957c-4ca8-9bbf-50dd9d94b1d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:06.983692 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fcb242a-957c-4ca8-9bbf-50dd9d94b1d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:06.984834 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fcb242a-957c-4ca8-9bbf-50dd9d94b1d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:07.084092 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2fcb242a-957c-4ca8-9bbf-50dd9d94b1d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:07.097498 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2fcb242a-957c-4ca8-9bbf-50dd9d94b1d5 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1221 microversion: 2.1 time: 0.138063 Oct 10 18:54:07.101194 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 546/1254] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:06 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1221 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:07.234521 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8211a68e-a09e-4f88-b49c-c641164ebdf8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:07.235472 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8211a68e-a09e-4f88-b49c-c641164ebdf8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:07.243287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8211a68e-a09e-4f88-b49c-c641164ebdf8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:07.244636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8211a68e-a09e-4f88-b49c-c641164ebdf8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:07.245108 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8211a68e-a09e-4f88-b49c-c641164ebdf8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:07.245959 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8211a68e-a09e-4f88-b49c-c641164ebdf8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:07.246511 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8211a68e-a09e-4f88-b49c-c641164ebdf8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:07.246999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8211a68e-a09e-4f88-b49c-c641164ebdf8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:07.769368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8211a68e-a09e-4f88-b49c-c641164ebdf8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:07.787284 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8211a68e-a09e-4f88-b49c-c641164ebdf8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1554 microversion: 2.1 time: 0.557927 Oct 10 18:54:07.795599 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 547/1255] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:07 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1554 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:07.808029 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a1821e1c-254d-4f62-ab5d-a0ba5daed61b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:07.809581 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a1821e1c-254d-4f62-ab5d-a0ba5daed61b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:07.813133 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Getting quotas for project 66d3b0a2007b41e59c5006778d1b5d76. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:54:07.819396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1821e1c-254d-4f62-ab5d-a0ba5daed61b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:07.819396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1821e1c-254d-4f62-ab5d-a0ba5daed61b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:07.819396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1821e1c-254d-4f62-ab5d-a0ba5daed61b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:07.819396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1821e1c-254d-4f62-ab5d-a0ba5daed61b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:07.820268 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1821e1c-254d-4f62-ab5d-a0ba5daed61b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:07.820893 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a1821e1c-254d-4f62-ab5d-a0ba5daed61b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:07.853172 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Getting quotas for user 2092dd5ed84e414ba0000c3816b7b6f6 and project 66d3b0a2007b41e59c5006778d1b5d76. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:54:07.904252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:54:07.911206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:54:07.911206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:54:07.911206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:54:07.911655 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:54:07.936260 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:07.939848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:07.939848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:07.939848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:07.939848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:07.939848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:07.963364 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Getting quotas for project 66d3b0a2007b41e59c5006778d1b5d76. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:54:07.969277 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Getting quotas for user 2092dd5ed84e414ba0000c3816b7b6f6 and project 66d3b0a2007b41e59c5006778d1b5d76. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:54:07.987993 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:54:08.003635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:54:08.104337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a1821e1c-254d-4f62-ab5d-a0ba5daed61b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:08.124654 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a1821e1c-254d-4f62-ab5d-a0ba5daed61b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1479 microversion: 2.1 time: 0.327855 Oct 10 18:54:08.144822 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 548/1256] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:07 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1479 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:08.156114 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-169cdcb6-77af-4782-9645-eb1381ac0233 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:08.157332 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-169cdcb6-77af-4782-9645-eb1381ac0233 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:08.172150 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-169cdcb6-77af-4782-9645-eb1381ac0233 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:08.177381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-169cdcb6-77af-4782-9645-eb1381ac0233 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:08.178499 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-169cdcb6-77af-4782-9645-eb1381ac0233 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:08.179634 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-169cdcb6-77af-4782-9645-eb1381ac0233 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:08.180315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-169cdcb6-77af-4782-9645-eb1381ac0233 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:08.181092 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-169cdcb6-77af-4782-9645-eb1381ac0233 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:08.181211 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7dbfa1e8-cd03-4c45-b93e-529126eab68b tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.235923 Oct 10 18:54:08.181854 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 709/1257] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:54:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 2237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:54:08.191089 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d680baa6-790b-4f54-b61a-682c29abcdf7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:08.193076 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d680baa6-790b-4f54-b61a-682c29abcdf7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:08.199100 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d680baa6-790b-4f54-b61a-682c29abcdf7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:08.199595 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d680baa6-790b-4f54-b61a-682c29abcdf7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:08.200485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d680baa6-790b-4f54-b61a-682c29abcdf7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:08.200851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d680baa6-790b-4f54-b61a-682c29abcdf7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:08.201260 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d680baa6-790b-4f54-b61a-682c29abcdf7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:08.201690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d680baa6-790b-4f54-b61a-682c29abcdf7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:08.348994 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d680baa6-790b-4f54-b61a-682c29abcdf7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:08.357311 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d680baa6-790b-4f54-b61a-682c29abcdf7 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1269 microversion: 2.1 time: 0.170899 Oct 10 18:54:08.361834 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 710/1258] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:08 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:08.371342 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-db5a7ec3-a883-4b40-8c32-f351079a4a02 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:08.372192 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-db5a7ec3-a883-4b40-8c32-f351079a4a02 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:08.464463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-db5a7ec3-a883-4b40-8c32-f351079a4a02 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:08.473570 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-db5a7ec3-a883-4b40-8c32-f351079a4a02 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1268 microversion: 2.1 time: 0.109516 Oct 10 18:54:08.474533 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 711/1259] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:08 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1268 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:08.510089 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-169cdcb6-77af-4782-9645-eb1381ac0233 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.363144 Oct 10 18:54:08.510677 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 549/1260] 10.222.0.43 () {58 vars in 1275 bytes} [Mon Oct 10 18:54:08 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-interface => generated 284 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:09.155999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-444f03f9-f290-4a1b-b967-001579206770 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:09.159798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-444f03f9-f290-4a1b-b967-001579206770 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:09.193840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-444f03f9-f290-4a1b-b967-001579206770 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:09.194688 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-444f03f9-f290-4a1b-b967-001579206770 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:09.195385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-444f03f9-f290-4a1b-b967-001579206770 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:09.196343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-444f03f9-f290-4a1b-b967-001579206770 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:09.197287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-444f03f9-f290-4a1b-b967-001579206770 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:09.200719 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-444f03f9-f290-4a1b-b967-001579206770 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:09.368965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1013955817", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "4e9b6228-48e7-47ac-9317-a5a4457ef8ad"}], "security_groups": [{"name": "tempest-securitygroup--1541634715"}], "key_name": "tempest-keypair-292837945", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:09.539098 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] validate_networks() for [('4e9b6228-48e7-47ac-9317-a5a4457ef8ad', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:54:09.870608 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-444f03f9-f290-4a1b-b967-001579206770 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:09.900846 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-444f03f9-f290-4a1b-b967-001579206770 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1479 microversion: 2.1 time: 0.750864 Oct 10 18:54:09.906576 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 712/1261] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:09 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1479 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:09.918097 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5b64d1b7-ea9d-4cc8-a8cf-9175c918c08a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:09.918816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5b64d1b7-ea9d-4cc8-a8cf-9175c918c08a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:09.941230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b64d1b7-ea9d-4cc8-a8cf-9175c918c08a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:09.941230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b64d1b7-ea9d-4cc8-a8cf-9175c918c08a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:09.941230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b64d1b7-ea9d-4cc8-a8cf-9175c918c08a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:09.941230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b64d1b7-ea9d-4cc8-a8cf-9175c918c08a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:09.941230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b64d1b7-ea9d-4cc8-a8cf-9175c918c08a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:09.941230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b64d1b7-ea9d-4cc8-a8cf-9175c918c08a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:10.099772 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5b64d1b7-ea9d-4cc8-a8cf-9175c918c08a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:10.115546 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5b64d1b7-ea9d-4cc8-a8cf-9175c918c08a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1275 microversion: 2.1 time: 0.203059 Oct 10 18:54:10.117722 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 713/1262] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:09 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:10.129410 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9e21d7b8-af60-4f45-8257-f0832b4698b1 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:10.131301 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9e21d7b8-af60-4f45-8257-f0832b4698b1 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:10.144617 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9e21d7b8-af60-4f45-8257-f0832b4698b1 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:10.148079 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9e21d7b8-af60-4f45-8257-f0832b4698b1 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:10.148740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9e21d7b8-af60-4f45-8257-f0832b4698b1 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:10.149706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9e21d7b8-af60-4f45-8257-f0832b4698b1 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:10.151969 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9e21d7b8-af60-4f45-8257-f0832b4698b1 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:10.153780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9e21d7b8-af60-4f45-8257-f0832b4698b1 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:10.207874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:54:10.208299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:54:10.208800 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:54:10.209457 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:54:10.209874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:54:10.220968 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:10.221558 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:10.222000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:10.222721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:10.223169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:10.223807 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:10.262373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Getting quotas for project 8ca11fe18cc64adfbc06166601106c7c. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:54:10.279022 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Getting quotas for user 789ef7a66ff042b9abebe36823008f8f and project 8ca11fe18cc64adfbc06166601106c7c. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:54:10.297775 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9e21d7b8-af60-4f45-8257-f0832b4698b1 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:10.310794 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:54:10.314929 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:54:10.315295 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9e21d7b8-af60-4f45-8257-f0832b4698b1 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1272 microversion: 2.1 time: 0.195700 Oct 10 18:54:10.315751 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 714/1263] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:10 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:10.503712 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-542cec4a-8eb9-4dc7-be0a-65853fb665eb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.139601 Oct 10 18:54:10.509575 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 550/1264] 10.222.0.43 () {62 vars in 1188 bytes} [Mon Oct 10 18:54:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 18:54:10.518814 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-533dbe20-a753-43cf-b2b7-a9c9ada9e89f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:10.520644 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-533dbe20-a753-43cf-b2b7-a9c9ada9e89f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:10.928954 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bf8356f6-b6b6-4910-8902-93f562cd6f3e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:10.929739 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bf8356f6-b6b6-4910-8902-93f562cd6f3e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:10.945451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bf8356f6-b6b6-4910-8902-93f562cd6f3e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:10.949511 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bf8356f6-b6b6-4910-8902-93f562cd6f3e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:10.950347 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bf8356f6-b6b6-4910-8902-93f562cd6f3e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:10.951738 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bf8356f6-b6b6-4910-8902-93f562cd6f3e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:10.952058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-533dbe20-a753-43cf-b2b7-a9c9ada9e89f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:10.954051 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bf8356f6-b6b6-4910-8902-93f562cd6f3e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:10.954682 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bf8356f6-b6b6-4910-8902-93f562cd6f3e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:10.960479 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-533dbe20-a753-43cf-b2b7-a9c9ada9e89f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:10.973956 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-533dbe20-a753-43cf-b2b7-a9c9ada9e89f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:10.976386 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-533dbe20-a753-43cf-b2b7-a9c9ada9e89f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1285 microversion: 2.25 time: 0.460556 Oct 10 18:54:10.976386 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 715/1265] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:10 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1285 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:11.158232 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4c2aa84d-afde-4eea-a591-5ce7e28694e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:11.159319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4c2aa84d-afde-4eea-a591-5ce7e28694e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:11.171343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4c2aa84d-afde-4eea-a591-5ce7e28694e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:11.172287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4c2aa84d-afde-4eea-a591-5ce7e28694e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:11.172909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4c2aa84d-afde-4eea-a591-5ce7e28694e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:11.173653 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4c2aa84d-afde-4eea-a591-5ce7e28694e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:11.174101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4c2aa84d-afde-4eea-a591-5ce7e28694e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:11.174515 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4c2aa84d-afde-4eea-a591-5ce7e28694e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:11.451638 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4c2aa84d-afde-4eea-a591-5ce7e28694e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:11.472524 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4c2aa84d-afde-4eea-a591-5ce7e28694e8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1275 microversion: 2.1 time: 0.315857 Oct 10 18:54:11.475340 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 716/1266] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:11 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1275 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:11.507398 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-42511a76-31f9-4fde-8488-2e669886efbd tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:11.508021 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-42511a76-31f9-4fde-8488-2e669886efbd tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:11.521116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42511a76-31f9-4fde-8488-2e669886efbd tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:11.525101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42511a76-31f9-4fde-8488-2e669886efbd tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:11.526422 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42511a76-31f9-4fde-8488-2e669886efbd tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:11.530924 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42511a76-31f9-4fde-8488-2e669886efbd tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:11.548838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42511a76-31f9-4fde-8488-2e669886efbd tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:11.550269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42511a76-31f9-4fde-8488-2e669886efbd tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:11.827335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bf8356f6-b6b6-4910-8902-93f562cd6f3e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:11.835920 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:11.840088 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bf8356f6-b6b6-4910-8902-93f562cd6f3e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1464 microversion: 2.1 time: 0.915283 Oct 10 18:54:11.843405 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 551/1267] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:10 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1464 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:11.851299 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-42511a76-31f9-4fde-8488-2e669886efbd tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:11.852375 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-d73577f9-7f38-4f12-98bc-32936b7fd5f1 req-250a8b8b-7670-4ad0-82ad-2f848f24c183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3624eba-30d5-486c-8753-86e4277189ff", "name": "network-vif-unplugged", "status": "completed", "tag": "877788c4-8817-4a16-9c01-e7dd796eebdd"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:11.875151 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-42511a76-31f9-4fde-8488-2e669886efbd tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1320 microversion: 2.1 time: 0.396767 Oct 10 18:54:11.877711 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 717/1268] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:11 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1320 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:11.887020 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8f7e96a7-0c2b-471d-bf57-609da42bd7d6 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:11.896749 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8f7e96a7-0c2b-471d-bf57-609da42bd7d6 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:11.904749 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d73577f9-7f38-4f12-98bc-32936b7fd5f1 req-250a8b8b-7670-4ad0-82ad-2f848f24c183 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:11.905919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d73577f9-7f38-4f12-98bc-32936b7fd5f1 req-250a8b8b-7670-4ad0-82ad-2f848f24c183 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:11.907063 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d73577f9-7f38-4f12-98bc-32936b7fd5f1 req-250a8b8b-7670-4ad0-82ad-2f848f24c183 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:11.912682 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f7e96a7-0c2b-471d-bf57-609da42bd7d6 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:11.923661 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f7e96a7-0c2b-471d-bf57-609da42bd7d6 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:11.924715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f7e96a7-0c2b-471d-bf57-609da42bd7d6 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:11.927875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f7e96a7-0c2b-471d-bf57-609da42bd7d6 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:11.930013 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f7e96a7-0c2b-471d-bf57-609da42bd7d6 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:11.931227 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f7e96a7-0c2b-471d-bf57-609da42bd7d6 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:11.933383 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-d73577f9-7f38-4f12-98bc-32936b7fd5f1 req-250a8b8b-7670-4ad0-82ad-2f848f24c183 service nova] Creating event network-vif-unplugged:877788c4-8817-4a16-9c01-e7dd796eebdd for instance d3624eba-30d5-486c-8753-86e4277189ff on n-h1-860863-1 Oct 10 18:54:11.955943 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-d73577f9-7f38-4f12-98bc-32936b7fd5f1 req-250a8b8b-7670-4ad0-82ad-2f848f24c183 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110105 Oct 10 18:54:11.957984 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 552/1269] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:12.404599 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8f7e96a7-0c2b-471d-bf57-609da42bd7d6 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff/action" status: 202 len: 0 microversion: 2.1 time: 0.525314 Oct 10 18:54:12.405954 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 718/1270] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:54:11 2022] POST /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:54:12.411820 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3c4972de-1c61-4594-ba73-010b82ae80f3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:12.417249 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3c4972de-1c61-4594-ba73-010b82ae80f3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:12.431219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c4972de-1c61-4594-ba73-010b82ae80f3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:12.436372 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c4972de-1c61-4594-ba73-010b82ae80f3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:12.437268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c4972de-1c61-4594-ba73-010b82ae80f3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:12.441332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c4972de-1c61-4594-ba73-010b82ae80f3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:12.443606 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c4972de-1c61-4594-ba73-010b82ae80f3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:12.446554 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c4972de-1c61-4594-ba73-010b82ae80f3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:12.633471 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3c4972de-1c61-4594-ba73-010b82ae80f3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:12.642300 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-600803141", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:12.657844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3c4972de-1c61-4594-ba73-010b82ae80f3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:12.659579 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3c4972de-1c61-4594-ba73-010b82ae80f3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:12.660913 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3c4972de-1c61-4594-ba73-010b82ae80f3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1281 microversion: 2.25 time: 0.253724 Oct 10 18:54:12.665451 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 719/1271] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:12 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1281 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:12.673422 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ee547559-6e9f-488c-abc7-cc8111ac3afc tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:12.676690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ee547559-6e9f-488c-abc7-cc8111ac3afc tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:12.685170 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee547559-6e9f-488c-abc7-cc8111ac3afc tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:12.685866 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee547559-6e9f-488c-abc7-cc8111ac3afc tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:12.686521 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee547559-6e9f-488c-abc7-cc8111ac3afc tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:12.687574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee547559-6e9f-488c-abc7-cc8111ac3afc tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:12.688209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee547559-6e9f-488c-abc7-cc8111ac3afc tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:12.688867 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee547559-6e9f-488c-abc7-cc8111ac3afc tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:12.739835 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] validate_networks() for None {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:54:12.777920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee547559-6e9f-488c-abc7-cc8111ac3afc tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:12.782854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee547559-6e9f-488c-abc7-cc8111ac3afc tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:12.786763 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee547559-6e9f-488c-abc7-cc8111ac3afc tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:12.787343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-ee547559-6e9f-488c-abc7-cc8111ac3afc tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lazy-loading 'fault' on Instance uuid d3624eba-30d5-486c-8753-86e4277189ff {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:54:13.061553 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:54:13.062571 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:54:13.063279 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:54:13.063955 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:54:13.064551 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:54:13.076831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:13.077519 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:13.078452 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:13.079381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:13.079847 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:13.080274 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:13.101588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Getting quotas for project af3bdebcbf8c4bfe845090db416be09d. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:54:13.111191 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Getting quotas for user 98d0928b54084f00a6c1cbf52ebc0a2a and project af3bdebcbf8c4bfe845090db416be09d. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:54:13.125772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:54:13.128633 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:54:13.251661 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2eda0d1f-1463-4bc6-9207-6202420c2ad2 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.271162 Oct 10 18:54:13.252723 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 553/1272] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:54:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 18:54:13.264412 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1017a316-0553-4ea7-a45d-850083a971b1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:13.265097 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1017a316-0553-4ea7-a45d-850083a971b1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:13.272833 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1017a316-0553-4ea7-a45d-850083a971b1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:13.273462 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1017a316-0553-4ea7-a45d-850083a971b1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:13.273997 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1017a316-0553-4ea7-a45d-850083a971b1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:13.274814 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1017a316-0553-4ea7-a45d-850083a971b1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:13.276070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1017a316-0553-4ea7-a45d-850083a971b1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:13.276522 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1017a316-0553-4ea7-a45d-850083a971b1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:13.344438 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ee547559-6e9f-488c-abc7-cc8111ac3afc tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1598 microversion: 2.1 time: 0.677598 Oct 10 18:54:13.360846 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 720/1273] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:12 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1598 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:13.369236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-09a649b3-a1cd-4108-bc17-ef0e7e629ef0 req-93065ec7-6ab7-42d4-8e86-fc324b037216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc84705b-369f-4b67-a7ad-4cb62ba09d40", "tag": "7fa49e0d-3a83-4a67-b0a9-cfc6f8f332ef"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:13.397652 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-09a649b3-a1cd-4108-bc17-ef0e7e629ef0 req-93065ec7-6ab7-42d4-8e86-fc324b037216 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:13.398142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-09a649b3-a1cd-4108-bc17-ef0e7e629ef0 req-93065ec7-6ab7-42d4-8e86-fc324b037216 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:13.398576 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-09a649b3-a1cd-4108-bc17-ef0e7e629ef0 req-93065ec7-6ab7-42d4-8e86-fc324b037216 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:13.429874 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-09a649b3-a1cd-4108-bc17-ef0e7e629ef0 req-93065ec7-6ab7-42d4-8e86-fc324b037216 service nova] Creating event network-changed:7fa49e0d-3a83-4a67-b0a9-cfc6f8f332ef for instance bc84705b-369f-4b67-a7ad-4cb62ba09d40 on n-h2-860863-1 Oct 10 18:54:13.446457 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-09a649b3-a1cd-4108-bc17-ef0e7e629ef0 req-93065ec7-6ab7-42d4-8e86-fc324b037216 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089502 Oct 10 18:54:13.448412 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 721/1274] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:13.457067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1eda8e2e-b9e0-48fc-8216-239e99cfecf8 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:13.462160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1eda8e2e-b9e0-48fc-8216-239e99cfecf8 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:13.479717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1eda8e2e-b9e0-48fc-8216-239e99cfecf8 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:13.480323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1eda8e2e-b9e0-48fc-8216-239e99cfecf8 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:13.480669 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1eda8e2e-b9e0-48fc-8216-239e99cfecf8 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:13.481385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1eda8e2e-b9e0-48fc-8216-239e99cfecf8 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:13.481843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1eda8e2e-b9e0-48fc-8216-239e99cfecf8 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:13.482522 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1eda8e2e-b9e0-48fc-8216-239e99cfecf8 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:13.613160 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1017a316-0553-4ea7-a45d-850083a971b1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:13.633848 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1017a316-0553-4ea7-a45d-850083a971b1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1317 microversion: 2.1 time: 0.372601 Oct 10 18:54:13.648577 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 554/1275] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:13 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:13.648577 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8f4f2bef-c727-4e58-ac34-2e1341dd9908 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:13.648577 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8f4f2bef-c727-4e58-ac34-2e1341dd9908 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:13.681523 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1eda8e2e-b9e0-48fc-8216-239e99cfecf8 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:13.692579 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1eda8e2e-b9e0-48fc-8216-239e99cfecf8 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1326 microversion: 2.1 time: 0.243592 Oct 10 18:54:13.693182 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 722/1276] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:13 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1326 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:13.699866 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4bc42656-be8b-4176-bb34-fa8de357333a tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:13.703094 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4bc42656-be8b-4176-bb34-fa8de357333a tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:13.741290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4bc42656-be8b-4176-bb34-fa8de357333a tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:13.741786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4bc42656-be8b-4176-bb34-fa8de357333a tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:13.745667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4bc42656-be8b-4176-bb34-fa8de357333a tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:13.746404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4bc42656-be8b-4176-bb34-fa8de357333a tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:13.747035 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4bc42656-be8b-4176-bb34-fa8de357333a tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:13.747676 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4bc42656-be8b-4176-bb34-fa8de357333a tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:13.890063 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8f4f2bef-c727-4e58-ac34-2e1341dd9908 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:13.902466 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8f4f2bef-c727-4e58-ac34-2e1341dd9908 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1221 microversion: 2.1 time: 0.265588 Oct 10 18:54:13.902703 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 555/1277] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:13 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1221 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:13.920589 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fc1da121-16bf-4f3c-8c19-e059aa9eba55 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:13.921392 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fc1da121-16bf-4f3c-8c19-e059aa9eba55 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:13.933371 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc1da121-16bf-4f3c-8c19-e059aa9eba55 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:13.933755 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc1da121-16bf-4f3c-8c19-e059aa9eba55 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:13.934190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc1da121-16bf-4f3c-8c19-e059aa9eba55 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:13.934944 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc1da121-16bf-4f3c-8c19-e059aa9eba55 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:13.935389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc1da121-16bf-4f3c-8c19-e059aa9eba55 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:13.936011 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc1da121-16bf-4f3c-8c19-e059aa9eba55 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:14.035177 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:14.060238 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fc1da121-16bf-4f3c-8c19-e059aa9eba55 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:14.069561 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fc1da121-16bf-4f3c-8c19-e059aa9eba55 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:14.071859 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fc1da121-16bf-4f3c-8c19-e059aa9eba55 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:14.074064 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fc1da121-16bf-4f3c-8c19-e059aa9eba55 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1355 microversion: 2.25 time: 0.170110 Oct 10 18:54:14.075112 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 556/1278] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:13 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1355 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:14.133918 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4bc42656-be8b-4176-bb34-fa8de357333a tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff/action" status: 202 len: 0 microversion: 2.1 time: 0.438336 Oct 10 18:54:14.136927 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 723/1279] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:54:13 2022] POST /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:54:14.145246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1b4d1591-7877-48cc-a44f-af6649c63586 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:14.145960 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1b4d1591-7877-48cc-a44f-af6649c63586 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:14.158850 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b4d1591-7877-48cc-a44f-af6649c63586 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:14.158850 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b4d1591-7877-48cc-a44f-af6649c63586 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:14.158850 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b4d1591-7877-48cc-a44f-af6649c63586 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:14.159415 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b4d1591-7877-48cc-a44f-af6649c63586 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:14.159976 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b4d1591-7877-48cc-a44f-af6649c63586 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:14.160501 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b4d1591-7877-48cc-a44f-af6649c63586 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:14.622016 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1b4d1591-7877-48cc-a44f-af6649c63586 tempest-ServersAdminTestJSON-1426961529 tempest-ServersAdminTestJSON-1426961529-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1615 microversion: 2.1 time: 0.480650 Oct 10 18:54:14.623175 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 557/1280] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:14 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1615 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:14.649803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b5f786de-c480-42e6-8e52-092aea4c4c98 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:14.651760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b5f786de-c480-42e6-8e52-092aea4c4c98 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:14.669439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5f786de-c480-42e6-8e52-092aea4c4c98 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:14.670426 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5f786de-c480-42e6-8e52-092aea4c4c98 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:14.671149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5f786de-c480-42e6-8e52-092aea4c4c98 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:14.672097 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5f786de-c480-42e6-8e52-092aea4c4c98 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:14.672702 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1afa38a3-b5c0-49b6-a401-c6dfca6a4a90 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:14.673080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5f786de-c480-42e6-8e52-092aea4c4c98 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:14.673328 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1afa38a3-b5c0-49b6-a401-c6dfca6a4a90 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:14.674088 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5f786de-c480-42e6-8e52-092aea4c4c98 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:14.687298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1afa38a3-b5c0-49b6-a401-c6dfca6a4a90 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:14.687942 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1afa38a3-b5c0-49b6-a401-c6dfca6a4a90 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:14.688383 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1afa38a3-b5c0-49b6-a401-c6dfca6a4a90 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:14.689813 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1afa38a3-b5c0-49b6-a401-c6dfca6a4a90 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:14.689922 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1afa38a3-b5c0-49b6-a401-c6dfca6a4a90 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:14.690283 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1afa38a3-b5c0-49b6-a401-c6dfca6a4a90 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:14.797461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b5f786de-c480-42e6-8e52-092aea4c4c98 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:54:15.109403 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:15.152197 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1afa38a3-b5c0-49b6-a401-c6dfca6a4a90 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:15.162006 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1afa38a3-b5c0-49b6-a401-c6dfca6a4a90 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1317 microversion: 2.1 time: 0.500732 Oct 10 18:54:15.163379 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 558/1281] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:14 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:15.171235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9972fa74-ed76-42bf-89ba-df672dd5f8df tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:15.172222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9972fa74-ed76-42bf-89ba-df672dd5f8df tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:15.184763 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9972fa74-ed76-42bf-89ba-df672dd5f8df tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:15.185505 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9972fa74-ed76-42bf-89ba-df672dd5f8df tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:15.186174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9972fa74-ed76-42bf-89ba-df672dd5f8df tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:15.187140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9972fa74-ed76-42bf-89ba-df672dd5f8df tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:15.188626 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9972fa74-ed76-42bf-89ba-df672dd5f8df tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:15.189265 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9972fa74-ed76-42bf-89ba-df672dd5f8df tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:15.201045 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b5f786de-c480-42e6-8e52-092aea4c4c98 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "DELETE /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 204 len: 0 microversion: 2.1 time: 0.553828 Oct 10 18:54:15.202339 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 724/1282] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:54:14 2022] DELETE /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:54:15.210878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1ed8cad2-c8a8-4c8d-8a2f-99fc572a0d7f tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:15.216052 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1ed8cad2-c8a8-4c8d-8a2f-99fc572a0d7f tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:15.228781 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ed8cad2-c8a8-4c8d-8a2f-99fc572a0d7f tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:15.229544 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ed8cad2-c8a8-4c8d-8a2f-99fc572a0d7f tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:15.236957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ed8cad2-c8a8-4c8d-8a2f-99fc572a0d7f tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:15.236957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ed8cad2-c8a8-4c8d-8a2f-99fc572a0d7f tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:15.236957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ed8cad2-c8a8-4c8d-8a2f-99fc572a0d7f tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:15.236957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ed8cad2-c8a8-4c8d-8a2f-99fc572a0d7f tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:15.356356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1ed8cad2-c8a8-4c8d-8a2f-99fc572a0d7f tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:15.365805 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1ed8cad2-c8a8-4c8d-8a2f-99fc572a0d7f tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1217 microversion: 2.1 time: 0.160869 Oct 10 18:54:15.365805 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 725/1283] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:15 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:15.371240 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-55d1f507-9619-4d7e-82a8-7cf03842d8db tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:15.371851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-55d1f507-9619-4d7e-82a8-7cf03842d8db tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:15.377926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55d1f507-9619-4d7e-82a8-7cf03842d8db tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:15.378756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55d1f507-9619-4d7e-82a8-7cf03842d8db tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:15.378990 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55d1f507-9619-4d7e-82a8-7cf03842d8db tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:15.379709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55d1f507-9619-4d7e-82a8-7cf03842d8db tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:15.380158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55d1f507-9619-4d7e-82a8-7cf03842d8db tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:15.381420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55d1f507-9619-4d7e-82a8-7cf03842d8db tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:15.489373 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55d1f507-9619-4d7e-82a8-7cf03842d8db tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:15.495897 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9972fa74-ed76-42bf-89ba-df672dd5f8df tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:15.498492 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55d1f507-9619-4d7e-82a8-7cf03842d8db tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:15.500105 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55d1f507-9619-4d7e-82a8-7cf03842d8db tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:15.501477 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-55d1f507-9619-4d7e-82a8-7cf03842d8db tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1343 microversion: 2.25 time: 0.134861 Oct 10 18:54:15.516480 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 726/1284] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:15 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1343 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:15.527566 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3d2ea730-cef6-49b8-8c43-20139f1be46a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:15.528208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3d2ea730-cef6-49b8-8c43-20139f1be46a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:15.531300 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9972fa74-ed76-42bf-89ba-df672dd5f8df tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1393 microversion: 2.1 time: 0.365183 Oct 10 18:54:15.534393 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 559/1285] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:15 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1393 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:15.535518 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d2ea730-cef6-49b8-8c43-20139f1be46a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:15.536571 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d2ea730-cef6-49b8-8c43-20139f1be46a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:15.537004 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d2ea730-cef6-49b8-8c43-20139f1be46a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:15.537706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d2ea730-cef6-49b8-8c43-20139f1be46a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:15.538889 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d2ea730-cef6-49b8-8c43-20139f1be46a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:15.539347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d2ea730-cef6-49b8-8c43-20139f1be46a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:15.551746 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-47170ede-9f56-4ead-b26b-865112b04be8 req-e5de6e91-428a-4f8d-9c45-dfb7ef31215f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07001745-db54-4bea-a7c8-d894f4638089", "tag": "5fbe7847-dfa2-4db5-b541-54af8f4629a1"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:15.580228 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-47170ede-9f56-4ead-b26b-865112b04be8 req-e5de6e91-428a-4f8d-9c45-dfb7ef31215f service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:15.583779 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-47170ede-9f56-4ead-b26b-865112b04be8 req-e5de6e91-428a-4f8d-9c45-dfb7ef31215f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:15.584228 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-47170ede-9f56-4ead-b26b-865112b04be8 req-e5de6e91-428a-4f8d-9c45-dfb7ef31215f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:15.603889 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-47170ede-9f56-4ead-b26b-865112b04be8 req-e5de6e91-428a-4f8d-9c45-dfb7ef31215f service nova] Creating event network-changed:5fbe7847-dfa2-4db5-b541-54af8f4629a1 for instance 07001745-db54-4bea-a7c8-d894f4638089 on n-h2-860863-1 Oct 10 18:54:15.609692 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-47170ede-9f56-4ead-b26b-865112b04be8 req-e5de6e91-428a-4f8d-9c45-dfb7ef31215f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073533 Oct 10 18:54:15.610565 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 560/1286] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:15.661648 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-74a0fe27-1240-4cc1-b0e1-9748dc2e0fdd req-f62d8042-ab81-43a6-9201-109b527fbe23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3624eba-30d5-486c-8753-86e4277189ff", "name": "network-vif-plugged", "status": "completed", "tag": "877788c4-8817-4a16-9c01-e7dd796eebdd"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:15.678017 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-74a0fe27-1240-4cc1-b0e1-9748dc2e0fdd req-f62d8042-ab81-43a6-9201-109b527fbe23 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:15.680854 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-74a0fe27-1240-4cc1-b0e1-9748dc2e0fdd req-f62d8042-ab81-43a6-9201-109b527fbe23 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:15.682183 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-74a0fe27-1240-4cc1-b0e1-9748dc2e0fdd req-f62d8042-ab81-43a6-9201-109b527fbe23 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:15.711942 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-74a0fe27-1240-4cc1-b0e1-9748dc2e0fdd req-f62d8042-ab81-43a6-9201-109b527fbe23 service nova] Creating event network-vif-plugged:877788c4-8817-4a16-9c01-e7dd796eebdd for instance d3624eba-30d5-486c-8753-86e4277189ff on n-h1-860863-1 Oct 10 18:54:15.719613 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-74a0fe27-1240-4cc1-b0e1-9748dc2e0fdd req-f62d8042-ab81-43a6-9201-109b527fbe23 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075331 Oct 10 18:54:15.720854 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 561/1287] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:15.846772 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3d2ea730-cef6-49b8-8c43-20139f1be46a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:15.867577 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3d2ea730-cef6-49b8-8c43-20139f1be46a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1469 microversion: 2.1 time: 0.349879 Oct 10 18:54:15.870502 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 727/1288] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:15 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1469 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:16.186414 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b792bcc1-aa6d-4888-a7f9-4a7384e01edf tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:16.187084 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b792bcc1-aa6d-4888-a7f9-4a7384e01edf tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:16.193729 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b792bcc1-aa6d-4888-a7f9-4a7384e01edf tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:16.194498 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b792bcc1-aa6d-4888-a7f9-4a7384e01edf tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:16.194770 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b792bcc1-aa6d-4888-a7f9-4a7384e01edf tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:16.195651 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b792bcc1-aa6d-4888-a7f9-4a7384e01edf tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:16.196262 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b792bcc1-aa6d-4888-a7f9-4a7384e01edf tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:16.196884 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b792bcc1-aa6d-4888-a7f9-4a7384e01edf tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:16.366839 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b792bcc1-aa6d-4888-a7f9-4a7384e01edf tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:16.374654 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b792bcc1-aa6d-4888-a7f9-4a7384e01edf tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1317 microversion: 2.1 time: 0.192906 Oct 10 18:54:16.375221 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 562/1289] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:16 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:16.387749 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2107a3d4-bfbc-421f-a092-eb83f0a3e0d7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:16.388464 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2107a3d4-bfbc-421f-a092-eb83f0a3e0d7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:16.395092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2107a3d4-bfbc-421f-a092-eb83f0a3e0d7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:16.395925 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2107a3d4-bfbc-421f-a092-eb83f0a3e0d7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:16.396520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2107a3d4-bfbc-421f-a092-eb83f0a3e0d7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:16.397400 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2107a3d4-bfbc-421f-a092-eb83f0a3e0d7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:16.398000 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2107a3d4-bfbc-421f-a092-eb83f0a3e0d7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:16.398717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2107a3d4-bfbc-421f-a092-eb83f0a3e0d7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:16.463958 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2107a3d4-bfbc-421f-a092-eb83f0a3e0d7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:16.474201 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2107a3d4-bfbc-421f-a092-eb83f0a3e0d7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1273 microversion: 2.1 time: 0.089116 Oct 10 18:54:16.474201 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 728/1290] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:16 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:16.532654 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f1ac2e13-729a-4dbf-a797-2fb014824f0b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:16.533371 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f1ac2e13-729a-4dbf-a797-2fb014824f0b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:16.537810 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:16.555094 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1ac2e13-729a-4dbf-a797-2fb014824f0b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:16.556337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1ac2e13-729a-4dbf-a797-2fb014824f0b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:16.557043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1ac2e13-729a-4dbf-a797-2fb014824f0b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:16.561860 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1ac2e13-729a-4dbf-a797-2fb014824f0b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:16.562534 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1ac2e13-729a-4dbf-a797-2fb014824f0b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:16.563063 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e597f2cc-9a9f-4a8e-8328-759d09e1db5d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:16.563351 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1ac2e13-729a-4dbf-a797-2fb014824f0b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:16.563991 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e597f2cc-9a9f-4a8e-8328-759d09e1db5d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:16.577385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e597f2cc-9a9f-4a8e-8328-759d09e1db5d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:16.578081 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e597f2cc-9a9f-4a8e-8328-759d09e1db5d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:16.578670 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e597f2cc-9a9f-4a8e-8328-759d09e1db5d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:16.579679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e597f2cc-9a9f-4a8e-8328-759d09e1db5d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:16.580700 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e597f2cc-9a9f-4a8e-8328-759d09e1db5d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:16.581552 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e597f2cc-9a9f-4a8e-8328-759d09e1db5d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:16.784487 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e597f2cc-9a9f-4a8e-8328-759d09e1db5d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:16.792935 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e597f2cc-9a9f-4a8e-8328-759d09e1db5d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1393 microversion: 2.1 time: 0.240369 Oct 10 18:54:16.793519 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 729/1291] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:16 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1393 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:16.809340 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f1ac2e13-729a-4dbf-a797-2fb014824f0b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:16.817447 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f1ac2e13-729a-4dbf-a797-2fb014824f0b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:16.819188 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f1ac2e13-729a-4dbf-a797-2fb014824f0b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:16.820375 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f1ac2e13-729a-4dbf-a797-2fb014824f0b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1411 microversion: 2.25 time: 0.292686 Oct 10 18:54:16.836943 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 563/1292] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:16 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1411 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:16.892253 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8910dbd9-c305-4023-9f17-0698a879172a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:16.893171 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8910dbd9-c305-4023-9f17-0698a879172a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:16.902534 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8910dbd9-c305-4023-9f17-0698a879172a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:16.904135 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8910dbd9-c305-4023-9f17-0698a879172a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:16.906281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8910dbd9-c305-4023-9f17-0698a879172a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:16.907332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8910dbd9-c305-4023-9f17-0698a879172a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:16.908683 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8910dbd9-c305-4023-9f17-0698a879172a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:16.909976 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8910dbd9-c305-4023-9f17-0698a879172a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:17.397528 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c1b0744c-fa1c-4735-a7cf-233593f73e15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:17.398144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c1b0744c-fa1c-4735-a7cf-233593f73e15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:17.404614 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c1b0744c-fa1c-4735-a7cf-233593f73e15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:17.405365 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c1b0744c-fa1c-4735-a7cf-233593f73e15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:17.405793 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c1b0744c-fa1c-4735-a7cf-233593f73e15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:17.406494 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c1b0744c-fa1c-4735-a7cf-233593f73e15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:17.406941 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c1b0744c-fa1c-4735-a7cf-233593f73e15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:17.407555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c1b0744c-fa1c-4735-a7cf-233593f73e15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:17.673311 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8910dbd9-c305-4023-9f17-0698a879172a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:17.684061 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8910dbd9-c305-4023-9f17-0698a879172a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1469 microversion: 2.1 time: 0.795644 Oct 10 18:54:17.700006 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 730/1293] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:16 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1469 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:17.700181 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c1b0744c-fa1c-4735-a7cf-233593f73e15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:17.700181 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c1b0744c-fa1c-4735-a7cf-233593f73e15 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1317 microversion: 2.1 time: 0.302032 Oct 10 18:54:17.700181 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 564/1294] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:17 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:17.721334 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-dde0d4f4-b998-4812-8c9a-2cbe38253988 req-3a6badac-dc3a-4513-aaa5-cc25cbbd098e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d79eab-1807-4467-b325-fe5f723ac559", "tag": "d4cf66ab-04c3-441b-9f60-e83abdbe71aa"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:17.723539 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4819224e-4e56-4a33-88e7-85a712e7db48 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:17.724231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4819224e-4e56-4a33-88e7-85a712e7db48 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:17.735056 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4819224e-4e56-4a33-88e7-85a712e7db48 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:17.735618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4819224e-4e56-4a33-88e7-85a712e7db48 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:17.736090 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4819224e-4e56-4a33-88e7-85a712e7db48 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:17.736832 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4819224e-4e56-4a33-88e7-85a712e7db48 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:17.737459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4819224e-4e56-4a33-88e7-85a712e7db48 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:17.737889 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4819224e-4e56-4a33-88e7-85a712e7db48 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:17.750193 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-dde0d4f4-b998-4812-8c9a-2cbe38253988 req-3a6badac-dc3a-4513-aaa5-cc25cbbd098e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:17.752619 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-dde0d4f4-b998-4812-8c9a-2cbe38253988 req-3a6badac-dc3a-4513-aaa5-cc25cbbd098e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:17.752619 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-dde0d4f4-b998-4812-8c9a-2cbe38253988 req-3a6badac-dc3a-4513-aaa5-cc25cbbd098e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:17.769503 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-dde0d4f4-b998-4812-8c9a-2cbe38253988 req-3a6badac-dc3a-4513-aaa5-cc25cbbd098e service nova] Creating event network-changed:d4cf66ab-04c3-441b-9f60-e83abdbe71aa for instance 96d79eab-1807-4467-b325-fe5f723ac559 on n-h1-860863-1 Oct 10 18:54:17.776252 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-dde0d4f4-b998-4812-8c9a-2cbe38253988 req-3a6badac-dc3a-4513-aaa5-cc25cbbd098e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072124 Oct 10 18:54:17.780763 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 731/1295] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:17.789295 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-ec32e217-327a-44f5-9f7f-e7cff7237060 req-6f6ae558-8068-479d-8d62-c0f7e6806591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1cd2e32-34ce-4a91-b679-2093d7808de2", "tag": "4f36482d-b661-45f8-b7dc-97cf9ebb5ad6"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:17.803090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-ec32e217-327a-44f5-9f7f-e7cff7237060 req-6f6ae558-8068-479d-8d62-c0f7e6806591 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:17.803648 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-ec32e217-327a-44f5-9f7f-e7cff7237060 req-6f6ae558-8068-479d-8d62-c0f7e6806591 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:17.804139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-ec32e217-327a-44f5-9f7f-e7cff7237060 req-6f6ae558-8068-479d-8d62-c0f7e6806591 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:17.822613 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-ec32e217-327a-44f5-9f7f-e7cff7237060 req-6f6ae558-8068-479d-8d62-c0f7e6806591 service nova] Creating event network-changed:4f36482d-b661-45f8-b7dc-97cf9ebb5ad6 for instance e1cd2e32-34ce-4a91-b679-2093d7808de2 on n-h1-860863-1 Oct 10 18:54:17.828743 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-ec32e217-327a-44f5-9f7f-e7cff7237060 req-6f6ae558-8068-479d-8d62-c0f7e6806591 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046094 Oct 10 18:54:17.829860 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 732/1296] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:17.837236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e5067dc4-4f41-443f-be15-143a985b0fb5 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:17.839042 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e5067dc4-4f41-443f-be15-143a985b0fb5 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:17.846286 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4819224e-4e56-4a33-88e7-85a712e7db48 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:17.846634 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5067dc4-4f41-443f-be15-143a985b0fb5 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:17.847225 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5067dc4-4f41-443f-be15-143a985b0fb5 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:17.847712 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5067dc4-4f41-443f-be15-143a985b0fb5 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:17.848709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5067dc4-4f41-443f-be15-143a985b0fb5 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:17.849210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5067dc4-4f41-443f-be15-143a985b0fb5 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:17.849734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5067dc4-4f41-443f-be15-143a985b0fb5 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:17.862575 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4819224e-4e56-4a33-88e7-85a712e7db48 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1273 microversion: 2.1 time: 0.162326 Oct 10 18:54:17.873158 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 565/1297] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:17 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:17.884068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6140e62e-281c-4a09-9699-290f115b65e5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:17.884068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6140e62e-281c-4a09-9699-290f115b65e5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:17.900836 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6140e62e-281c-4a09-9699-290f115b65e5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:17.902081 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6140e62e-281c-4a09-9699-290f115b65e5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:17.902695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6140e62e-281c-4a09-9699-290f115b65e5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:17.914154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6140e62e-281c-4a09-9699-290f115b65e5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:17.914652 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6140e62e-281c-4a09-9699-290f115b65e5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:17.916529 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6140e62e-281c-4a09-9699-290f115b65e5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:17.950577 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:18.163714 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6140e62e-281c-4a09-9699-290f115b65e5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:18.178399 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6140e62e-281c-4a09-9699-290f115b65e5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:18.180726 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6140e62e-281c-4a09-9699-290f115b65e5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:18.182019 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6140e62e-281c-4a09-9699-290f115b65e5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1411 microversion: 2.25 time: 0.316202 Oct 10 18:54:18.198717 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 566/1298] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:17 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1411 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:18.381624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e5067dc4-4f41-443f-be15-143a985b0fb5 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:18.391685 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e5067dc4-4f41-443f-be15-143a985b0fb5 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1393 microversion: 2.1 time: 0.560284 Oct 10 18:54:18.392372 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 733/1299] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:17 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1393 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:18.716194 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d0e83525-a560-45ab-82dc-55bc95827e04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:18.727769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d0e83525-a560-45ab-82dc-55bc95827e04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:18.727943 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b372bf77-74bf-40e7-b1d4-bc457d9aa0b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:18.727943 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b372bf77-74bf-40e7-b1d4-bc457d9aa0b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:18.738906 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0e83525-a560-45ab-82dc-55bc95827e04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:18.739449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0e83525-a560-45ab-82dc-55bc95827e04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:18.746089 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b372bf77-74bf-40e7-b1d4-bc457d9aa0b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:18.746624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b372bf77-74bf-40e7-b1d4-bc457d9aa0b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:18.747210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b372bf77-74bf-40e7-b1d4-bc457d9aa0b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:18.756710 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0e83525-a560-45ab-82dc-55bc95827e04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:18.758910 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0e83525-a560-45ab-82dc-55bc95827e04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:18.759427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0e83525-a560-45ab-82dc-55bc95827e04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:18.762351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b372bf77-74bf-40e7-b1d4-bc457d9aa0b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:18.762854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b372bf77-74bf-40e7-b1d4-bc457d9aa0b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:18.763300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b372bf77-74bf-40e7-b1d4-bc457d9aa0b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:18.764530 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d0e83525-a560-45ab-82dc-55bc95827e04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:18.877785 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d0e83525-a560-45ab-82dc-55bc95827e04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:18.891012 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d0e83525-a560-45ab-82dc-55bc95827e04 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1427 microversion: 2.1 time: 0.181047 Oct 10 18:54:18.891691 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 567/1300] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:18 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1427 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:18.899224 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e2bd7723-92ec-4323-9bea-cb316dbdb21a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:18.899861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e2bd7723-92ec-4323-9bea-cb316dbdb21a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:18.907903 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2bd7723-92ec-4323-9bea-cb316dbdb21a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:18.908466 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2bd7723-92ec-4323-9bea-cb316dbdb21a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:18.909025 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2bd7723-92ec-4323-9bea-cb316dbdb21a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:18.909763 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2bd7723-92ec-4323-9bea-cb316dbdb21a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:18.910227 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2bd7723-92ec-4323-9bea-cb316dbdb21a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:18.910681 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2bd7723-92ec-4323-9bea-cb316dbdb21a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:18.984197 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e2bd7723-92ec-4323-9bea-cb316dbdb21a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:18.993344 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e2bd7723-92ec-4323-9bea-cb316dbdb21a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1273 microversion: 2.1 time: 0.100565 Oct 10 18:54:18.994808 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 568/1301] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:18 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:19.046450 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b372bf77-74bf-40e7-b1d4-bc457d9aa0b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:19.059107 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b372bf77-74bf-40e7-b1d4-bc457d9aa0b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1317 microversion: 2.1 time: 0.339588 Oct 10 18:54:19.073068 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 734/1302] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:18 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:19.211128 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2fb6b776-3acb-48fc-a3cf-faae5644be3e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:19.213363 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2fb6b776-3acb-48fc-a3cf-faae5644be3e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:19.223979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6b776-3acb-48fc-a3cf-faae5644be3e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:19.224824 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6b776-3acb-48fc-a3cf-faae5644be3e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:19.226911 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6b776-3acb-48fc-a3cf-faae5644be3e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:19.233272 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6b776-3acb-48fc-a3cf-faae5644be3e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:19.234064 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6b776-3acb-48fc-a3cf-faae5644be3e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:19.234720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6b776-3acb-48fc-a3cf-faae5644be3e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:19.416364 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5a15185e-6bb1-42aa-b746-eec3d065e099 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:19.417050 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5a15185e-6bb1-42aa-b746-eec3d065e099 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:19.427994 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a15185e-6bb1-42aa-b746-eec3d065e099 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:19.428503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a15185e-6bb1-42aa-b746-eec3d065e099 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:19.428962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a15185e-6bb1-42aa-b746-eec3d065e099 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:19.435773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a15185e-6bb1-42aa-b746-eec3d065e099 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:19.437861 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a15185e-6bb1-42aa-b746-eec3d065e099 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:19.438511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a15185e-6bb1-42aa-b746-eec3d065e099 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:19.773283 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5a15185e-6bb1-42aa-b746-eec3d065e099 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:19.786873 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5a15185e-6bb1-42aa-b746-eec3d065e099 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1393 microversion: 2.1 time: 0.375172 Oct 10 18:54:19.788278 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 735/1303] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:19 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1393 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:19.793626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5f129c7f-df61-45cc-9663-6f21207e09cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:19.794359 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5f129c7f-df61-45cc-9663-6f21207e09cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:19.803558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f129c7f-df61-45cc-9663-6f21207e09cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:19.804345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f129c7f-df61-45cc-9663-6f21207e09cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:19.805275 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f129c7f-df61-45cc-9663-6f21207e09cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:19.806162 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f129c7f-df61-45cc-9663-6f21207e09cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:19.806797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f129c7f-df61-45cc-9663-6f21207e09cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:19.807514 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f129c7f-df61-45cc-9663-6f21207e09cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:19.845963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5f129c7f-df61-45cc-9663-6f21207e09cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:54:19.916896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2fb6b776-3acb-48fc-a3cf-faae5644be3e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:19.925179 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2fb6b776-3acb-48fc-a3cf-faae5644be3e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:19.927374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2fb6b776-3acb-48fc-a3cf-faae5644be3e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:19.928848 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2fb6b776-3acb-48fc-a3cf-faae5644be3e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1411 microversion: 2.25 time: 0.723463 Oct 10 18:54:19.940796 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 569/1304] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:19 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1411 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:19.953117 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-6fb02609-cbec-4be1-a257-189dc5556ae0 req-8f565777-5fc0-4033-9062-4d4c6859b883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ec3f63-ef69-4151-987f-39dda9024b73", "name": "network-vif-deleted", "tag": "e655b402-9cae-4ff9-ac35-3f3160df330a"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:19.963025 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6fb02609-cbec-4be1-a257-189dc5556ae0 req-8f565777-5fc0-4033-9062-4d4c6859b883 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:19.963521 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6fb02609-cbec-4be1-a257-189dc5556ae0 req-8f565777-5fc0-4033-9062-4d4c6859b883 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:19.963953 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6fb02609-cbec-4be1-a257-189dc5556ae0 req-8f565777-5fc0-4033-9062-4d4c6859b883 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:19.990002 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-6fb02609-cbec-4be1-a257-189dc5556ae0 req-8f565777-5fc0-4033-9062-4d4c6859b883 service nova] Creating event network-vif-deleted:e655b402-9cae-4ff9-ac35-3f3160df330a for instance 99ec3f63-ef69-4151-987f-39dda9024b73 on n-h1-860863-1 Oct 10 18:54:19.999692 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-6fb02609-cbec-4be1-a257-189dc5556ae0 req-8f565777-5fc0-4033-9062-4d4c6859b883 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057235 Oct 10 18:54:20.000312 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 570/1305] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:20.012377 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d5f52c9c-0b08-4446-91c2-5f16bfde34fc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:20.013404 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d5f52c9c-0b08-4446-91c2-5f16bfde34fc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:20.020138 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5f52c9c-0b08-4446-91c2-5f16bfde34fc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:20.020991 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5f52c9c-0b08-4446-91c2-5f16bfde34fc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:20.021621 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5f52c9c-0b08-4446-91c2-5f16bfde34fc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:20.022525 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5f52c9c-0b08-4446-91c2-5f16bfde34fc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:20.023147 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5f52c9c-0b08-4446-91c2-5f16bfde34fc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:20.023738 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5f52c9c-0b08-4446-91c2-5f16bfde34fc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:20.148122 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5f129c7f-df61-45cc-9663-6f21207e09cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 204 len: 0 microversion: 2.1 time: 0.355985 Oct 10 18:54:20.150818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d5f52c9c-0b08-4446-91c2-5f16bfde34fc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:20.151060 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 736/1306] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:54:19 2022] DELETE /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:54:20.159736 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0ef91918-4c28-4d5b-b212-34ae4a44ad2e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:20.160744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0ef91918-4c28-4d5b-b212-34ae4a44ad2e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:20.166967 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d5f52c9c-0b08-4446-91c2-5f16bfde34fc tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1427 microversion: 2.1 time: 0.160164 Oct 10 18:54:20.169902 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ef91918-4c28-4d5b-b212-34ae4a44ad2e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:20.170639 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ef91918-4c28-4d5b-b212-34ae4a44ad2e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:20.171235 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 571/1307] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:20 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1427 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:20.171576 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ef91918-4c28-4d5b-b212-34ae4a44ad2e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:20.173511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ef91918-4c28-4d5b-b212-34ae4a44ad2e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:20.174585 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ef91918-4c28-4d5b-b212-34ae4a44ad2e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:20.175234 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ef91918-4c28-4d5b-b212-34ae4a44ad2e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:20.180131 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2d133c0b-38ae-4fcc-ba7f-3d8e45d3873e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:20.183518 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2d133c0b-38ae-4fcc-ba7f-3d8e45d3873e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:20.192787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2d133c0b-38ae-4fcc-ba7f-3d8e45d3873e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:20.193362 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2d133c0b-38ae-4fcc-ba7f-3d8e45d3873e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:20.194041 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2d133c0b-38ae-4fcc-ba7f-3d8e45d3873e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:20.194934 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2d133c0b-38ae-4fcc-ba7f-3d8e45d3873e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:20.195598 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2d133c0b-38ae-4fcc-ba7f-3d8e45d3873e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:20.196268 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2d133c0b-38ae-4fcc-ba7f-3d8e45d3873e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:20.312332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0ef91918-4c28-4d5b-b212-34ae4a44ad2e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:20.323308 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0ef91918-4c28-4d5b-b212-34ae4a44ad2e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1279 microversion: 2.1 time: 0.168727 Oct 10 18:54:20.336765 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 737/1308] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:20 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1279 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:20.345793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fd4cf75d-5e5c-4321-a644-af6e24349367 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:20.349931 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fd4cf75d-5e5c-4321-a644-af6e24349367 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:20.370531 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd4cf75d-5e5c-4321-a644-af6e24349367 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:20.371021 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd4cf75d-5e5c-4321-a644-af6e24349367 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:20.371447 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd4cf75d-5e5c-4321-a644-af6e24349367 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:20.372144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd4cf75d-5e5c-4321-a644-af6e24349367 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:20.373082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd4cf75d-5e5c-4321-a644-af6e24349367 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:20.373082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd4cf75d-5e5c-4321-a644-af6e24349367 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:20.388890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:20.446413 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2d133c0b-38ae-4fcc-ba7f-3d8e45d3873e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:20.449038 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:20.455381 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2d133c0b-38ae-4fcc-ba7f-3d8e45d3873e tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1317 microversion: 2.1 time: 0.282983 Oct 10 18:54:20.456054 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 572/1309] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:20 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:20.638485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fd4cf75d-5e5c-4321-a644-af6e24349367 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:20.652410 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fd4cf75d-5e5c-4321-a644-af6e24349367 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1555 microversion: 2.1 time: 0.310457 Oct 10 18:54:20.668574 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 738/1310] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:20 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1555 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:20.814233 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4ff5d544-b176-49a5-9520-04180203e4a4 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:20.815289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4ff5d544-b176-49a5-9520-04180203e4a4 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:20.850209 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ff5d544-b176-49a5-9520-04180203e4a4 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:20.850970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ff5d544-b176-49a5-9520-04180203e4a4 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:20.851437 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ff5d544-b176-49a5-9520-04180203e4a4 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:20.852213 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ff5d544-b176-49a5-9520-04180203e4a4 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:20.852708 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ff5d544-b176-49a5-9520-04180203e4a4 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:20.853125 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ff5d544-b176-49a5-9520-04180203e4a4 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:20.960339 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b99ece82-b83c-4ec4-8719-41da1f1f7d00 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:20.962346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b99ece82-b83c-4ec4-8719-41da1f1f7d00 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:20.968757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=20 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:20.974786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b99ece82-b83c-4ec4-8719-41da1f1f7d00 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:20.976832 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b99ece82-b83c-4ec4-8719-41da1f1f7d00 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:20.977815 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b99ece82-b83c-4ec4-8719-41da1f1f7d00 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:20.980399 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b99ece82-b83c-4ec4-8719-41da1f1f7d00 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:20.980980 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b99ece82-b83c-4ec4-8719-41da1f1f7d00 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:20.981504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b99ece82-b83c-4ec4-8719-41da1f1f7d00 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:21.076313 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4ff5d544-b176-49a5-9520-04180203e4a4 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:21.085586 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4ff5d544-b176-49a5-9520-04180203e4a4 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1393 microversion: 2.1 time: 0.276342 Oct 10 18:54:21.089070 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 573/1311] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:20 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1393 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:21.206268 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2882fca7-2c3d-440c-b533-b99597a2b39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:21.207164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2882fca7-2c3d-440c-b533-b99597a2b39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:21.227584 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2882fca7-2c3d-440c-b533-b99597a2b39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:21.228354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2882fca7-2c3d-440c-b533-b99597a2b39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:21.231324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2882fca7-2c3d-440c-b533-b99597a2b39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:21.238360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2882fca7-2c3d-440c-b533-b99597a2b39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:21.238360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2882fca7-2c3d-440c-b533-b99597a2b39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:21.238360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2882fca7-2c3d-440c-b533-b99597a2b39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:21.292365 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2882fca7-2c3d-440c-b533-b99597a2b39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:21.292933 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2882fca7-2c3d-440c-b533-b99597a2b39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:21.293366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2882fca7-2c3d-440c-b533-b99597a2b39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:21.293812 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-2882fca7-2c3d-440c-b533-b99597a2b39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lazy-loading 'fault' on Instance uuid 99ec3f63-ef69-4151-987f-39dda9024b73 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:54:21.354182 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2882fca7-2c3d-440c-b533-b99597a2b39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:21.369335 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2882fca7-2c3d-440c-b533-b99597a2b39a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 200 len: 1303 microversion: 2.1 time: 0.170215 Oct 10 18:54:21.370555 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 574/1312] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:21 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 1303 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:21.375573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-56e50535-fd72-405f-9c30-33fc0f565896 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:21.376228 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-56e50535-fd72-405f-9c30-33fc0f565896 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:21.382408 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56e50535-fd72-405f-9c30-33fc0f565896 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:21.385289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56e50535-fd72-405f-9c30-33fc0f565896 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:21.385289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56e50535-fd72-405f-9c30-33fc0f565896 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:21.385289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56e50535-fd72-405f-9c30-33fc0f565896 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:21.385289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56e50535-fd72-405f-9c30-33fc0f565896 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:21.385968 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56e50535-fd72-405f-9c30-33fc0f565896 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:21.430667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b99ece82-b83c-4ec4-8719-41da1f1f7d00 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:21.441768 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b99ece82-b83c-4ec4-8719-41da1f1f7d00 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:21.443377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b99ece82-b83c-4ec4-8719-41da1f1f7d00 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:21.444630 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b99ece82-b83c-4ec4-8719-41da1f1f7d00 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1411 microversion: 2.25 time: 0.490256 Oct 10 18:54:21.450106 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 739/1313] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:20 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1411 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:54:21.488560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c006bd07-6e4c-4e3a-bc90-d517c003ce42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:21.489833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c006bd07-6e4c-4e3a-bc90-d517c003ce42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:21.498601 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c006bd07-6e4c-4e3a-bc90-d517c003ce42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:21.499287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c006bd07-6e4c-4e3a-bc90-d517c003ce42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:21.499833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c006bd07-6e4c-4e3a-bc90-d517c003ce42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:21.500669 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c006bd07-6e4c-4e3a-bc90-d517c003ce42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:21.501190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c006bd07-6e4c-4e3a-bc90-d517c003ce42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:21.501684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c006bd07-6e4c-4e3a-bc90-d517c003ce42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:21.564733 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-56e50535-fd72-405f-9c30-33fc0f565896 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:21.575081 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-56e50535-fd72-405f-9c30-33fc0f565896 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1321 microversion: 2.1 time: 0.202909 Oct 10 18:54:21.575587 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 575/1314] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:21 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:21.679691 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6df80abf-7297-4aea-a061-bbe36818051f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:21.680496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6df80abf-7297-4aea-a061-bbe36818051f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:21.689843 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6df80abf-7297-4aea-a061-bbe36818051f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:21.690574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6df80abf-7297-4aea-a061-bbe36818051f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:21.691185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6df80abf-7297-4aea-a061-bbe36818051f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:21.692121 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6df80abf-7297-4aea-a061-bbe36818051f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:21.692765 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6df80abf-7297-4aea-a061-bbe36818051f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:21.693373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6df80abf-7297-4aea-a061-bbe36818051f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:21.804364 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c006bd07-6e4c-4e3a-bc90-d517c003ce42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:21.818618 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c006bd07-6e4c-4e3a-bc90-d517c003ce42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1317 microversion: 2.1 time: 0.336639 Oct 10 18:54:21.820724 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 740/1315] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:21 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:22.110388 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7128b600-5374-41d5-92a1-96d0f3987e65 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:22.111126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7128b600-5374-41d5-92a1-96d0f3987e65 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:22.118182 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7128b600-5374-41d5-92a1-96d0f3987e65 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:22.118747 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7128b600-5374-41d5-92a1-96d0f3987e65 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:22.119984 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7128b600-5374-41d5-92a1-96d0f3987e65 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:22.120953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7128b600-5374-41d5-92a1-96d0f3987e65 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:22.121626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7128b600-5374-41d5-92a1-96d0f3987e65 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:22.122273 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7128b600-5374-41d5-92a1-96d0f3987e65 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:22.284736 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6df80abf-7297-4aea-a061-bbe36818051f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:22.298579 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6df80abf-7297-4aea-a061-bbe36818051f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1555 microversion: 2.1 time: 0.616347 Oct 10 18:54:22.300029 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 576/1316] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:21 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1555 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:22.371882 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7128b600-5374-41d5-92a1-96d0f3987e65 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:22.381396 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7128b600-5374-41d5-92a1-96d0f3987e65 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1393 microversion: 2.1 time: 0.274705 Oct 10 18:54:22.384587 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 741/1317] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:22 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1393 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:22.406112 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ecc07269-d111-4b95-890d-3eb79cb8f7e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:22.407144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ecc07269-d111-4b95-890d-3eb79cb8f7e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: 99ec3f63-ef69-4151-987f-39dda9024b73] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:22.417575 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ecc07269-d111-4b95-890d-3eb79cb8f7e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:22.419590 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ecc07269-d111-4b95-890d-3eb79cb8f7e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:22.420748 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ecc07269-d111-4b95-890d-3eb79cb8f7e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:22.424703 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ecc07269-d111-4b95-890d-3eb79cb8f7e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:22.424703 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ecc07269-d111-4b95-890d-3eb79cb8f7e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:22.424703 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ecc07269-d111-4b95-890d-3eb79cb8f7e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:22.443338 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-ecc07269-d111-4b95-890d-3eb79cb8f7e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] HTTP exception thrown: Instance 99ec3f63-ef69-4151-987f-39dda9024b73 could not be found. Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ecc07269-d111-4b95-890d-3eb79cb8f7e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Request method failure captured: Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 HTTP/1.1 Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGnGzjHl9zlyRAeEBzTu296w6ybPgeC7xUdCMCcualbSf_ClTNcQCc02yK29SBpAKoWEwe0HB-GZxZtT31haBJBC8D0grXD2NGFsG3TQEahwD0_fE6RQX0G6O4OoSAuA1326ZdVMojMKz6BqaxFM06aKMBtF4PlmmkaDlludRjxsK5Y Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: b15c92e4a6804ff5ba5d91c342f6c529 Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersAdminTestJSON-416646207 Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b15c92e4a6804ff5ba5d91c342f6c529", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b15c92e4a6804ff5ba5d91c342f6c529"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b15c92e4a6804ff5ba5d91c342f6c529"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b15c92e4a6804ff5ba5d91c342f6c529"}]}] Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersAdminTestJSON-416646207 Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: b15c92e4a6804ff5ba5d91c342f6c529 Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersAdminTestJSON-416646207 Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersAdminTestJSON-416646207-project Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 53de519302254009b38a5324f76a1e92 Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersAdminTestJSON-416646207-project Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 99ec3f63-ef69-4151-987f-39dda9024b73 could not be found. Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '99ec3f63-ef69-4151-987f-39dda9024b73'} Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99ec3f63-ef69-4151-987f-39dda9024b73 could not be found. Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99ec3f63-ef69-4151-987f-39dda9024b73 could not be found. Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:22.453533 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:22.459933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:22.459933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:22.459933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:22.459933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:22.459933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:22.459933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99ec3f63-ef69-4151-987f-39dda9024b73 could not be found. Oct 10 18:54:22.459933 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:22.464107 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ecc07269-d111-4b95-890d-3eb79cb8f7e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Returning 404 to user: Instance 99ec3f63-ef69-4151-987f-39dda9024b73 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:22.466680 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ecc07269-d111-4b95-890d-3eb79cb8f7e7 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73" status: 404 len: 111 microversion: 2.1 time: 0.070006 Oct 10 18:54:22.475688 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 577/1318] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:22 2022] GET /compute/v2.1/servers/99ec3f63-ef69-4151-987f-39dda9024b73 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:54:22.488645 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5690b248-2710-4d54-a39a-4ed761f85f65 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:22.489301 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5690b248-2710-4d54-a39a-4ed761f85f65 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:22.489534 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-51fa5139-845f-4b7a-a326-3e0e08ea0111 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:22.490861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-51fa5139-845f-4b7a-a326-3e0e08ea0111 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:22.500372 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51fa5139-845f-4b7a-a326-3e0e08ea0111 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:22.505394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51fa5139-845f-4b7a-a326-3e0e08ea0111 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:22.505394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51fa5139-845f-4b7a-a326-3e0e08ea0111 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:22.505394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51fa5139-845f-4b7a-a326-3e0e08ea0111 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:22.505394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51fa5139-845f-4b7a-a326-3e0e08ea0111 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:22.505394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51fa5139-845f-4b7a-a326-3e0e08ea0111 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:22.508585 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5690b248-2710-4d54-a39a-4ed761f85f65 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:22.513010 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5690b248-2710-4d54-a39a-4ed761f85f65 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:22.513463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5690b248-2710-4d54-a39a-4ed761f85f65 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:22.514207 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5690b248-2710-4d54-a39a-4ed761f85f65 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:22.514663 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5690b248-2710-4d54-a39a-4ed761f85f65 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:22.515089 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5690b248-2710-4d54-a39a-4ed761f85f65 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:22.585287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-51fa5139-845f-4b7a-a326-3e0e08ea0111 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:54:23.019060 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-51fa5139-845f-4b7a-a326-3e0e08ea0111 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 204 len: 0 microversion: 2.1 time: 0.538936 Oct 10 18:54:23.019765 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 578/1319] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:54:22 2022] DELETE /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:54:23.030775 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0c518f43-f5c7-4afc-a553-4f567070d21d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:23.034153 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0c518f43-f5c7-4afc-a553-4f567070d21d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:23.048809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c518f43-f5c7-4afc-a553-4f567070d21d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:23.049336 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c518f43-f5c7-4afc-a553-4f567070d21d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:23.054818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c518f43-f5c7-4afc-a553-4f567070d21d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:23.054818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c518f43-f5c7-4afc-a553-4f567070d21d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:23.054818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c518f43-f5c7-4afc-a553-4f567070d21d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:23.060142 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c518f43-f5c7-4afc-a553-4f567070d21d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:23.061080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5690b248-2710-4d54-a39a-4ed761f85f65 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:23.082636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5690b248-2710-4d54-a39a-4ed761f85f65 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:23.085900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5690b248-2710-4d54-a39a-4ed761f85f65 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:23.092172 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5690b248-2710-4d54-a39a-4ed761f85f65 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1411 microversion: 2.25 time: 0.617130 Oct 10 18:54:23.093678 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=6 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:23.095259 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 742/1320] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:22 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1411 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:54:23.106802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-56a13647-c568-4689-8fe9-820bd3e9e960 req-b4732cfc-c109-4434-b583-50ab7d9e189e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07001745-db54-4bea-a7c8-d894f4638089", "name": "network-vif-plugged", "status": "completed", "tag": "5fbe7847-dfa2-4db5-b541-54af8f4629a1"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:23.138600 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-56a13647-c568-4689-8fe9-820bd3e9e960 req-b4732cfc-c109-4434-b583-50ab7d9e189e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:23.138989 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-56a13647-c568-4689-8fe9-820bd3e9e960 req-b4732cfc-c109-4434-b583-50ab7d9e189e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:23.139412 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-56a13647-c568-4689-8fe9-820bd3e9e960 req-b4732cfc-c109-4434-b583-50ab7d9e189e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:23.171907 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-56a13647-c568-4689-8fe9-820bd3e9e960 req-b4732cfc-c109-4434-b583-50ab7d9e189e service nova] Creating event network-vif-plugged:5fbe7847-dfa2-4db5-b541-54af8f4629a1 for instance 07001745-db54-4bea-a7c8-d894f4638089 on n-h2-860863-1 Oct 10 18:54:23.186376 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-56a13647-c568-4689-8fe9-820bd3e9e960 req-b4732cfc-c109-4434-b583-50ab7d9e189e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088790 Oct 10 18:54:23.187434 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 743/1321] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:23.202371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5d781807-fa63-423f-b984-61a062ba9d8a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:23.205035 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5d781807-fa63-423f-b984-61a062ba9d8a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:23.220660 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d781807-fa63-423f-b984-61a062ba9d8a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:23.221151 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d781807-fa63-423f-b984-61a062ba9d8a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:23.221579 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d781807-fa63-423f-b984-61a062ba9d8a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:23.222289 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d781807-fa63-423f-b984-61a062ba9d8a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:23.222735 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d781807-fa63-423f-b984-61a062ba9d8a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:23.224443 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d781807-fa63-423f-b984-61a062ba9d8a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:23.383387 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0c518f43-f5c7-4afc-a553-4f567070d21d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:23.392922 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0c518f43-f5c7-4afc-a553-4f567070d21d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1321 microversion: 2.1 time: 0.367599 Oct 10 18:54:23.393456 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 579/1322] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:23 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:23.418023 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8dee0b52-f891-42a3-b43f-dd287c11855a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:23.418023 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8dee0b52-f891-42a3-b43f-dd287c11855a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:23.423666 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8dee0b52-f891-42a3-b43f-dd287c11855a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:23.424140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8dee0b52-f891-42a3-b43f-dd287c11855a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:23.424603 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8dee0b52-f891-42a3-b43f-dd287c11855a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:23.425340 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8dee0b52-f891-42a3-b43f-dd287c11855a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:23.426467 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8dee0b52-f891-42a3-b43f-dd287c11855a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:23.427655 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8dee0b52-f891-42a3-b43f-dd287c11855a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:23.473432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5d781807-fa63-423f-b984-61a062ba9d8a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:23.482560 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5d781807-fa63-423f-b984-61a062ba9d8a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1317 microversion: 2.1 time: 0.292858 Oct 10 18:54:23.483237 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 744/1323] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:23 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:23.504677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8ad73069-1ad5-40d2-880b-c7a5e75ee1ac tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:23.505298 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8ad73069-1ad5-40d2-880b-c7a5e75ee1ac tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:23.512411 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ad73069-1ad5-40d2-880b-c7a5e75ee1ac tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:23.516511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ad73069-1ad5-40d2-880b-c7a5e75ee1ac tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:23.516511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ad73069-1ad5-40d2-880b-c7a5e75ee1ac tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:23.516511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ad73069-1ad5-40d2-880b-c7a5e75ee1ac tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:23.516511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ad73069-1ad5-40d2-880b-c7a5e75ee1ac tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:23.516511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ad73069-1ad5-40d2-880b-c7a5e75ee1ac tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:23.713375 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8dee0b52-f891-42a3-b43f-dd287c11855a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:23.722034 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8dee0b52-f891-42a3-b43f-dd287c11855a tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1469 microversion: 2.1 time: 0.316535 Oct 10 18:54:23.726156 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 580/1324] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:23 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1469 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:23.735838 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fee69b8e-ea5e-49d6-b7b0-fd47f8f46d85 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:23.736456 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fee69b8e-ea5e-49d6-b7b0-fd47f8f46d85 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:23.742468 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fee69b8e-ea5e-49d6-b7b0-fd47f8f46d85 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:23.743228 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fee69b8e-ea5e-49d6-b7b0-fd47f8f46d85 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:23.744360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fee69b8e-ea5e-49d6-b7b0-fd47f8f46d85 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:23.745264 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fee69b8e-ea5e-49d6-b7b0-fd47f8f46d85 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:23.745884 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fee69b8e-ea5e-49d6-b7b0-fd47f8f46d85 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:23.746470 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fee69b8e-ea5e-49d6-b7b0-fd47f8f46d85 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:23.799130 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8ad73069-1ad5-40d2-880b-c7a5e75ee1ac tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:23.835502 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8ad73069-1ad5-40d2-880b-c7a5e75ee1ac tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1555 microversion: 2.1 time: 0.350912 Oct 10 18:54:23.836103 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 745/1325] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:23 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1555 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:23.865728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-de66356c-30db-414a-ac03-681dd9845ce7 req-4a00d15f-9bac-432b-b753-5b600003c7f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4812966e-0f45-4261-bf1d-99e46ebab1ac", "name": "network-vif-deleted", "tag": "a67b1ca6-1605-4592-8d8e-0973c5d12f86"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:23.867389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-de66356c-30db-414a-ac03-681dd9845ce7 req-4a00d15f-9bac-432b-b753-5b600003c7f4 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:23.867861 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-de66356c-30db-414a-ac03-681dd9845ce7 req-4a00d15f-9bac-432b-b753-5b600003c7f4 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:23.868282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-de66356c-30db-414a-ac03-681dd9845ce7 req-4a00d15f-9bac-432b-b753-5b600003c7f4 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:23.883350 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-de66356c-30db-414a-ac03-681dd9845ce7 req-4a00d15f-9bac-432b-b753-5b600003c7f4 service nova] Creating event network-vif-deleted:a67b1ca6-1605-4592-8d8e-0973c5d12f86 for instance 4812966e-0f45-4261-bf1d-99e46ebab1ac on n-h2-860863-1 Oct 10 18:54:23.895537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=24 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:23.910066 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-de66356c-30db-414a-ac03-681dd9845ce7 req-4a00d15f-9bac-432b-b753-5b600003c7f4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072726 Oct 10 18:54:23.910688 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 746/1326] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:24.039300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-39e200b3-87af-4d11-9025-d0ab303c118f req-bb922051-5b95-4b46-ab33-efead3147e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5365436c-bee1-4eba-8561-14ce05700e6e", "tag": "86796ad0-424f-455d-9477-87ec669e0c56"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:24.051155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-39e200b3-87af-4d11-9025-d0ab303c118f req-bb922051-5b95-4b46-ab33-efead3147e67 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:24.052287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-39e200b3-87af-4d11-9025-d0ab303c118f req-bb922051-5b95-4b46-ab33-efead3147e67 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:24.053121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-39e200b3-87af-4d11-9025-d0ab303c118f req-bb922051-5b95-4b46-ab33-efead3147e67 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:24.072136 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-39e200b3-87af-4d11-9025-d0ab303c118f req-bb922051-5b95-4b46-ab33-efead3147e67 service nova] Creating event network-changed:86796ad0-424f-455d-9477-87ec669e0c56 for instance 5365436c-bee1-4eba-8561-14ce05700e6e on n-h2-860863-1 Oct 10 18:54:24.074387 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-39e200b3-87af-4d11-9025-d0ab303c118f req-bb922051-5b95-4b46-ab33-efead3147e67 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039132 Oct 10 18:54:24.075539 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 747/1327] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:54:24.120623 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a1116106-5927-42cc-a40d-627fe008c2c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:24.121341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a1116106-5927-42cc-a40d-627fe008c2c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:24.140777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a1116106-5927-42cc-a40d-627fe008c2c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:24.142220 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a1116106-5927-42cc-a40d-627fe008c2c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:24.142675 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a1116106-5927-42cc-a40d-627fe008c2c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:24.143579 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a1116106-5927-42cc-a40d-627fe008c2c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:24.144240 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a1116106-5927-42cc-a40d-627fe008c2c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:24.144988 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a1116106-5927-42cc-a40d-627fe008c2c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:24.211508 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fee69b8e-ea5e-49d6-b7b0-fd47f8f46d85 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:24.226529 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fee69b8e-ea5e-49d6-b7b0-fd47f8f46d85 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1393 microversion: 2.1 time: 0.496110 Oct 10 18:54:24.240562 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 581/1328] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:23 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1393 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:24.343568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a1116106-5927-42cc-a40d-627fe008c2c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:24.359292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a1116106-5927-42cc-a40d-627fe008c2c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:24.361433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a1116106-5927-42cc-a40d-627fe008c2c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:24.362600 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a1116106-5927-42cc-a40d-627fe008c2c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1411 microversion: 2.25 time: 0.246891 Oct 10 18:54:24.372687 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 748/1329] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:24 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1411 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:24.419903 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-25e9e23a-3e53-4708-8cb2-b233851b9269 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:24.421455 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-25e9e23a-3e53-4708-8cb2-b233851b9269 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:24.430260 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-25e9e23a-3e53-4708-8cb2-b233851b9269 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:24.430685 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-25e9e23a-3e53-4708-8cb2-b233851b9269 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:24.431308 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-25e9e23a-3e53-4708-8cb2-b233851b9269 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:24.432064 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-25e9e23a-3e53-4708-8cb2-b233851b9269 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:24.432522 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-25e9e23a-3e53-4708-8cb2-b233851b9269 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:24.433171 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-25e9e23a-3e53-4708-8cb2-b233851b9269 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:24.517128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f40823df-4262-4043-8528-648bdc03a654 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:24.518095 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f40823df-4262-4043-8528-648bdc03a654 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:24.541939 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f40823df-4262-4043-8528-648bdc03a654 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:24.542719 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f40823df-4262-4043-8528-648bdc03a654 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:24.544812 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f40823df-4262-4043-8528-648bdc03a654 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:24.546457 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f40823df-4262-4043-8528-648bdc03a654 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:24.548351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f40823df-4262-4043-8528-648bdc03a654 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:24.549477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f40823df-4262-4043-8528-648bdc03a654 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:25.390458 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-25e9e23a-3e53-4708-8cb2-b233851b9269 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:25.411348 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-25e9e23a-3e53-4708-8cb2-b233851b9269 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1321 microversion: 2.1 time: 0.995113 Oct 10 18:54:25.412807 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 582/1330] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:24 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1321 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:25.415965 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f40823df-4262-4043-8528-648bdc03a654 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:25.424594 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f40823df-4262-4043-8528-648bdc03a654 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1317 microversion: 2.1 time: 0.921897 Oct 10 18:54:25.434251 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0320a651-6b0f-4254-90db-112fb5527c58 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:25.434251 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0320a651-6b0f-4254-90db-112fb5527c58 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:25.435688 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 749/1331] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:24 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1317 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:25.440877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0320a651-6b0f-4254-90db-112fb5527c58 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:25.441599 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0320a651-6b0f-4254-90db-112fb5527c58 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:25.442540 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0320a651-6b0f-4254-90db-112fb5527c58 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:25.443412 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0320a651-6b0f-4254-90db-112fb5527c58 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:25.444019 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d71fdcc6-cd8b-43d8-84c9-f831d72c651c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:25.444386 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0320a651-6b0f-4254-90db-112fb5527c58 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:25.445004 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0320a651-6b0f-4254-90db-112fb5527c58 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:25.446261 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d71fdcc6-cd8b-43d8-84c9-f831d72c651c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:25.470562 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d71fdcc6-cd8b-43d8-84c9-f831d72c651c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:25.471219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d71fdcc6-cd8b-43d8-84c9-f831d72c651c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:25.472483 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d71fdcc6-cd8b-43d8-84c9-f831d72c651c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:25.473843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d71fdcc6-cd8b-43d8-84c9-f831d72c651c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:25.474526 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d71fdcc6-cd8b-43d8-84c9-f831d72c651c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:25.475158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d71fdcc6-cd8b-43d8-84c9-f831d72c651c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:25.684687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d71fdcc6-cd8b-43d8-84c9-f831d72c651c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:25.697314 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d71fdcc6-cd8b-43d8-84c9-f831d72c651c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1346 microversion: 2.1 time: 0.257173 Oct 10 18:54:25.698875 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 750/1332] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:25 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1346 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:25.706325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1a5a9048-d2cc-408b-900e-4fee9d112daf tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:25.707116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1a5a9048-d2cc-408b-900e-4fee9d112daf tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:25.714715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a5a9048-d2cc-408b-900e-4fee9d112daf tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:25.715385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a5a9048-d2cc-408b-900e-4fee9d112daf tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:25.716102 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a5a9048-d2cc-408b-900e-4fee9d112daf tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:25.716908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a5a9048-d2cc-408b-900e-4fee9d112daf tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:25.717455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a5a9048-d2cc-408b-900e-4fee9d112daf tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:25.718148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a5a9048-d2cc-408b-900e-4fee9d112daf tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:25.903649 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0320a651-6b0f-4254-90db-112fb5527c58 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:25.921354 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0320a651-6b0f-4254-90db-112fb5527c58 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1469 microversion: 2.1 time: 0.506735 Oct 10 18:54:25.922152 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 583/1333] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:25 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1469 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:25.930104 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-29569a7e-8a5c-45b0-9a6a-a9aaa59f3013 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:25.933595 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-29569a7e-8a5c-45b0-9a6a-a9aaa59f3013 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:25.948693 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29569a7e-8a5c-45b0-9a6a-a9aaa59f3013 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:25.949395 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29569a7e-8a5c-45b0-9a6a-a9aaa59f3013 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:25.950042 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29569a7e-8a5c-45b0-9a6a-a9aaa59f3013 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:25.950747 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29569a7e-8a5c-45b0-9a6a-a9aaa59f3013 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:25.951248 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29569a7e-8a5c-45b0-9a6a-a9aaa59f3013 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:25.951619 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29569a7e-8a5c-45b0-9a6a-a9aaa59f3013 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:26.203016 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1a5a9048-d2cc-408b-900e-4fee9d112daf tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:26.214640 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1a5a9048-d2cc-408b-900e-4fee9d112daf tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1393 microversion: 2.1 time: 0.513607 Oct 10 18:54:26.216075 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 751/1334] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:25 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1393 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:26.222505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-3d6759e4-2e7b-4327-b0c3-2e003829425b req-b64d440f-6109-42b9-b6b5-b49beebf4817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1cd2e32-34ce-4a91-b679-2093d7808de2", "name": "network-vif-plugged", "status": "completed", "tag": "4f36482d-b661-45f8-b7dc-97cf9ebb5ad6"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:26.251962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-3d6759e4-2e7b-4327-b0c3-2e003829425b req-b64d440f-6109-42b9-b6b5-b49beebf4817 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:26.251962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-3d6759e4-2e7b-4327-b0c3-2e003829425b req-b64d440f-6109-42b9-b6b5-b49beebf4817 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:26.252964 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-3d6759e4-2e7b-4327-b0c3-2e003829425b req-b64d440f-6109-42b9-b6b5-b49beebf4817 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:26.269519 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-3d6759e4-2e7b-4327-b0c3-2e003829425b req-b64d440f-6109-42b9-b6b5-b49beebf4817 service nova] Creating event network-vif-plugged:4f36482d-b661-45f8-b7dc-97cf9ebb5ad6 for instance e1cd2e32-34ce-4a91-b679-2093d7808de2 on n-h1-860863-1 Oct 10 18:54:26.277483 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-3d6759e4-2e7b-4327-b0c3-2e003829425b req-b64d440f-6109-42b9-b6b5-b49beebf4817 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059573 Oct 10 18:54:26.278856 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 752/1335] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:26.316830 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-29569a7e-8a5c-45b0-9a6a-a9aaa59f3013 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:26.327528 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-29569a7e-8a5c-45b0-9a6a-a9aaa59f3013 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:26.347829 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-29569a7e-8a5c-45b0-9a6a-a9aaa59f3013 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:26.349468 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-29569a7e-8a5c-45b0-9a6a-a9aaa59f3013 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1411 microversion: 2.25 time: 0.426165 Oct 10 18:54:26.350316 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 584/1336] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:25 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1411 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:26.441184 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d4950f0c-6d2e-45d1-b420-8264daacf2dd tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:26.442365 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d4950f0c-6d2e-45d1-b420-8264daacf2dd tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:26.449811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d4950f0c-6d2e-45d1-b420-8264daacf2dd tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:26.450355 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d4950f0c-6d2e-45d1-b420-8264daacf2dd tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:26.450797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d4950f0c-6d2e-45d1-b420-8264daacf2dd tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:26.451508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d4950f0c-6d2e-45d1-b420-8264daacf2dd tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:26.452115 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d4950f0c-6d2e-45d1-b420-8264daacf2dd tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:26.452607 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d4950f0c-6d2e-45d1-b420-8264daacf2dd tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:26.470125 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-26cd9615-fad4-4698-b260-992305d9a815 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:26.470747 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-26cd9615-fad4-4698-b260-992305d9a815 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:26.489474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26cd9615-fad4-4698-b260-992305d9a815 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:26.489968 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26cd9615-fad4-4698-b260-992305d9a815 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:26.490400 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26cd9615-fad4-4698-b260-992305d9a815 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:26.491105 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26cd9615-fad4-4698-b260-992305d9a815 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:26.491551 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26cd9615-fad4-4698-b260-992305d9a815 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:26.491965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26cd9615-fad4-4698-b260-992305d9a815 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:26.865504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d4950f0c-6d2e-45d1-b420-8264daacf2dd tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:26.879435 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-26cd9615-fad4-4698-b260-992305d9a815 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:26.881174 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d4950f0c-6d2e-45d1-b420-8264daacf2dd tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1321 microversion: 2.1 time: 0.445653 Oct 10 18:54:26.881770 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 753/1337] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:26 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1321 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:26.889551 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-26cd9615-fad4-4698-b260-992305d9a815 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1465 microversion: 2.1 time: 0.423218 Oct 10 18:54:26.913148 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 585/1338] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:26 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1465 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:26.921100 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-944d6698-6ee0-47b3-b9c1-1147939b654e tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:26.921710 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-944d6698-6ee0-47b3-b9c1-1147939b654e tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:26.923401 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6c74fdb0-6089-482f-8f88-ffcc9d3f8adc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:26.924174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6c74fdb0-6089-482f-8f88-ffcc9d3f8adc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:26.935706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6c74fdb0-6089-482f-8f88-ffcc9d3f8adc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:26.940491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-944d6698-6ee0-47b3-b9c1-1147939b654e tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:26.940491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-944d6698-6ee0-47b3-b9c1-1147939b654e tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:26.940491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-944d6698-6ee0-47b3-b9c1-1147939b654e tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:26.940835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6c74fdb0-6089-482f-8f88-ffcc9d3f8adc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:26.940933 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-944d6698-6ee0-47b3-b9c1-1147939b654e tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:26.941033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6c74fdb0-6089-482f-8f88-ffcc9d3f8adc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:26.941141 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-944d6698-6ee0-47b3-b9c1-1147939b654e tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:26.941253 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6c74fdb0-6089-482f-8f88-ffcc9d3f8adc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:26.941370 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-944d6698-6ee0-47b3-b9c1-1147939b654e tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:26.942301 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6c74fdb0-6089-482f-8f88-ffcc9d3f8adc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:26.946012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6c74fdb0-6089-482f-8f88-ffcc9d3f8adc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:27.081689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6c74fdb0-6089-482f-8f88-ffcc9d3f8adc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:27.099418 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6c74fdb0-6089-482f-8f88-ffcc9d3f8adc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1346 microversion: 2.1 time: 0.188544 Oct 10 18:54:27.100140 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 754/1339] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:26 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1346 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:27.110054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c6e26a58-ada5-4827-8003-187874ec727f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:27.110054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c6e26a58-ada5-4827-8003-187874ec727f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:27.124219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6e26a58-ada5-4827-8003-187874ec727f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:27.125056 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6e26a58-ada5-4827-8003-187874ec727f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:27.125679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6e26a58-ada5-4827-8003-187874ec727f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:27.126547 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6e26a58-ada5-4827-8003-187874ec727f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:27.127317 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6e26a58-ada5-4827-8003-187874ec727f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:27.127926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6e26a58-ada5-4827-8003-187874ec727f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:27.212469 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-944d6698-6ee0-47b3-b9c1-1147939b654e tempest-ServersOnMultiNodesTest-1752906602 tempest-ServersOnMultiNodesTest-1752906602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1616 microversion: 2.1 time: 0.294977 Oct 10 18:54:27.214280 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 586/1340] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:26 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1616 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:27.220872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-055e272a-884b-4afe-9e79-e48c0eefafca req-632b2940-554a-4179-b11f-e1c4037456eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01ef8a6-60ce-4468-a0e9-6a33c3392761", "name": "network-vif-deleted", "tag": "69b5aea1-483c-4645-b02d-ca80e77bdc38"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:27.229710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c6e26a58-ada5-4827-8003-187874ec727f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:27.234682 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-055e272a-884b-4afe-9e79-e48c0eefafca req-632b2940-554a-4179-b11f-e1c4037456eb service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:27.238629 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c6e26a58-ada5-4827-8003-187874ec727f tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1427 microversion: 2.1 time: 0.137293 Oct 10 18:54:27.239317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-055e272a-884b-4afe-9e79-e48c0eefafca req-632b2940-554a-4179-b11f-e1c4037456eb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:27.239752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-055e272a-884b-4afe-9e79-e48c0eefafca req-632b2940-554a-4179-b11f-e1c4037456eb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:27.240104 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 755/1341] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:27 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1427 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:27.253884 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-055e272a-884b-4afe-9e79-e48c0eefafca req-632b2940-554a-4179-b11f-e1c4037456eb service nova] Creating event network-vif-deleted:69b5aea1-483c-4645-b02d-ca80e77bdc38 for instance f01ef8a6-60ce-4468-a0e9-6a33c3392761 on n-h1-860863-1 Oct 10 18:54:27.262161 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-055e272a-884b-4afe-9e79-e48c0eefafca req-632b2940-554a-4179-b11f-e1c4037456eb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046420 Oct 10 18:54:27.265076 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 587/1342] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:27.271336 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ab34f5be-96f2-42c4-9650-ddaf9e1d133a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:27.271865 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ab34f5be-96f2-42c4-9650-ddaf9e1d133a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:27.282273 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab34f5be-96f2-42c4-9650-ddaf9e1d133a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:27.282769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab34f5be-96f2-42c4-9650-ddaf9e1d133a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:27.283203 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab34f5be-96f2-42c4-9650-ddaf9e1d133a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:27.283917 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab34f5be-96f2-42c4-9650-ddaf9e1d133a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:27.284629 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab34f5be-96f2-42c4-9650-ddaf9e1d133a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:27.285064 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab34f5be-96f2-42c4-9650-ddaf9e1d133a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:27.319759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ab34f5be-96f2-42c4-9650-ddaf9e1d133a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:54:27.334260 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:27.474951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-859cf63b-be63-4dbe-92ba-7fac7c476e89 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Calling method '.version_select at 0x7f31921b8430>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:27.504154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG neutronclient.v2_0.client [None req-859cf63b-be63-4dbe-92ba-7fac7c476e89 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9f5e44c6-c10f-4f4b-bf42-156469df1309 does not exist", "detail": ""}} {{(pid=127288) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:54:27.505000 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.security_group_api [None req-859cf63b-be63-4dbe-92ba-7fac7c476e89 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Neutron security group 9f5e44c6-c10f-4f4b-bf42-156469df1309 not found {{(pid=127288) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:54:27.505929 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-859cf63b-be63-4dbe-92ba-7fac7c476e89 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] HTTP exception thrown: Security group 9f5e44c6-c10f-4f4b-bf42-156469df1309 does not exist Oct 10 18:54:27.505929 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-59ef28be-df3d-481c-8cc2-ed789a6b1b88'] Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-859cf63b-be63-4dbe-92ba-7fac7c476e89 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Request method failure captured: Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/os-security-groups/9f5e44c6-c10f-4f4b-bf42-156469df1309 HTTP/1.1 Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGpjMs9YidgsygUOkr6JT50hWG-cekvAaeMcemTbwiSporUEbh1_WyvWPmOYstlW46ZhTbDbvsJDXWblqyggJDBZeJwgQHK5sShQ5NT_QX4iJpZ6m1UVkOEtJOolgtkhDPdyE4i6yvp4ycuErKhGPFmEcS6G98nSlO8AV4CpTJQ9lYQ Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 32e3fff2f377462ab62b9d4d6ce64842 Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1669756519 Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_32e3fff2f377462ab62b9d4d6ce64842", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/32e3fff2f377462ab62b9d4d6ce64842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/32e3fff2f377462ab62b9d4d6ce64842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/32e3fff2f377462ab62b9d4d6ce64842"}]}] Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1669756519 Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 32e3fff2f377462ab62b9d4d6ce64842 Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1669756519 Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupsNegativeTestJSON-1669756519-project Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 0114d1ed2232451eb7ae2e1e3a7c25d6 Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1669756519-project Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: exception: Security group 9f5e44c6-c10f-4f4b-bf42-156469df1309 does not exist Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-59ef28be-df3d-481c-8cc2-ed789a6b1b88'] Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '9f5e44c6-c10f-4f4b-bf42-156469df1309'} Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:54:27.511004 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9f5e44c6-c10f-4f4b-bf42-156469df1309 does not exist Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59ef28be-df3d-481c-8cc2-ed789a6b1b88'] Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9f5e44c6-c10f-4f4b-bf42-156469df1309 does not exist Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59ef28be-df3d-481c-8cc2-ed789a6b1b88'] Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9f5e44c6-c10f-4f4b-bf42-156469df1309 does not exist Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59ef28be-df3d-481c-8cc2-ed789a6b1b88'] Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9f5e44c6-c10f-4f4b-bf42-156469df1309 does not exist Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59ef28be-df3d-481c-8cc2-ed789a6b1b88'] Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-859cf63b-be63-4dbe-92ba-7fac7c476e89 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Returning 404 to user: Security group 9f5e44c6-c10f-4f4b-bf42-156469df1309 does not exist Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-59ef28be-df3d-481c-8cc2-ed789a6b1b88'] {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-859cf63b-be63-4dbe-92ba-7fac7c476e89 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/9f5e44c6-c10f-4f4b-bf42-156469df1309" status: 404 len: 194 microversion: 2.1 time: 0.271343 Oct 10 18:54:27.517572 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 756/1343] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:54:27 2022] DELETE /compute/v2.1/os-security-groups/9f5e44c6-c10f-4f4b-bf42-156469df1309 => generated 194 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:54:27.525378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3a1cce83-46c6-4eee-b961-8e759f953860 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:27.525674 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3a1cce83-46c6-4eee-b961-8e759f953860 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:27.535139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a1cce83-46c6-4eee-b961-8e759f953860 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:27.535768 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a1cce83-46c6-4eee-b961-8e759f953860 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:27.537335 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a1cce83-46c6-4eee-b961-8e759f953860 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:27.538325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a1cce83-46c6-4eee-b961-8e759f953860 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:27.538856 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a1cce83-46c6-4eee-b961-8e759f953860 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:27.539958 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a1cce83-46c6-4eee-b961-8e759f953860 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:27.658558 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ab34f5be-96f2-42c4-9650-ddaf9e1d133a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "DELETE /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 204 len: 0 microversion: 2.1 time: 0.391996 Oct 10 18:54:27.662965 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 588/1344] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:54:27 2022] DELETE /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:54:27.666216 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c1bf947a-0b72-4ee4-8fdf-bb23b820fb11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:27.667050 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c1bf947a-0b72-4ee4-8fdf-bb23b820fb11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:27.680157 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c1bf947a-0b72-4ee4-8fdf-bb23b820fb11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:27.681918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c1bf947a-0b72-4ee4-8fdf-bb23b820fb11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:27.683887 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c1bf947a-0b72-4ee4-8fdf-bb23b820fb11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:27.685479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c1bf947a-0b72-4ee4-8fdf-bb23b820fb11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:27.688579 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c1bf947a-0b72-4ee4-8fdf-bb23b820fb11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:27.689906 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c1bf947a-0b72-4ee4-8fdf-bb23b820fb11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:27.744848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3a1cce83-46c6-4eee-b961-8e759f953860 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:27.755102 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3a1cce83-46c6-4eee-b961-8e759f953860 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1393 microversion: 2.1 time: 0.240160 Oct 10 18:54:27.756003 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 757/1345] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:27 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1393 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:27.762958 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-aea301d9-9904-4217-a3aa-8089b4b34b0c tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005762 Oct 10 18:54:27.763752 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 758/1346] 10.222.0.43 () {58 vars in 1164 bytes} [Mon Oct 10 18:54:27 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 10 18:54:27.770819 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8c7b6a8b-42b0-4630-ae7b-631c8c98d3f8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:27.771447 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8c7b6a8b-42b0-4630-ae7b-631c8c98d3f8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:27.779400 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8c7b6a8b-42b0-4630-ae7b-631c8c98d3f8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:27.780946 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8c7b6a8b-42b0-4630-ae7b-631c8c98d3f8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:27.781568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8c7b6a8b-42b0-4630-ae7b-631c8c98d3f8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:27.782442 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8c7b6a8b-42b0-4630-ae7b-631c8c98d3f8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:27.783056 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8c7b6a8b-42b0-4630-ae7b-631c8c98d3f8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:27.783658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8c7b6a8b-42b0-4630-ae7b-631c8c98d3f8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:27.882957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c1bf947a-0b72-4ee4-8fdf-bb23b820fb11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:27.894477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c1bf947a-0b72-4ee4-8fdf-bb23b820fb11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:27.896125 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c1bf947a-0b72-4ee4-8fdf-bb23b820fb11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:27.899052 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c1bf947a-0b72-4ee4-8fdf-bb23b820fb11 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1411 microversion: 2.25 time: 0.235950 Oct 10 18:54:27.902498 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 589/1347] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:27 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1411 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:27.907803 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-667e006c-ab2c-40d3-8a3c-1f66807bc90c tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Calling method '.version_select at 0x7f318dcc1c10>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:27.962477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8c7b6a8b-42b0-4630-ae7b-631c8c98d3f8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:27.965569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:27.972322 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8c7b6a8b-42b0-4630-ae7b-631c8c98d3f8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1471 microversion: 2.1 time: 0.207554 Oct 10 18:54:27.985316 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 759/1348] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:27 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:27.997333 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-42120b3e-3ee1-4aec-8da4-1745bb7a88f4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:27.998128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-42120b3e-3ee1-4aec-8da4-1745bb7a88f4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:28.006397 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42120b3e-3ee1-4aec-8da4-1745bb7a88f4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:28.007144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42120b3e-3ee1-4aec-8da4-1745bb7a88f4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:28.007807 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42120b3e-3ee1-4aec-8da4-1745bb7a88f4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:28.008790 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42120b3e-3ee1-4aec-8da4-1745bb7a88f4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:28.010875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42120b3e-3ee1-4aec-8da4-1745bb7a88f4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:28.011318 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42120b3e-3ee1-4aec-8da4-1745bb7a88f4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:28.202645 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-667e006c-ab2c-40d3-8a3c-1f66807bc90c tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.298919 Oct 10 18:54:28.203634 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 590/1349] 10.222.0.43 () {58 vars in 1158 bytes} [Mon Oct 10 18:54:27 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:28.208301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-33a59c87-45c7-4c76-8c98-e72a961bb9a1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:28.210343 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-33a59c87-45c7-4c76-8c98-e72a961bb9a1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:28.220019 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33a59c87-45c7-4c76-8c98-e72a961bb9a1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:28.224184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33a59c87-45c7-4c76-8c98-e72a961bb9a1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:28.224834 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33a59c87-45c7-4c76-8c98-e72a961bb9a1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:28.229695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33a59c87-45c7-4c76-8c98-e72a961bb9a1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:28.229695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33a59c87-45c7-4c76-8c98-e72a961bb9a1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:28.229695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33a59c87-45c7-4c76-8c98-e72a961bb9a1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:28.234235 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-42120b3e-3ee1-4aec-8da4-1745bb7a88f4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:28.244129 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-42120b3e-3ee1-4aec-8da4-1745bb7a88f4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1321 microversion: 2.1 time: 0.256486 Oct 10 18:54:28.260714 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 760/1350] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:27 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:28.271301 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-562efa68-5110-48e0-962a-06c929f0d5d9 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Calling method '.version_select at 0x7f318d826ee0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:28.332472 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-33a59c87-45c7-4c76-8c98-e72a961bb9a1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:28.343372 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-33a59c87-45c7-4c76-8c98-e72a961bb9a1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1346 microversion: 2.1 time: 0.138543 Oct 10 18:54:28.343961 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 591/1351] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:28 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1346 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:28.349039 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-85e801c4-8e7a-4abf-a58b-c0b180a2891e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:28.349819 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-85e801c4-8e7a-4abf-a58b-c0b180a2891e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:28.357734 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85e801c4-8e7a-4abf-a58b-c0b180a2891e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:28.358423 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85e801c4-8e7a-4abf-a58b-c0b180a2891e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:28.359020 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85e801c4-8e7a-4abf-a58b-c0b180a2891e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:28.359902 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85e801c4-8e7a-4abf-a58b-c0b180a2891e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:28.360356 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85e801c4-8e7a-4abf-a58b-c0b180a2891e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:28.360815 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85e801c4-8e7a-4abf-a58b-c0b180a2891e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:28.396450 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85e801c4-8e7a-4abf-a58b-c0b180a2891e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:28.397147 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85e801c4-8e7a-4abf-a58b-c0b180a2891e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:28.397590 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85e801c4-8e7a-4abf-a58b-c0b180a2891e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:28.398039 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-85e801c4-8e7a-4abf-a58b-c0b180a2891e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lazy-loading 'fault' on Instance uuid f01ef8a6-60ce-4468-a0e9-6a33c3392761 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: DEBUG neutronclient.v2_0.client [None req-562efa68-5110-48e0-962a-06c929f0d5d9 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=127288) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-562efa68-5110-48e0-962a-06c929f0d5d9 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-c78ea364-458b-4373-a88c-078a0155b1a8'] Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-562efa68-5110-48e0-962a-06c929f0d5d9 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Request method failure captured: Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/os-security-groups/0af373b0-43d0-44b7-9e81-3bdfd3d05ced HTTP/1.1 Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGpjMs9YidgsygUOkr6JT50hWG-cekvAaeMcemTbwiSporUEbh1_WyvWPmOYstlW46ZhTbDbvsJDXWblqyggJDBZeJwgQHK5sShQ5NT_QX4iJpZ6m1UVkOEtJOolgtkhDPdyE4i6yvp4ycuErKhGPFmEcS6G98nSlO8AV4CpTJQ9lYQ Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 32e3fff2f377462ab62b9d4d6ce64842 Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1669756519 Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_32e3fff2f377462ab62b9d4d6ce64842", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/32e3fff2f377462ab62b9d4d6ce64842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/32e3fff2f377462ab62b9d4d6ce64842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/32e3fff2f377462ab62b9d4d6ce64842"}]}] Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1669756519 Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 32e3fff2f377462ab62b9d4d6ce64842 Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1669756519 Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupsNegativeTestJSON-1669756519-project Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 0114d1ed2232451eb7ae2e1e3a7c25d6 Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1669756519-project Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: exception: Insufficient rights for removing default security group. Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-c78ea364-458b-4373-a88c-078a0155b1a8'] Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '0af373b0-43d0-44b7-9e81-3bdfd3d05ced'} Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.723003 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c78ea364-458b-4373-a88c-078a0155b1a8'] Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c78ea364-458b-4373-a88c-078a0155b1a8'] Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c78ea364-458b-4373-a88c-078a0155b1a8'] Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c78ea364-458b-4373-a88c-078a0155b1a8'] Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-562efa68-5110-48e0-962a-06c929f0d5d9 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-c78ea364-458b-4373-a88c-078a0155b1a8'] {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-562efa68-5110-48e0-962a-06c929f0d5d9 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/0af373b0-43d0-44b7-9e81-3bdfd3d05ced" status: 400 len: 182 microversion: 2.1 time: 0.167637 Oct 10 18:54:28.728377 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 761/1352] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 18:54:28 2022] DELETE /compute/v2.1/os-security-groups/0af373b0-43d0-44b7-9e81-3bdfd3d05ced => generated 182 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:54:28.738232 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-0ed53655-4679-44f2-9179-0c9045220f8e req-60182309-d7d5-45a0-ae7a-98ac8f9f0589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d79eab-1807-4467-b325-fe5f723ac559", "name": "network-vif-plugged", "status": "completed", "tag": "d4cf66ab-04c3-441b-9f60-e83abdbe71aa"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:28.739132 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-85e801c4-8e7a-4abf-a58b-c0b180a2891e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:28.740258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0ed53655-4679-44f2-9179-0c9045220f8e req-60182309-d7d5-45a0-ae7a-98ac8f9f0589 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:28.740258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0ed53655-4679-44f2-9179-0c9045220f8e req-60182309-d7d5-45a0-ae7a-98ac8f9f0589 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:28.740258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0ed53655-4679-44f2-9179-0c9045220f8e req-60182309-d7d5-45a0-ae7a-98ac8f9f0589 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:28.741218 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-85e801c4-8e7a-4abf-a58b-c0b180a2891e tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 200 len: 1304 microversion: 2.1 time: 0.147169 Oct 10 18:54:28.741218 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 592/1353] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:28 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:28.741641 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-0ed53655-4679-44f2-9179-0c9045220f8e req-60182309-d7d5-45a0-ae7a-98ac8f9f0589 service nova] Creating event network-vif-plugged:d4cf66ab-04c3-441b-9f60-e83abdbe71aa for instance 96d79eab-1807-4467-b325-fe5f723ac559 on n-h1-860863-1 Oct 10 18:54:28.741641 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-0ed53655-4679-44f2-9179-0c9045220f8e req-60182309-d7d5-45a0-ae7a-98ac8f9f0589 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068514 Oct 10 18:54:28.741955 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-aa5b4085-8a01-4ce6-b5c4-db4b0972d34c tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Calling method '.version_select at 0x7f318dcc10d0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:28.742263 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 762/1354] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: DEBUG neutronclient.v2_0.client [None req-aa5b4085-8a01-4ce6-b5c4-db4b0972d34c tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8d1debed-81bf-486c-819a-886fde86eea3 does not exist", "detail": ""}} {{(pid=127289) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.security_group_api [None req-aa5b4085-8a01-4ce6-b5c4-db4b0972d34c tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Neutron security group 8d1debed-81bf-486c-819a-886fde86eea3 not found {{(pid=127289) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-aa5b4085-8a01-4ce6-b5c4-db4b0972d34c tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] HTTP exception thrown: Security group 8d1debed-81bf-486c-819a-886fde86eea3 does not exist Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-776241eb-4419-4256-86ac-c9148742c988'] Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-aa5b4085-8a01-4ce6-b5c4-db4b0972d34c tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Request method failure captured: Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-security-groups/8d1debed-81bf-486c-819a-886fde86eea3 HTTP/1.1 Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGpjMs9YidgsygUOkr6JT50hWG-cekvAaeMcemTbwiSporUEbh1_WyvWPmOYstlW46ZhTbDbvsJDXWblqyggJDBZeJwgQHK5sShQ5NT_QX4iJpZ6m1UVkOEtJOolgtkhDPdyE4i6yvp4ycuErKhGPFmEcS6G98nSlO8AV4CpTJQ9lYQ Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 32e3fff2f377462ab62b9d4d6ce64842 Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1669756519 Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_32e3fff2f377462ab62b9d4d6ce64842", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/32e3fff2f377462ab62b9d4d6ce64842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/32e3fff2f377462ab62b9d4d6ce64842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/32e3fff2f377462ab62b9d4d6ce64842"}]}] Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1669756519 Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 32e3fff2f377462ab62b9d4d6ce64842 Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1669756519 Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-SecurityGroupsNegativeTestJSON-1669756519-project Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 0114d1ed2232451eb7ae2e1e3a7c25d6 Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1669756519-project Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: exception: Security group 8d1debed-81bf-486c-819a-886fde86eea3 does not exist Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-776241eb-4419-4256-86ac-c9148742c988'] Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '8d1debed-81bf-486c-819a-886fde86eea3'} Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.742569 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8d1debed-81bf-486c-819a-886fde86eea3 does not exist Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-776241eb-4419-4256-86ac-c9148742c988'] Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8d1debed-81bf-486c-819a-886fde86eea3 does not exist Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-776241eb-4419-4256-86ac-c9148742c988'] Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8d1debed-81bf-486c-819a-886fde86eea3 does not exist Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-776241eb-4419-4256-86ac-c9148742c988'] Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8d1debed-81bf-486c-819a-886fde86eea3 does not exist Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-776241eb-4419-4256-86ac-c9148742c988'] Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-aa5b4085-8a01-4ce6-b5c4-db4b0972d34c tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Returning 404 to user: Security group 8d1debed-81bf-486c-819a-886fde86eea3 does not exist Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: Neutron server returns request_ids: ['req-776241eb-4419-4256-86ac-c9148742c988'] {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:28.747261 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-aa5b4085-8a01-4ce6-b5c4-db4b0972d34c tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/8d1debed-81bf-486c-819a-886fde86eea3" status: 404 len: 194 microversion: 2.1 time: 0.067130 Oct 10 18:54:28.752295 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 593/1355] 10.222.0.43 () {58 vars in 1269 bytes} [Mon Oct 10 18:54:28 2022] GET /compute/v2.1/os-security-groups/8d1debed-81bf-486c-819a-886fde86eea3 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7260709b-3e29-41f5-9fc7-ffce0e743282 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Action: 'update', calling method: .version_select at 0x7f318d83c0d0>, body: {"security_group": {"name": "tempest-sg-1284691296", "description": "tempest-description-1639615036"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: DEBUG neutronclient.v2_0.client [None req-7260709b-3e29-41f5-9fc7-ffce0e743282 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b2b8776d-5e5d-4b72-8447-94f504c584f6 does not exist", "detail": ""}} {{(pid=127288) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.security_group_api [None req-7260709b-3e29-41f5-9fc7-ffce0e743282 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Neutron security group b2b8776d-5e5d-4b72-8447-94f504c584f6 not found {{(pid=127288) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-7260709b-3e29-41f5-9fc7-ffce0e743282 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] HTTP exception thrown: Security group b2b8776d-5e5d-4b72-8447-94f504c584f6 does not exist Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-e6030735-6171-43a5-bc72-ea511caff2ec'] Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7260709b-3e29-41f5-9fc7-ffce0e743282 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Request method failure captured: Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: request: PUT /compute/v2.1/os-security-groups/b2b8776d-5e5d-4b72-8447-94f504c584f6 HTTP/1.1 Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 102 Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGpjMs9YidgsygUOkr6JT50hWG-cekvAaeMcemTbwiSporUEbh1_WyvWPmOYstlW46ZhTbDbvsJDXWblqyggJDBZeJwgQHK5sShQ5NT_QX4iJpZ6m1UVkOEtJOolgtkhDPdyE4i6yvp4ycuErKhGPFmEcS6G98nSlO8AV4CpTJQ9lYQ Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 32e3fff2f377462ab62b9d4d6ce64842 Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1669756519 Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_32e3fff2f377462ab62b9d4d6ce64842", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/32e3fff2f377462ab62b9d4d6ce64842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/32e3fff2f377462ab62b9d4d6ce64842"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/32e3fff2f377462ab62b9d4d6ce64842"}]}] Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1669756519 Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 32e3fff2f377462ab62b9d4d6ce64842 Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1669756519 Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-SecurityGroupsNegativeTestJSON-1669756519-project Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 0114d1ed2232451eb7ae2e1e3a7c25d6 Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1669756519-project Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: {"security_group": {"name": "tempest-sg-1284691296", "description": "tempest-description-1639615036"}} Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: exception: Security group b2b8776d-5e5d-4b72-8447-94f504c584f6 does not exist Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-e6030735-6171-43a5-bc72-ea511caff2ec'] Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'b2b8776d-5e5d-4b72-8447-94f504c584f6', 'body': {'security_group': {'name': 'tempest-sg-1284691296', 'description': 'tempest-description-1639615036'}}} Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 10 18:54:28.752401 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b2b8776d-5e5d-4b72-8447-94f504c584f6 does not exist Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6030735-6171-43a5-bc72-ea511caff2ec'] Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b2b8776d-5e5d-4b72-8447-94f504c584f6 does not exist Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6030735-6171-43a5-bc72-ea511caff2ec'] Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b2b8776d-5e5d-4b72-8447-94f504c584f6 does not exist Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6030735-6171-43a5-bc72-ea511caff2ec'] Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b2b8776d-5e5d-4b72-8447-94f504c584f6 does not exist Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6030735-6171-43a5-bc72-ea511caff2ec'] Oct 10 18:54:28.756201 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:28.763111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7260709b-3e29-41f5-9fc7-ffce0e743282 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] Returning 404 to user: Security group b2b8776d-5e5d-4b72-8447-94f504c584f6 does not exist Oct 10 18:54:28.763111 n-d-860863-1 devstack@n-api.service[127288]: Neutron server returns request_ids: ['req-e6030735-6171-43a5-bc72-ea511caff2ec'] {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:28.763111 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7260709b-3e29-41f5-9fc7-ffce0e743282 tempest-SecurityGroupsNegativeTestJSON-1669756519 tempest-SecurityGroupsNegativeTestJSON-1669756519-project] 10.222.0.43 "PUT /compute/v2.1/os-security-groups/b2b8776d-5e5d-4b72-8447-94f504c584f6" status: 404 len: 194 microversion: 2.1 time: 0.039572 Oct 10 18:54:28.763111 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 763/1356] 10.222.0.43 () {60 vars in 1290 bytes} [Mon Oct 10 18:54:28 2022] PUT /compute/v2.1/os-security-groups/b2b8776d-5e5d-4b72-8447-94f504c584f6 => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:54:28.779908 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-52670436-2c0d-4983-80c4-63542964f9d3 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:28.781008 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-52670436-2c0d-4983-80c4-63542964f9d3 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:28.789985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-52670436-2c0d-4983-80c4-63542964f9d3 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:28.790896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-52670436-2c0d-4983-80c4-63542964f9d3 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:28.791568 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-52670436-2c0d-4983-80c4-63542964f9d3 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:28.802182 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-52670436-2c0d-4983-80c4-63542964f9d3 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:28.802908 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-52670436-2c0d-4983-80c4-63542964f9d3 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:28.803366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-52670436-2c0d-4983-80c4-63542964f9d3 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:28.927501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-df5ecb84-7465-4440-b7cd-4de57bc17e1e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:28.929567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-df5ecb84-7465-4440-b7cd-4de57bc17e1e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:28.945229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df5ecb84-7465-4440-b7cd-4de57bc17e1e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:28.946150 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df5ecb84-7465-4440-b7cd-4de57bc17e1e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:28.946684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df5ecb84-7465-4440-b7cd-4de57bc17e1e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:28.948303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df5ecb84-7465-4440-b7cd-4de57bc17e1e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:28.949036 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df5ecb84-7465-4440-b7cd-4de57bc17e1e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:28.949563 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-df5ecb84-7465-4440-b7cd-4de57bc17e1e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:29.103275 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-df5ecb84-7465-4440-b7cd-4de57bc17e1e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:29.113208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-df5ecb84-7465-4440-b7cd-4de57bc17e1e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:29.115995 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-df5ecb84-7465-4440-b7cd-4de57bc17e1e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:29.117397 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-df5ecb84-7465-4440-b7cd-4de57bc17e1e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1411 microversion: 2.25 time: 0.194962 Oct 10 18:54:29.119377 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 764/1357] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:28 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1411 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:54:29.141026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c94f1304-ec87-433a-a8ce-09bcfdb16db0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:29.144451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c94f1304-ec87-433a-a8ce-09bcfdb16db0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:29.163929 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c94f1304-ec87-433a-a8ce-09bcfdb16db0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:29.164940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c94f1304-ec87-433a-a8ce-09bcfdb16db0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:29.165582 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c94f1304-ec87-433a-a8ce-09bcfdb16db0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:29.166573 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c94f1304-ec87-433a-a8ce-09bcfdb16db0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:29.167185 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c94f1304-ec87-433a-a8ce-09bcfdb16db0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:29.169941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c94f1304-ec87-433a-a8ce-09bcfdb16db0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:29.255484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-52670436-2c0d-4983-80c4-63542964f9d3 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:29.266633 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-52670436-2c0d-4983-80c4-63542964f9d3 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1575 microversion: 2.1 time: 0.489659 Oct 10 18:54:29.267448 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 594/1358] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:28 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1575 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:29.274206 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-28a45e25-c256-4780-9d97-e68429ef304b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:29.278770 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-28a45e25-c256-4780-9d97-e68429ef304b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:29.292578 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28a45e25-c256-4780-9d97-e68429ef304b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:29.297158 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28a45e25-c256-4780-9d97-e68429ef304b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:29.297883 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28a45e25-c256-4780-9d97-e68429ef304b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:29.298798 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28a45e25-c256-4780-9d97-e68429ef304b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:29.299407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28a45e25-c256-4780-9d97-e68429ef304b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:29.305282 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28a45e25-c256-4780-9d97-e68429ef304b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:29.476430 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c94f1304-ec87-433a-a8ce-09bcfdb16db0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:29.485552 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c94f1304-ec87-433a-a8ce-09bcfdb16db0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1471 microversion: 2.1 time: 0.363380 Oct 10 18:54:29.486247 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 765/1359] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:29 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1471 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:29.510950 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e632f0f4-50d5-4888-a678-39f263b6d8a9 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:29.510950 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e632f0f4-50d5-4888-a678-39f263b6d8a9 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:29.516795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e632f0f4-50d5-4888-a678-39f263b6d8a9 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:29.517523 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e632f0f4-50d5-4888-a678-39f263b6d8a9 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:29.518233 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e632f0f4-50d5-4888-a678-39f263b6d8a9 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:29.519233 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e632f0f4-50d5-4888-a678-39f263b6d8a9 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:29.519846 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e632f0f4-50d5-4888-a678-39f263b6d8a9 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:29.520418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e632f0f4-50d5-4888-a678-39f263b6d8a9 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:29.703888 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e632f0f4-50d5-4888-a678-39f263b6d8a9 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.210852 Oct 10 18:54:29.705362 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 766/1360] 10.222.0.43 () {58 vars in 1275 bytes} [Mon Oct 10 18:54:29 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2/os-interface => generated 285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:29.713616 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cfa47c40-75e5-4365-be7d-a4341ee571df tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:29.715066 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cfa47c40-75e5-4365-be7d-a4341ee571df tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:29.723509 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cfa47c40-75e5-4365-be7d-a4341ee571df tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:29.724216 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cfa47c40-75e5-4365-be7d-a4341ee571df tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:29.725012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cfa47c40-75e5-4365-be7d-a4341ee571df tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:29.725901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cfa47c40-75e5-4365-be7d-a4341ee571df tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:29.726567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cfa47c40-75e5-4365-be7d-a4341ee571df tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:29.727340 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cfa47c40-75e5-4365-be7d-a4341ee571df tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:29.743483 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-28a45e25-c256-4780-9d97-e68429ef304b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:29.761368 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-28a45e25-c256-4780-9d97-e68429ef304b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1321 microversion: 2.1 time: 0.490717 Oct 10 18:54:29.762542 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 595/1361] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:29 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1321 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:29.768159 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4ccda203-b038-4b3b-9bb2-8e654ca30e76 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:29.774551 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4ccda203-b038-4b3b-9bb2-8e654ca30e76 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: f01ef8a6-60ce-4468-a0e9-6a33c3392761] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:29.791316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ccda203-b038-4b3b-9bb2-8e654ca30e76 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:29.791807 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ccda203-b038-4b3b-9bb2-8e654ca30e76 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:29.792241 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ccda203-b038-4b3b-9bb2-8e654ca30e76 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:29.792981 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ccda203-b038-4b3b-9bb2-8e654ca30e76 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:29.793434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ccda203-b038-4b3b-9bb2-8e654ca30e76 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:29.793856 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ccda203-b038-4b3b-9bb2-8e654ca30e76 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:29.821523 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-4ccda203-b038-4b3b-9bb2-8e654ca30e76 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] HTTP exception thrown: Instance f01ef8a6-60ce-4468-a0e9-6a33c3392761 could not be found. Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4ccda203-b038-4b3b-9bb2-8e654ca30e76 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Request method failure captured: Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 HTTP/1.1 Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGnGzjHl9zlyRAeEBzTu296w6ybPgeC7xUdCMCcualbSf_ClTNcQCc02yK29SBpAKoWEwe0HB-GZxZtT31haBJBC8D0grXD2NGFsG3TQEahwD0_fE6RQX0G6O4OoSAuA1326ZdVMojMKz6BqaxFM06aKMBtF4PlmmkaDlludRjxsK5Y Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: b15c92e4a6804ff5ba5d91c342f6c529 Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersAdminTestJSON-416646207 Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b15c92e4a6804ff5ba5d91c342f6c529", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b15c92e4a6804ff5ba5d91c342f6c529"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b15c92e4a6804ff5ba5d91c342f6c529"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b15c92e4a6804ff5ba5d91c342f6c529"}]}] Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersAdminTestJSON-416646207 Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: b15c92e4a6804ff5ba5d91c342f6c529 Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersAdminTestJSON-416646207 Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersAdminTestJSON-416646207-project Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 53de519302254009b38a5324f76a1e92 Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersAdminTestJSON-416646207-project Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance f01ef8a6-60ce-4468-a0e9-6a33c3392761 could not be found. Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'f01ef8a6-60ce-4468-a0e9-6a33c3392761'} Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f01ef8a6-60ce-4468-a0e9-6a33c3392761 could not be found. Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f01ef8a6-60ce-4468-a0e9-6a33c3392761 could not be found. Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:29.823128 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:29.829641 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:29.829641 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:29.829641 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:29.829641 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:29.829641 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:29.829641 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f01ef8a6-60ce-4468-a0e9-6a33c3392761 could not be found. Oct 10 18:54:29.829641 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:29.829641 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4ccda203-b038-4b3b-9bb2-8e654ca30e76 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Returning 404 to user: Instance f01ef8a6-60ce-4468-a0e9-6a33c3392761 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:29.829641 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4ccda203-b038-4b3b-9bb2-8e654ca30e76 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761" status: 404 len: 111 microversion: 2.1 time: 0.060828 Oct 10 18:54:29.829641 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 596/1362] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:29 2022] GET /compute/v2.1/servers/f01ef8a6-60ce-4468-a0e9-6a33c3392761 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:54:29.848474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c70773d6-a973-4b86-be28-6df571f22e5d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:29.850906 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c70773d6-a973-4b86-be28-6df571f22e5d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:29.857137 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c70773d6-a973-4b86-be28-6df571f22e5d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:29.857635 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c70773d6-a973-4b86-be28-6df571f22e5d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:29.858075 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c70773d6-a973-4b86-be28-6df571f22e5d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:29.858854 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c70773d6-a973-4b86-be28-6df571f22e5d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:29.859307 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c70773d6-a973-4b86-be28-6df571f22e5d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:29.859912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c70773d6-a973-4b86-be28-6df571f22e5d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:29.886657 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cfa47c40-75e5-4365-be7d-a4341ee571df tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:29.897418 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c70773d6-a973-4b86-be28-6df571f22e5d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:54:29.914958 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cfa47c40-75e5-4365-be7d-a4341ee571df tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1346 microversion: 2.1 time: 0.208096 Oct 10 18:54:29.928567 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 767/1363] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:29 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1346 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:30.149921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e4315133-9e00-4140-baac-c748119c65f0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:30.152100 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e4315133-9e00-4140-baac-c748119c65f0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:30.159705 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4315133-9e00-4140-baac-c748119c65f0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:30.160716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4315133-9e00-4140-baac-c748119c65f0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:30.162886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4315133-9e00-4140-baac-c748119c65f0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:30.163497 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4315133-9e00-4140-baac-c748119c65f0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:30.164156 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4315133-9e00-4140-baac-c748119c65f0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:30.164843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4315133-9e00-4140-baac-c748119c65f0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:30.348766 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c70773d6-a973-4b86-be28-6df571f22e5d tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 204 len: 0 microversion: 2.1 time: 0.503733 Oct 10 18:54:30.349703 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 597/1364] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:54:29 2022] DELETE /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:54:30.359898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-83b7906a-98b8-43d7-82cb-def72ac6e77b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:30.361534 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-83b7906a-98b8-43d7-82cb-def72ac6e77b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:30.379106 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-83b7906a-98b8-43d7-82cb-def72ac6e77b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:30.380301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-83b7906a-98b8-43d7-82cb-def72ac6e77b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:30.390550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-83b7906a-98b8-43d7-82cb-def72ac6e77b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:30.390550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-83b7906a-98b8-43d7-82cb-def72ac6e77b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:30.393175 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-83b7906a-98b8-43d7-82cb-def72ac6e77b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:30.394240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-83b7906a-98b8-43d7-82cb-def72ac6e77b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:30.813959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e4315133-9e00-4140-baac-c748119c65f0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:30.827240 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e4315133-9e00-4140-baac-c748119c65f0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:30.829379 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e4315133-9e00-4140-baac-c748119c65f0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:30.833825 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e4315133-9e00-4140-baac-c748119c65f0 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1411 microversion: 2.25 time: 0.687860 Oct 10 18:54:30.835522 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 768/1365] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:30 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1411 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:30.841085 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b55eec4e-d687-4e9c-99a8-9090ef28b78d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:30.852090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b55eec4e-d687-4e9c-99a8-9090ef28b78d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:30.867878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b55eec4e-d687-4e9c-99a8-9090ef28b78d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:30.868520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b55eec4e-d687-4e9c-99a8-9090ef28b78d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:30.869088 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b55eec4e-d687-4e9c-99a8-9090ef28b78d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:30.870024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b55eec4e-d687-4e9c-99a8-9090ef28b78d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:30.870662 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b55eec4e-d687-4e9c-99a8-9090ef28b78d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:30.871257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b55eec4e-d687-4e9c-99a8-9090ef28b78d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:31.053962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b55eec4e-d687-4e9c-99a8-9090ef28b78d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:31.065092 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b55eec4e-d687-4e9c-99a8-9090ef28b78d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1302 microversion: 2.1 time: 0.228178 Oct 10 18:54:31.065689 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 769/1366] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:30 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1302 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:31.081043 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-b5f417f0-dbff-417b-b2ae-229b6f8c0fdb req-fd23411b-6da8-4a44-af40-63359269d467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07001745-db54-4bea-a7c8-d894f4638089", "name": "network-vif-deleted", "tag": "5fbe7847-dfa2-4db5-b541-54af8f4629a1"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:31.098707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b5f417f0-dbff-417b-b2ae-229b6f8c0fdb req-fd23411b-6da8-4a44-af40-63359269d467 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:31.099624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b5f417f0-dbff-417b-b2ae-229b6f8c0fdb req-fd23411b-6da8-4a44-af40-63359269d467 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:31.104872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b5f417f0-dbff-417b-b2ae-229b6f8c0fdb req-fd23411b-6da8-4a44-af40-63359269d467 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:31.119714 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-b5f417f0-dbff-417b-b2ae-229b6f8c0fdb req-fd23411b-6da8-4a44-af40-63359269d467 service nova] Creating event network-vif-deleted:5fbe7847-dfa2-4db5-b541-54af8f4629a1 for instance 07001745-db54-4bea-a7c8-d894f4638089 on n-h2-860863-1 Oct 10 18:54:31.126548 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-b5f417f0-dbff-417b-b2ae-229b6f8c0fdb req-fd23411b-6da8-4a44-af40-63359269d467 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059545 Oct 10 18:54:31.128107 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 770/1367] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:31.143367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-caf31fdb-c689-4fb7-b746-fad552f5f216 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:31.144393 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-caf31fdb-c689-4fb7-b746-fad552f5f216 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:31.155102 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-caf31fdb-c689-4fb7-b746-fad552f5f216 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:31.157599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-caf31fdb-c689-4fb7-b746-fad552f5f216 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:31.158338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-caf31fdb-c689-4fb7-b746-fad552f5f216 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:31.159908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-caf31fdb-c689-4fb7-b746-fad552f5f216 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:31.160677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-caf31fdb-c689-4fb7-b746-fad552f5f216 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:31.162080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-caf31fdb-c689-4fb7-b746-fad552f5f216 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:31.255117 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-83b7906a-98b8-43d7-82cb-def72ac6e77b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:31.264009 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-83b7906a-98b8-43d7-82cb-def72ac6e77b tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1470 microversion: 2.1 time: 0.909692 Oct 10 18:54:31.265073 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 598/1368] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:30 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1470 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:31.281707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cf5263df-a719-4210-b2b4-15999adbbe1b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:31.282377 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cf5263df-a719-4210-b2b4-15999adbbe1b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:31.294018 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf5263df-a719-4210-b2b4-15999adbbe1b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:31.294765 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf5263df-a719-4210-b2b4-15999adbbe1b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:31.295371 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf5263df-a719-4210-b2b4-15999adbbe1b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:31.296287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf5263df-a719-4210-b2b4-15999adbbe1b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:31.296970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf5263df-a719-4210-b2b4-15999adbbe1b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:31.297555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf5263df-a719-4210-b2b4-15999adbbe1b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:31.359759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf5263df-a719-4210-b2b4-15999adbbe1b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:31.360559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf5263df-a719-4210-b2b4-15999adbbe1b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:31.361159 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf5263df-a719-4210-b2b4-15999adbbe1b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:31.361771 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-cf5263df-a719-4210-b2b4-15999adbbe1b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lazy-loading 'fault' on Instance uuid 4812966e-0f45-4261-bf1d-99e46ebab1ac {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:54:31.432695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cf5263df-a719-4210-b2b4-15999adbbe1b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:31.448226 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cf5263df-a719-4210-b2b4-15999adbbe1b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 200 len: 1351 microversion: 2.1 time: 0.175164 Oct 10 18:54:31.449109 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 599/1369] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:31 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 1351 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:31.614399 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-caf31fdb-c689-4fb7-b746-fad552f5f216 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:31.626439 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-caf31fdb-c689-4fb7-b746-fad552f5f216 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1321 microversion: 2.1 time: 0.496640 Oct 10 18:54:31.645646 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 771/1370] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:31 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1321 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:31.861533 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-84744322-ab14-4611-bd9a-5ee613569ee5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:31.862736 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-84744322-ab14-4611-bd9a-5ee613569ee5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:31.869721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-84744322-ab14-4611-bd9a-5ee613569ee5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:31.870510 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-84744322-ab14-4611-bd9a-5ee613569ee5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:31.871141 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-84744322-ab14-4611-bd9a-5ee613569ee5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:31.872073 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-84744322-ab14-4611-bd9a-5ee613569ee5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:31.874227 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-84744322-ab14-4611-bd9a-5ee613569ee5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:31.874858 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-84744322-ab14-4611-bd9a-5ee613569ee5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:32.092482 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1696326d-b221-4a9a-a86c-8d4b202f8d42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:32.093231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1696326d-b221-4a9a-a86c-8d4b202f8d42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:32.103578 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1696326d-b221-4a9a-a86c-8d4b202f8d42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:32.104447 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1696326d-b221-4a9a-a86c-8d4b202f8d42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:32.105127 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1696326d-b221-4a9a-a86c-8d4b202f8d42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:32.110648 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1696326d-b221-4a9a-a86c-8d4b202f8d42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:32.111477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1696326d-b221-4a9a-a86c-8d4b202f8d42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:32.112405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1696326d-b221-4a9a-a86c-8d4b202f8d42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:32.153605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1696326d-b221-4a9a-a86c-8d4b202f8d42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:32.153841 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-84744322-ab14-4611-bd9a-5ee613569ee5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:32.154889 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1696326d-b221-4a9a-a86c-8d4b202f8d42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:32.155825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1696326d-b221-4a9a-a86c-8d4b202f8d42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:32.156969 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-1696326d-b221-4a9a-a86c-8d4b202f8d42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lazy-loading 'fault' on Instance uuid 07001745-db54-4bea-a7c8-d894f4638089 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:54:32.163710 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-84744322-ab14-4611-bd9a-5ee613569ee5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:32.168984 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-84744322-ab14-4611-bd9a-5ee613569ee5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:32.170595 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-84744322-ab14-4611-bd9a-5ee613569ee5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1607 microversion: 2.25 time: 0.312825 Oct 10 18:54:32.171232 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 600/1371] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:54:31 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1607 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:54:32.198898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0baf71c8-0688-4537-9eb2-792acea40899 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:32.199953 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0baf71c8-0688-4537-9eb2-792acea40899 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:32.206777 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0baf71c8-0688-4537-9eb2-792acea40899 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:32.207550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0baf71c8-0688-4537-9eb2-792acea40899 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:32.208228 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0baf71c8-0688-4537-9eb2-792acea40899 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:32.209209 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0baf71c8-0688-4537-9eb2-792acea40899 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:32.210200 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0baf71c8-0688-4537-9eb2-792acea40899 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:32.210875 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0baf71c8-0688-4537-9eb2-792acea40899 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:32.291736 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1696326d-b221-4a9a-a86c-8d4b202f8d42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:32.305698 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1696326d-b221-4a9a-a86c-8d4b202f8d42 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 200 len: 1307 microversion: 2.1 time: 0.216904 Oct 10 18:54:32.322181 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 772/1372] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:32 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 1307 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:32.330513 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7281b099-4912-4296-ad33-9c802ae52f86 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:32.330513 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7281b099-4912-4296-ad33-9c802ae52f86 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:32.338686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7281b099-4912-4296-ad33-9c802ae52f86 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:32.339392 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7281b099-4912-4296-ad33-9c802ae52f86 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:32.340046 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7281b099-4912-4296-ad33-9c802ae52f86 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:32.341069 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7281b099-4912-4296-ad33-9c802ae52f86 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:32.341591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7281b099-4912-4296-ad33-9c802ae52f86 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:32.342175 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7281b099-4912-4296-ad33-9c802ae52f86 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:32.372816 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0baf71c8-0688-4537-9eb2-792acea40899 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.178318 Oct 10 18:54:32.373417 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 601/1373] 10.222.0.43 () {60 vars in 1316 bytes} [Mon Oct 10 18:54:32 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-interface => generated 285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 18:54:32.482751 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6f13ec5e-ad9a-41e0-8077-0bef1a168029 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:32.483569 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6f13ec5e-ad9a-41e0-8077-0bef1a168029 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:32.490108 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f13ec5e-ad9a-41e0-8077-0bef1a168029 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:32.496052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f13ec5e-ad9a-41e0-8077-0bef1a168029 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:32.496052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f13ec5e-ad9a-41e0-8077-0bef1a168029 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:32.496052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f13ec5e-ad9a-41e0-8077-0bef1a168029 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:32.496052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f13ec5e-ad9a-41e0-8077-0bef1a168029 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:32.496052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f13ec5e-ad9a-41e0-8077-0bef1a168029 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:32.509427 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-6f13ec5e-ad9a-41e0-8077-0bef1a168029 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6f13ec5e-ad9a-41e0-8077-0bef1a168029 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac HTTP/1.1 Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '4812966e-0f45-4261-bf1d-99e46ebab1ac'} Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:32.511396 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:32.521893 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:32.521893 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:32.521893 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:32.521893 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:32.521893 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:32.521893 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:54:32.521893 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:32.521893 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6f13ec5e-ad9a-41e0-8077-0bef1a168029 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:32.521893 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6f13ec5e-ad9a-41e0-8077-0bef1a168029 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 404 len: 111 microversion: 2.1 time: 0.035933 Oct 10 18:54:32.523775 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 602/1374] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:32 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 18:54:32.658783 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-60a49ecc-b3fd-492f-a1a1-5a874cb4a87e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:32.663227 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-60a49ecc-b3fd-492f-a1a1-5a874cb4a87e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:32.663227 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:32.668371 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-60a49ecc-b3fd-492f-a1a1-5a874cb4a87e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:32.670787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-60a49ecc-b3fd-492f-a1a1-5a874cb4a87e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:32.671437 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-60a49ecc-b3fd-492f-a1a1-5a874cb4a87e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:32.672345 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-60a49ecc-b3fd-492f-a1a1-5a874cb4a87e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:32.672992 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-60a49ecc-b3fd-492f-a1a1-5a874cb4a87e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:32.673612 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-60a49ecc-b3fd-492f-a1a1-5a874cb4a87e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:32.929290 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-60a49ecc-b3fd-492f-a1a1-5a874cb4a87e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:32.938691 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-60a49ecc-b3fd-492f-a1a1-5a874cb4a87e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1321 microversion: 2.1 time: 0.283967 Oct 10 18:54:32.952995 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 603/1375] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:32 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:32.959518 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-80dd3e22-cd61-4fdc-ae28-e5bde3622cee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:32.962101 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-80dd3e22-cd61-4fdc-ae28-e5bde3622cee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:32.969379 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80dd3e22-cd61-4fdc-ae28-e5bde3622cee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:32.977895 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80dd3e22-cd61-4fdc-ae28-e5bde3622cee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:32.977895 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80dd3e22-cd61-4fdc-ae28-e5bde3622cee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:32.977895 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80dd3e22-cd61-4fdc-ae28-e5bde3622cee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:32.977895 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80dd3e22-cd61-4fdc-ae28-e5bde3622cee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:32.977895 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80dd3e22-cd61-4fdc-ae28-e5bde3622cee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:32.987472 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-80dd3e22-cd61-4fdc-ae28-e5bde3622cee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-80dd3e22-cd61-4fdc-ae28-e5bde3622cee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac/os-volume_attachments HTTP/1.1 Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'server_id': '4812966e-0f45-4261-bf1d-99e46ebab1ac'} Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:54:32.989528 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:54:32.994591 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:54:32.994591 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:32.994591 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:32.994591 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:32.994591 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:32.994591 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:32.994591 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:32.994591 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:32.994591 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:32.994591 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:54:32.994591 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:32.996309 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-80dd3e22-cd61-4fdc-ae28-e5bde3622cee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:32.997678 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-80dd3e22-cd61-4fdc-ae28-e5bde3622cee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043670 Oct 10 18:54:32.998425 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 604/1376] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:54:32 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:54:33.006715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7281b099-4912-4296-ad33-9c802ae52f86 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:33.016601 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7281b099-4912-4296-ad33-9c802ae52f86 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1470 microversion: 2.1 time: 0.692768 Oct 10 18:54:33.019087 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 773/1377] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:32 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1470 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:33.213484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-19070422-3494-487d-949d-ef468daf4857 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:33.214313 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-19070422-3494-487d-949d-ef468daf4857 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:33.221953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-5fefb943-cfeb-4ba3-8f40-87c9cdd61b3c req-dcb6e3aa-357a-42d2-ba5c-6e9201eb5e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1cd2e32-34ce-4a91-b679-2093d7808de2", "tag": "4f36482d-b661-45f8-b7dc-97cf9ebb5ad6"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:33.231402 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19070422-3494-487d-949d-ef468daf4857 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:33.231921 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19070422-3494-487d-949d-ef468daf4857 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:33.232374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19070422-3494-487d-949d-ef468daf4857 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:33.233156 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19070422-3494-487d-949d-ef468daf4857 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:33.233598 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19070422-3494-487d-949d-ef468daf4857 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:33.235345 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19070422-3494-487d-949d-ef468daf4857 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:33.236958 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:33.247340 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5fefb943-cfeb-4ba3-8f40-87c9cdd61b3c req-dcb6e3aa-357a-42d2-ba5c-6e9201eb5e46 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:33.248024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5fefb943-cfeb-4ba3-8f40-87c9cdd61b3c req-dcb6e3aa-357a-42d2-ba5c-6e9201eb5e46 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:33.248764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5fefb943-cfeb-4ba3-8f40-87c9cdd61b3c req-dcb6e3aa-357a-42d2-ba5c-6e9201eb5e46 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:33.273333 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-5fefb943-cfeb-4ba3-8f40-87c9cdd61b3c req-dcb6e3aa-357a-42d2-ba5c-6e9201eb5e46 service nova] Creating event network-changed:4f36482d-b661-45f8-b7dc-97cf9ebb5ad6 for instance e1cd2e32-34ce-4a91-b679-2093d7808de2 on n-h1-860863-1 Oct 10 18:54:33.286629 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-5fefb943-cfeb-4ba3-8f40-87c9cdd61b3c req-dcb6e3aa-357a-42d2-ba5c-6e9201eb5e46 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068027 Oct 10 18:54:33.288225 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 774/1378] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:33.297893 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-886855942", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "737898c7-94e7-46dc-b9d9-724fb5cc9d52"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:33.401591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] validate_networks() for [('737898c7-94e7-46dc-b9d9-724fb5cc9d52', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:54:33.966818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-19070422-3494-487d-949d-ef468daf4857 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:33.970027 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:33.982211 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-19070422-3494-487d-949d-ef468daf4857 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1575 microversion: 2.1 time: 0.774741 Oct 10 18:54:33.983027 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 605/1379] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:33 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1575 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:34.001803 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8ffa7bb7-c6d5-4ff1-a511-4c41b07a2deb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:34.002684 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8ffa7bb7-c6d5-4ff1-a511-4c41b07a2deb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 07001745-db54-4bea-a7c8-d894f4638089] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:34.013997 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ffa7bb7-c6d5-4ff1-a511-4c41b07a2deb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:34.020576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ffa7bb7-c6d5-4ff1-a511-4c41b07a2deb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:34.020576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ffa7bb7-c6d5-4ff1-a511-4c41b07a2deb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:34.020576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ffa7bb7-c6d5-4ff1-a511-4c41b07a2deb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:34.020576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ffa7bb7-c6d5-4ff1-a511-4c41b07a2deb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:34.020576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8ffa7bb7-c6d5-4ff1-a511-4c41b07a2deb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:34.037497 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-8ffa7bb7-c6d5-4ff1-a511-4c41b07a2deb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] HTTP exception thrown: Instance 07001745-db54-4bea-a7c8-d894f4638089 could not be found. Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8ffa7bb7-c6d5-4ff1-a511-4c41b07a2deb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Request method failure captured: Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 HTTP/1.1 Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGm4gi-GigrCCGP4gZ0L6T7bfFulRKFfLM2g8v9pYuIlN-6kcPDxo1dVOtF12HlrUDwYL2ilR3T2CEZskDG5X4WyXTvGaYXSGu6yuVLVcexzys5KE6QRZju-8W5aaKEyioTybqHJ7jCOt5qQoZ1_926e1tP4yBBHEbyJngUytXsHWSU Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: f536cb88016b414298031238fb251097 Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f536cb88016b414298031238fb251097", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f536cb88016b414298031238fb251097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}] Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: f536cb88016b414298031238fb251097 Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: c62f3c2582904aa2894aa339e7bb882d Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 07001745-db54-4bea-a7c8-d894f4638089 could not be found. Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '07001745-db54-4bea-a7c8-d894f4638089'} Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07001745-db54-4bea-a7c8-d894f4638089 could not be found. Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07001745-db54-4bea-a7c8-d894f4638089 could not be found. Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:34.039503 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:34.047560 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:34.047560 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:34.047560 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:34.047560 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:34.047560 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:34.047560 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07001745-db54-4bea-a7c8-d894f4638089 could not be found. Oct 10 18:54:34.047560 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:34.047560 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8ffa7bb7-c6d5-4ff1-a511-4c41b07a2deb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Returning 404 to user: Instance 07001745-db54-4bea-a7c8-d894f4638089 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:34.047560 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8ffa7bb7-c6d5-4ff1-a511-4c41b07a2deb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089" status: 404 len: 111 microversion: 2.1 time: 0.061728 Oct 10 18:54:34.051963 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 606/1380] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:33 2022] GET /compute/v2.1/servers/07001745-db54-4bea-a7c8-d894f4638089 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:54:34.085722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d4e70a0f-fcd8-40b2-814f-d23e75a54f06 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:34.086389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d4e70a0f-fcd8-40b2-814f-d23e75a54f06 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:34.106111 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d4e70a0f-fcd8-40b2-814f-d23e75a54f06 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:34.106610 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d4e70a0f-fcd8-40b2-814f-d23e75a54f06 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:34.107053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d4e70a0f-fcd8-40b2-814f-d23e75a54f06 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:34.110005 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d4e70a0f-fcd8-40b2-814f-d23e75a54f06 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:34.110499 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d4e70a0f-fcd8-40b2-814f-d23e75a54f06 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:34.114079 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d4e70a0f-fcd8-40b2-814f-d23e75a54f06 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:34.285686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:54:34.286677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:54:34.287307 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:54:34.290408 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:54:34.290408 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:54:34.303824 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:34.307871 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:34.308671 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:34.309707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:34.311773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:34.312490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:34.344795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Getting quotas for project c5d5fb01be0c409d98c222551a2c0e2e. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:54:34.354362 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Getting quotas for user afedfd9cc5b241ad97e27f6e911244a1 and project c5d5fb01be0c409d98c222551a2c0e2e. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:54:34.371072 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:54:34.374907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: a2fa0400-c9b5-49df-af7c-2ffcb7a502e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:54:34.608311 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d4e70a0f-fcd8-40b2-814f-d23e75a54f06 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:34.621931 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d4e70a0f-fcd8-40b2-814f-d23e75a54f06 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1321 microversion: 2.1 time: 0.567146 Oct 10 18:54:34.622728 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 607/1381] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:34 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:34.637856 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d5fffd21-6048-4aff-9300-0ae268bdb219 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:34.638773 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d5fffd21-6048-4aff-9300-0ae268bdb219 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:34.649686 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5fffd21-6048-4aff-9300-0ae268bdb219 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:34.650605 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5fffd21-6048-4aff-9300-0ae268bdb219 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:34.651404 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5fffd21-6048-4aff-9300-0ae268bdb219 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:34.653501 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5fffd21-6048-4aff-9300-0ae268bdb219 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:34.654934 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5fffd21-6048-4aff-9300-0ae268bdb219 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:34.656937 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5fffd21-6048-4aff-9300-0ae268bdb219 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:34.704852 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9a506438-6d3e-4cf8-a133-9c703ac06732 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.413229 Oct 10 18:54:34.705677 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 775/1382] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:54:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:54:34.735595 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-928d1c59-a6c5-449f-bcfb-dc887f4ec339 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:34.736268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-928d1c59-a6c5-449f-bcfb-dc887f4ec339 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:34.764986 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-928d1c59-a6c5-449f-bcfb-dc887f4ec339 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:34.765582 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-928d1c59-a6c5-449f-bcfb-dc887f4ec339 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:34.768191 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-928d1c59-a6c5-449f-bcfb-dc887f4ec339 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:34.769660 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-928d1c59-a6c5-449f-bcfb-dc887f4ec339 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:34.770788 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-928d1c59-a6c5-449f-bcfb-dc887f4ec339 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:34.771339 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-928d1c59-a6c5-449f-bcfb-dc887f4ec339 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:34.792047 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5fffd21-6048-4aff-9300-0ae268bdb219 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:34.792565 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5fffd21-6048-4aff-9300-0ae268bdb219 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:34.793052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5fffd21-6048-4aff-9300-0ae268bdb219 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:34.793438 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-d5fffd21-6048-4aff-9300-0ae268bdb219 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lazy-loading 'fault' on Instance uuid d3624eba-30d5-486c-8753-86e4277189ff {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:54:34.838841 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-928d1c59-a6c5-449f-bcfb-dc887f4ec339 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:54:34.987528 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d5fffd21-6048-4aff-9300-0ae268bdb219 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:35.002490 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d5fffd21-6048-4aff-9300-0ae268bdb219 tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1304 microversion: 2.1 time: 0.373138 Oct 10 18:54:35.002490 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 608/1383] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:34 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1304 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:35.010474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6a3cffc3-6956-4a25-b2e4-0cadfe514f66 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:35.013594 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6a3cffc3-6956-4a25-b2e4-0cadfe514f66 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: a2fa0400-c9b5-49df-af7c-2ffcb7a502e7] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:35.127288 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6a3cffc3-6956-4a25-b2e4-0cadfe514f66 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:35.148685 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6a3cffc3-6956-4a25-b2e4-0cadfe514f66 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/a2fa0400-c9b5-49df-af7c-2ffcb7a502e7" status: 200 len: 1214 microversion: 2.1 time: 0.140047 Oct 10 18:54:35.149317 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 609/1384] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:35 2022] GET /compute/v2.1/servers/a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:35.164707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-d7acb896-2005-4e8c-ac9e-cffbafc3a496 req-8e917e66-e129-4903-8cf3-a337ff4f90c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5365436c-bee1-4eba-8561-14ce05700e6e", "name": "network-vif-plugged", "status": "completed", "tag": "86796ad0-424f-455d-9477-87ec669e0c56"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:35.184298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d7acb896-2005-4e8c-ac9e-cffbafc3a496 req-8e917e66-e129-4903-8cf3-a337ff4f90c7 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:35.185131 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d7acb896-2005-4e8c-ac9e-cffbafc3a496 req-8e917e66-e129-4903-8cf3-a337ff4f90c7 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:35.185874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d7acb896-2005-4e8c-ac9e-cffbafc3a496 req-8e917e66-e129-4903-8cf3-a337ff4f90c7 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:35.202983 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-d7acb896-2005-4e8c-ac9e-cffbafc3a496 req-8e917e66-e129-4903-8cf3-a337ff4f90c7 service nova] Creating event network-vif-plugged:86796ad0-424f-455d-9477-87ec669e0c56 for instance 5365436c-bee1-4eba-8561-14ce05700e6e on n-h2-860863-1 Oct 10 18:54:35.208179 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-d7acb896-2005-4e8c-ac9e-cffbafc3a496 req-8e917e66-e129-4903-8cf3-a337ff4f90c7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052321 Oct 10 18:54:35.209381 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 610/1385] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:35.229623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3ace9580-655d-4c9a-bf01-23dc34482ad2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:35.230579 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3ace9580-655d-4c9a-bf01-23dc34482ad2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: a2fa0400-c9b5-49df-af7c-2ffcb7a502e7] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:35.278904 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-928d1c59-a6c5-449f-bcfb-dc887f4ec339 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "DELETE /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 204 len: 0 microversion: 2.1 time: 0.559829 Oct 10 18:54:35.281195 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 776/1386] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:54:34 2022] DELETE /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:54:35.288428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4f910b51-ed8a-47a5-a47b-59dc71ab1d45 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:35.297454 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4f910b51-ed8a-47a5-a47b-59dc71ab1d45 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:35.312883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4f910b51-ed8a-47a5-a47b-59dc71ab1d45 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:35.313397 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4f910b51-ed8a-47a5-a47b-59dc71ab1d45 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:35.313840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4f910b51-ed8a-47a5-a47b-59dc71ab1d45 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:35.314564 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4f910b51-ed8a-47a5-a47b-59dc71ab1d45 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:35.315751 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3ace9580-655d-4c9a-bf01-23dc34482ad2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: a2fa0400-c9b5-49df-af7c-2ffcb7a502e7] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:54:35.322781 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4f910b51-ed8a-47a5-a47b-59dc71ab1d45 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:35.323178 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4f910b51-ed8a-47a5-a47b-59dc71ab1d45 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:35.657508 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3ace9580-655d-4c9a-bf01-23dc34482ad2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a2fa0400-c9b5-49df-af7c-2ffcb7a502e7" status: 204 len: 0 microversion: 2.1 time: 0.446556 Oct 10 18:54:35.658386 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 611/1387] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:54:35 2022] DELETE /compute/v2.1/servers/a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:54:35.665152 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-d719f9a4-55b1-4d8e-9dd0-3c41ca0b7681 req-ae22876f-b41a-4bdc-970d-30115089f364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3624eba-30d5-486c-8753-86e4277189ff", "name": "network-vif-deleted", "tag": "877788c4-8817-4a16-9c01-e7dd796eebdd"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:35.676250 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d719f9a4-55b1-4d8e-9dd0-3c41ca0b7681 req-ae22876f-b41a-4bdc-970d-30115089f364 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:35.677027 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d719f9a4-55b1-4d8e-9dd0-3c41ca0b7681 req-ae22876f-b41a-4bdc-970d-30115089f364 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:35.677699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d719f9a4-55b1-4d8e-9dd0-3c41ca0b7681 req-ae22876f-b41a-4bdc-970d-30115089f364 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:35.691765 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-d719f9a4-55b1-4d8e-9dd0-3c41ca0b7681 req-ae22876f-b41a-4bdc-970d-30115089f364 service nova] Creating event network-vif-deleted:877788c4-8817-4a16-9c01-e7dd796eebdd for instance d3624eba-30d5-486c-8753-86e4277189ff on n-h1-860863-1 Oct 10 18:54:35.698264 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-d719f9a4-55b1-4d8e-9dd0-3c41ca0b7681 req-ae22876f-b41a-4bdc-970d-30115089f364 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038630 Oct 10 18:54:35.699159 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 612/1388] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:35.706065 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-6cc63396-40ff-4732-a1db-23e2ec549c88 req-088731a1-4289-465a-b94f-a363080e87cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d79eab-1807-4467-b325-fe5f723ac559", "tag": "d4cf66ab-04c3-441b-9f60-e83abdbe71aa"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:35.716805 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6cc63396-40ff-4732-a1db-23e2ec549c88 req-088731a1-4289-465a-b94f-a363080e87cd service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:35.717614 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6cc63396-40ff-4732-a1db-23e2ec549c88 req-088731a1-4289-465a-b94f-a363080e87cd service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:35.718106 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6cc63396-40ff-4732-a1db-23e2ec549c88 req-088731a1-4289-465a-b94f-a363080e87cd service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:35.730819 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-6cc63396-40ff-4732-a1db-23e2ec549c88 req-088731a1-4289-465a-b94f-a363080e87cd service nova] Creating event network-changed:d4cf66ab-04c3-441b-9f60-e83abdbe71aa for instance 96d79eab-1807-4467-b325-fe5f723ac559 on n-h1-860863-1 Oct 10 18:54:35.736953 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-6cc63396-40ff-4732-a1db-23e2ec549c88 req-088731a1-4289-465a-b94f-a363080e87cd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036244 Oct 10 18:54:35.737874 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 613/1389] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:35.738313 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4f910b51-ed8a-47a5-a47b-59dc71ab1d45 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:35.747186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a094d10d-1d1c-4236-88f3-979491e78a05 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:35.748138 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a094d10d-1d1c-4236-88f3-979491e78a05 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:35.755773 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a094d10d-1d1c-4236-88f3-979491e78a05 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:35.756441 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a094d10d-1d1c-4236-88f3-979491e78a05 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:35.757795 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a094d10d-1d1c-4236-88f3-979491e78a05 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:35.757935 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a094d10d-1d1c-4236-88f3-979491e78a05 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:35.758417 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a094d10d-1d1c-4236-88f3-979491e78a05 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:35.758927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a094d10d-1d1c-4236-88f3-979491e78a05 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:35.767197 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4f910b51-ed8a-47a5-a47b-59dc71ab1d45 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1473 microversion: 2.1 time: 0.482945 Oct 10 18:54:35.781361 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 777/1390] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:35 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1473 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:35.786222 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a9e113a7-7d5f-47b2-b0a2-b735aec1d0d1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:35.786822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a9e113a7-7d5f-47b2-b0a2-b735aec1d0d1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: a2fa0400-c9b5-49df-af7c-2ffcb7a502e7] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:35.798434 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-a9e113a7-7d5f-47b2-b0a2-b735aec1d0d1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a9e113a7-7d5f-47b2-b0a2-b735aec1d0d1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 HTTP/1.1 Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'a2fa0400-c9b5-49df-af7c-2ffcb7a502e7'} Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:35.800279 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:35.805417 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:35.805417 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:35.805417 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:35.805417 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:54:35.805417 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:35.805417 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a9e113a7-7d5f-47b2-b0a2-b735aec1d0d1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:35.807182 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a9e113a7-7d5f-47b2-b0a2-b735aec1d0d1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/a2fa0400-c9b5-49df-af7c-2ffcb7a502e7" status: 404 len: 111 microversion: 2.1 time: 0.024034 Oct 10 18:54:35.808137 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 778/1391] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:35 2022] GET /compute/v2.1/servers/a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:54:35.869779 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1424355080", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "737898c7-94e7-46dc-b9d9-724fb5cc9d52"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:35.932111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] validate_networks() for [('737898c7-94e7-46dc-b9d9-724fb5cc9d52', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:54:35.942206 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a094d10d-1d1c-4236-88f3-979491e78a05 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:35.951360 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a094d10d-1d1c-4236-88f3-979491e78a05 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1321 microversion: 2.1 time: 0.211321 Oct 10 18:54:35.951947 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 614/1392] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:35 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:36.027371 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d1abb6ca-ba96-4f70-b52e-e6ddf24b39de tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:36.029049 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d1abb6ca-ba96-4f70-b52e-e6ddf24b39de tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:36.040243 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-ba96-4f70-b52e-e6ddf24b39de tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:36.048052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-ba96-4f70-b52e-e6ddf24b39de tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:36.049301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-ba96-4f70-b52e-e6ddf24b39de tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:36.050777 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-ba96-4f70-b52e-e6ddf24b39de tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:36.051655 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-ba96-4f70-b52e-e6ddf24b39de tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:36.052279 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-ba96-4f70-b52e-e6ddf24b39de tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:36.110329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-ba96-4f70-b52e-e6ddf24b39de tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:36.110947 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-ba96-4f70-b52e-e6ddf24b39de tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:36.111575 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1abb6ca-ba96-4f70-b52e-e6ddf24b39de tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:36.112196 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-d1abb6ca-ba96-4f70-b52e-e6ddf24b39de tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lazy-loading 'fault' on Instance uuid d3624eba-30d5-486c-8753-86e4277189ff {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:54:36.174359 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d1abb6ca-ba96-4f70-b52e-e6ddf24b39de tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53de519302254009b38a5324f76a1e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15c92e4a6804ff5ba5d91c342f6c529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:36.190066 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d1abb6ca-ba96-4f70-b52e-e6ddf24b39de tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 200 len: 1304 microversion: 2.1 time: 0.167527 Oct 10 18:54:36.191954 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 615/1393] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:36 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 1304 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:36.363451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:54:36.363451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:54:36.364007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:54:36.364403 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:54:36.365391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:54:36.375393 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:36.375864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:36.376286 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:36.377054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:36.377495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:36.377909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:36.405202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Getting quotas for project c5d5fb01be0c409d98c222551a2c0e2e. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:54:36.425972 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Getting quotas for user afedfd9cc5b241ad97e27f6e911244a1 and project c5d5fb01be0c409d98c222551a2c0e2e. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:54:36.441150 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:54:36.443542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:54:36.611528 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f7a2dfca-b6db-462d-9fb6-f5bdb726aa9a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746465 Oct 10 18:54:36.613437 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 779/1394] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:54:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:54:36.631218 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4d62772f-b038-4a4b-8189-2e55ba02ddef tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:36.632608 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4d62772f-b038-4a4b-8189-2e55ba02ddef tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:36.707244 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4d62772f-b038-4a4b-8189-2e55ba02ddef tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:36.716154 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4d62772f-b038-4a4b-8189-2e55ba02ddef tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1215 microversion: 2.1 time: 0.090884 Oct 10 18:54:36.717384 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 616/1395] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:36 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:36.802986 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-90a2025c-3fb8-4cc6-88c0-ecfba90039a6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:36.803637 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-90a2025c-3fb8-4cc6-88c0-ecfba90039a6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:36.827001 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-90a2025c-3fb8-4cc6-88c0-ecfba90039a6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:36.841451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-90a2025c-3fb8-4cc6-88c0-ecfba90039a6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:36.843236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-90a2025c-3fb8-4cc6-88c0-ecfba90039a6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:36.848115 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-90a2025c-3fb8-4cc6-88c0-ecfba90039a6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:36.848751 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-90a2025c-3fb8-4cc6-88c0-ecfba90039a6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:36.850944 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-90a2025c-3fb8-4cc6-88c0-ecfba90039a6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:36.974950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c0e8b712-1ef0-4a62-8c67-e9a3fd2b720d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:36.975580 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c0e8b712-1ef0-4a62-8c67-e9a3fd2b720d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:36.985555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c0e8b712-1ef0-4a62-8c67-e9a3fd2b720d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:36.987807 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c0e8b712-1ef0-4a62-8c67-e9a3fd2b720d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:36.994603 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c0e8b712-1ef0-4a62-8c67-e9a3fd2b720d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:36.997792 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c0e8b712-1ef0-4a62-8c67-e9a3fd2b720d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:36.997792 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c0e8b712-1ef0-4a62-8c67-e9a3fd2b720d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:36.997792 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c0e8b712-1ef0-4a62-8c67-e9a3fd2b720d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:37.264871 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c0e8b712-1ef0-4a62-8c67-e9a3fd2b720d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:37.273140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-90a2025c-3fb8-4cc6-88c0-ecfba90039a6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:37.289431 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c0e8b712-1ef0-4a62-8c67-e9a3fd2b720d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1321 microversion: 2.1 time: 0.318836 Oct 10 18:54:37.293581 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 617/1396] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:36 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:37.304726 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-90a2025c-3fb8-4cc6-88c0-ecfba90039a6 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1473 microversion: 2.1 time: 0.501202 Oct 10 18:54:37.304726 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 780/1397] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:36 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1473 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:37.304726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8a3fa92e-2a37-4719-8737-d8fbafb0107c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:37.304726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8a3fa92e-2a37-4719-8737-d8fbafb0107c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] [instance: d3624eba-30d5-486c-8753-86e4277189ff] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:37.324428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8a3fa92e-2a37-4719-8737-d8fbafb0107c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:37.325673 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8a3fa92e-2a37-4719-8737-d8fbafb0107c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:37.329027 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8a3fa92e-2a37-4719-8737-d8fbafb0107c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:37.329831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8a3fa92e-2a37-4719-8737-d8fbafb0107c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:37.331630 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8a3fa92e-2a37-4719-8737-d8fbafb0107c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:37.332133 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8a3fa92e-2a37-4719-8737-d8fbafb0107c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:37.541484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:37.553537 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-8a3fa92e-2a37-4719-8737-d8fbafb0107c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] HTTP exception thrown: Instance d3624eba-30d5-486c-8753-86e4277189ff could not be found. Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8a3fa92e-2a37-4719-8737-d8fbafb0107c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Request method failure captured: Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff HTTP/1.1 Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGnGzjHl9zlyRAeEBzTu296w6ybPgeC7xUdCMCcualbSf_ClTNcQCc02yK29SBpAKoWEwe0HB-GZxZtT31haBJBC8D0grXD2NGFsG3TQEahwD0_fE6RQX0G6O4OoSAuA1326ZdVMojMKz6BqaxFM06aKMBtF4PlmmkaDlludRjxsK5Y Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b15c92e4a6804ff5ba5d91c342f6c529 Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersAdminTestJSON-416646207 Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b15c92e4a6804ff5ba5d91c342f6c529", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b15c92e4a6804ff5ba5d91c342f6c529"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b15c92e4a6804ff5ba5d91c342f6c529"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b15c92e4a6804ff5ba5d91c342f6c529"}]}] Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersAdminTestJSON-416646207 Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b15c92e4a6804ff5ba5d91c342f6c529 Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersAdminTestJSON-416646207 Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersAdminTestJSON-416646207-project Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 53de519302254009b38a5324f76a1e92 Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersAdminTestJSON-416646207-project Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance d3624eba-30d5-486c-8753-86e4277189ff could not be found. Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'd3624eba-30d5-486c-8753-86e4277189ff'} Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3624eba-30d5-486c-8753-86e4277189ff could not be found. Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3624eba-30d5-486c-8753-86e4277189ff could not be found. Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:37.555091 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:37.560794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:37.560794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:37.560794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:37.560794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:37.560794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:37.560794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3624eba-30d5-486c-8753-86e4277189ff could not be found. Oct 10 18:54:37.560794 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:37.560794 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8a3fa92e-2a37-4719-8737-d8fbafb0107c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] Returning 404 to user: Instance d3624eba-30d5-486c-8753-86e4277189ff could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:37.560794 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8a3fa92e-2a37-4719-8737-d8fbafb0107c tempest-ServersAdminTestJSON-416646207 tempest-ServersAdminTestJSON-416646207-project] 10.222.0.43 "GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff" status: 404 len: 111 microversion: 2.1 time: 0.259089 Oct 10 18:54:37.560794 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 781/1398] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:37 2022] GET /compute/v2.1/servers/d3624eba-30d5-486c-8753-86e4277189ff => generated 111 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:54:37.739517 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-014dc2e4-e8d3-4b2b-bc95-abe71789e746 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:37.740630 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-014dc2e4-e8d3-4b2b-bc95-abe71789e746 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:37.748406 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-014dc2e4-e8d3-4b2b-bc95-abe71789e746 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:37.749080 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-014dc2e4-e8d3-4b2b-bc95-abe71789e746 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:37.749608 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-014dc2e4-e8d3-4b2b-bc95-abe71789e746 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:37.750577 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-014dc2e4-e8d3-4b2b-bc95-abe71789e746 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:37.751130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-014dc2e4-e8d3-4b2b-bc95-abe71789e746 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:37.751657 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-014dc2e4-e8d3-4b2b-bc95-abe71789e746 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:37.820067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-014dc2e4-e8d3-4b2b-bc95-abe71789e746 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:37.828281 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-014dc2e4-e8d3-4b2b-bc95-abe71789e746 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1219 microversion: 2.1 time: 0.092758 Oct 10 18:54:37.828892 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 618/1399] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:37 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:38.174940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-f992db00-0213-4982-b9e8-41cb23982f41 req-aaa59360-f71f-400a-891f-7035a7e96f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92880065-c226-4118-9326-529eff171df0", "name": "network-vif-deleted", "tag": "887bde6f-cc1f-4045-9db8-fd17432c6ed5"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:38.193239 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f992db00-0213-4982-b9e8-41cb23982f41 req-aaa59360-f71f-400a-891f-7035a7e96f9d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:38.194957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f992db00-0213-4982-b9e8-41cb23982f41 req-aaa59360-f71f-400a-891f-7035a7e96f9d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:38.195569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f992db00-0213-4982-b9e8-41cb23982f41 req-aaa59360-f71f-400a-891f-7035a7e96f9d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:38.208463 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-f992db00-0213-4982-b9e8-41cb23982f41 req-aaa59360-f71f-400a-891f-7035a7e96f9d service nova] Creating event network-vif-deleted:887bde6f-cc1f-4045-9db8-fd17432c6ed5 for instance 92880065-c226-4118-9326-529eff171df0 on n-h1-860863-1 Oct 10 18:54:38.215239 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-f992db00-0213-4982-b9e8-41cb23982f41 req-aaa59360-f71f-400a-891f-7035a7e96f9d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044911 Oct 10 18:54:38.225039 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 782/1400] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:38.324081 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-46dc9548-1821-4bdf-b8ac-120357fb8e31 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:38.325098 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1abdb69f-00bf-49b9-8185-dd8c987829b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:38.325796 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-46dc9548-1821-4bdf-b8ac-120357fb8e31 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:38.326258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1abdb69f-00bf-49b9-8185-dd8c987829b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:38.345676 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1abdb69f-00bf-49b9-8185-dd8c987829b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:38.346573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46dc9548-1821-4bdf-b8ac-120357fb8e31 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:38.348426 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46dc9548-1821-4bdf-b8ac-120357fb8e31 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:38.350189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46dc9548-1821-4bdf-b8ac-120357fb8e31 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:38.351031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1abdb69f-00bf-49b9-8185-dd8c987829b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:38.352006 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46dc9548-1821-4bdf-b8ac-120357fb8e31 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:38.352918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1abdb69f-00bf-49b9-8185-dd8c987829b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:38.355648 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46dc9548-1821-4bdf-b8ac-120357fb8e31 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:38.356717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1abdb69f-00bf-49b9-8185-dd8c987829b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:38.357359 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46dc9548-1821-4bdf-b8ac-120357fb8e31 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:38.359778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1abdb69f-00bf-49b9-8185-dd8c987829b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:38.362550 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1abdb69f-00bf-49b9-8185-dd8c987829b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:38.540149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1abdb69f-00bf-49b9-8185-dd8c987829b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:38.551369 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1abdb69f-00bf-49b9-8185-dd8c987829b8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1302 microversion: 2.1 time: 0.232775 Oct 10 18:54:38.552053 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 783/1401] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:38 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1302 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:38.616054 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-46dc9548-1821-4bdf-b8ac-120357fb8e31 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:38.633025 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-46dc9548-1821-4bdf-b8ac-120357fb8e31 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1471 microversion: 2.1 time: 0.319865 Oct 10 18:54:38.634061 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 619/1402] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:38 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1471 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:38.851545 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b9bee6bf-ea2d-4975-b499-0d908187e2fd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:38.852407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b9bee6bf-ea2d-4975-b499-0d908187e2fd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:38.859974 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9bee6bf-ea2d-4975-b499-0d908187e2fd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:38.863119 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9bee6bf-ea2d-4975-b499-0d908187e2fd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:38.863119 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9bee6bf-ea2d-4975-b499-0d908187e2fd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:38.863119 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9bee6bf-ea2d-4975-b499-0d908187e2fd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:38.863119 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9bee6bf-ea2d-4975-b499-0d908187e2fd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:38.863119 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9bee6bf-ea2d-4975-b499-0d908187e2fd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:38.947311 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b9bee6bf-ea2d-4975-b499-0d908187e2fd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:38.958990 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6b2e4831-87a9-41c3-8ad3-55ccf30be9b7 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:38.959355 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b9bee6bf-ea2d-4975-b499-0d908187e2fd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1267 microversion: 2.1 time: 0.111917 Oct 10 18:54:38.960041 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6b2e4831-87a9-41c3-8ad3-55ccf30be9b7 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] [instance: 09b69888-7f6c-43d5-ad29-85abb97e320d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:38.960157 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 620/1403] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:38 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1267 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:38.965824 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-6b2e4831-87a9-41c3-8ad3-55ccf30be9b7 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] HTTP exception thrown: Instance 09b69888-7f6c-43d5-ad29-85abb97e320d could not be found. Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6b2e4831-87a9-41c3-8ad3-55ccf30be9b7 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Request method failure captured: Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/servers/09b69888-7f6c-43d5-ad29-85abb97e320d/action HTTP/1.1 Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 15 Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGpT7HDhycSKBwNBA-cXZA3PMefCEMxr_6df4-mlNbFJof9URbLGF6qLLVqVQ2N4MWF0urARbVROjiMJcyFSQrJSGVM05NAL8-jxz7BffL4ZKbEj8GBm3_WTdItg2PntkS2E9ULzgs3nMTcor8t5GBjJId6qlCrZIVDGG3LQJkDQSQY Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 3368577bc381452fba1e63525293dd8f Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3368577bc381452fba1e63525293dd8f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3368577bc381452fba1e63525293dd8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3368577bc381452fba1e63525293dd8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3368577bc381452fba1e63525293dd8f"}]}] Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 3368577bc381452fba1e63525293dd8f Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersAdminNegativeTestJSON-1330594175-project-admin Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: d048273dae0840238da50cca18cb36c4 Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1330594175-project-admin Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: {"migrate": {}} Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 09b69888-7f6c-43d5-ad29-85abb97e320d could not be found. Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '09b69888-7f6c-43d5-ad29-85abb97e320d', 'body': {'migrate': {}}} Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b69888-7f6c-43d5-ad29-85abb97e320d could not be found. Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b69888-7f6c-43d5-ad29-85abb97e320d could not be found. Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:38.967603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:38.972330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:38.972330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:38.972330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:38.972330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:38.972330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b69888-7f6c-43d5-ad29-85abb97e320d could not be found. Oct 10 18:54:38.972330 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:38.973711 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6b2e4831-87a9-41c3-8ad3-55ccf30be9b7 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Returning 404 to user: Instance 09b69888-7f6c-43d5-ad29-85abb97e320d could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:38.974687 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6b2e4831-87a9-41c3-8ad3-55ccf30be9b7 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/09b69888-7f6c-43d5-ad29-85abb97e320d/action" status: 404 len: 111 microversion: 2.1 time: 0.320888 Oct 10 18:54:38.975241 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 784/1404] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:54:38 2022] POST /compute/v2.1/servers/09b69888-7f6c-43d5-ad29-85abb97e320d/action => generated 111 bytes in 322 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 18:54:39.104044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1279363574", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:39.160762 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] validate_networks() for None {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:54:39.385783 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:54:39.386427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:54:39.386722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:54:39.387318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:54:39.387740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:54:39.397432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:39.397923 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:39.398355 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:39.405506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:39.405506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:39.405506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:39.417740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Getting quotas for project af3bdebcbf8c4bfe845090db416be09d. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:54:39.422432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Getting quotas for user 98d0928b54084f00a6c1cbf52ebc0a2a and project af3bdebcbf8c4bfe845090db416be09d. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:54:39.438273 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:54:39.441146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:54:39.575764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-21412585-2949-4bb3-9a47-620512836be0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:39.577285 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-21412585-2949-4bb3-9a47-620512836be0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:39.585136 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-21412585-2949-4bb3-9a47-620512836be0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:39.585908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-21412585-2949-4bb3-9a47-620512836be0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:39.586765 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-21412585-2949-4bb3-9a47-620512836be0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:39.587921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-21412585-2949-4bb3-9a47-620512836be0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:39.588467 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-21412585-2949-4bb3-9a47-620512836be0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:39.589015 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-21412585-2949-4bb3-9a47-620512836be0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:39.621128 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-96154f0b-7e2f-469a-aa17-58d5944ecbc6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519633 Oct 10 18:54:39.622091 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 621/1405] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:54:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:54:39.656144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3936829e-ee86-4715-9615-eb340fbadf98 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:39.665296 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3936829e-ee86-4715-9615-eb340fbadf98 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:39.679522 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-21412585-2949-4bb3-9a47-620512836be0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:39.680406 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-21412585-2949-4bb3-9a47-620512836be0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:39.681095 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-21412585-2949-4bb3-9a47-620512836be0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:39.682305 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-21412585-2949-4bb3-9a47-620512836be0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lazy-loading 'fault' on Instance uuid 92880065-c226-4118-9326-529eff171df0 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:54:39.738437 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-21412585-2949-4bb3-9a47-620512836be0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:39.747701 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3936829e-ee86-4715-9615-eb340fbadf98 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:39.748807 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-21412585-2949-4bb3-9a47-620512836be0 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 200 len: 1307 microversion: 2.1 time: 0.177631 Oct 10 18:54:39.750008 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 785/1406] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:39 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 1307 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:39.772260 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3936829e-ee86-4715-9615-eb340fbadf98 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1222 microversion: 2.1 time: 0.140989 Oct 10 18:54:39.772880 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 622/1407] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:39 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:39.984815 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-713d90c6-33d2-4b5f-a189-c5b4cea792b4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:39.985901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-713d90c6-33d2-4b5f-a189-c5b4cea792b4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:39.999781 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-713d90c6-33d2-4b5f-a189-c5b4cea792b4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:40.001148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-713d90c6-33d2-4b5f-a189-c5b4cea792b4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:40.003723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-713d90c6-33d2-4b5f-a189-c5b4cea792b4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:40.006092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-713d90c6-33d2-4b5f-a189-c5b4cea792b4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:40.006586 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-713d90c6-33d2-4b5f-a189-c5b4cea792b4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:40.009215 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-713d90c6-33d2-4b5f-a189-c5b4cea792b4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:40.125304 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-713d90c6-33d2-4b5f-a189-c5b4cea792b4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:40.138654 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-713d90c6-33d2-4b5f-a189-c5b4cea792b4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1273 microversion: 2.1 time: 0.157800 Oct 10 18:54:40.141085 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 786/1408] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:39 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:40.775931 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0d4bc25e-6e2e-44d8-a007-6ec0d2b5a644 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:40.776573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0d4bc25e-6e2e-44d8-a007-6ec0d2b5a644 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 92880065-c226-4118-9326-529eff171df0] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:40.789264 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d4bc25e-6e2e-44d8-a007-6ec0d2b5a644 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:40.789790 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d4bc25e-6e2e-44d8-a007-6ec0d2b5a644 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:40.792968 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d4bc25e-6e2e-44d8-a007-6ec0d2b5a644 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:40.793305 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d4bc25e-6e2e-44d8-a007-6ec0d2b5a644 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:40.793739 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d4bc25e-6e2e-44d8-a007-6ec0d2b5a644 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:40.796572 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d4bc25e-6e2e-44d8-a007-6ec0d2b5a644 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:40.804911 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-388d9805-e7d2-4564-93b8-700c1fd0085b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:40.807658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-388d9805-e7d2-4564-93b8-700c1fd0085b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:40.830319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-388d9805-e7d2-4564-93b8-700c1fd0085b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:40.830823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-388d9805-e7d2-4564-93b8-700c1fd0085b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:40.831260 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-388d9805-e7d2-4564-93b8-700c1fd0085b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:40.835178 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-388d9805-e7d2-4564-93b8-700c1fd0085b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:40.835348 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-0d4bc25e-6e2e-44d8-a007-6ec0d2b5a644 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] HTTP exception thrown: Instance 92880065-c226-4118-9326-529eff171df0 could not be found. Oct 10 18:54:40.835721 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-388d9805-e7d2-4564-93b8-700c1fd0085b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:40.836205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-388d9805-e7d2-4564-93b8-700c1fd0085b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0d4bc25e-6e2e-44d8-a007-6ec0d2b5a644 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Request method failure captured: Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 HTTP/1.1 Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGm4gi-GigrCCGP4gZ0L6T7bfFulRKFfLM2g8v9pYuIlN-6kcPDxo1dVOtF12HlrUDwYL2ilR3T2CEZskDG5X4WyXTvGaYXSGu6yuVLVcexzys5KE6QRZju-8W5aaKEyioTybqHJ7jCOt5qQoZ1_926e1tP4yBBHEbyJngUytXsHWSU Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: f536cb88016b414298031238fb251097 Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f536cb88016b414298031238fb251097", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f536cb88016b414298031238fb251097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}] Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: f536cb88016b414298031238fb251097 Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: c62f3c2582904aa2894aa339e7bb882d Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 92880065-c226-4118-9326-529eff171df0 could not be found. Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '92880065-c226-4118-9326-529eff171df0'} Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92880065-c226-4118-9326-529eff171df0 could not be found. Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92880065-c226-4118-9326-529eff171df0 could not be found. Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:40.837300 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:40.842462 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:40.842462 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:40.842462 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:40.842462 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:40.842462 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:40.842462 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92880065-c226-4118-9326-529eff171df0 could not be found. Oct 10 18:54:40.842462 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:40.842462 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0d4bc25e-6e2e-44d8-a007-6ec0d2b5a644 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Returning 404 to user: Instance 92880065-c226-4118-9326-529eff171df0 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:40.842462 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0d4bc25e-6e2e-44d8-a007-6ec0d2b5a644 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0" status: 404 len: 111 microversion: 2.1 time: 0.067760 Oct 10 18:54:40.842462 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 623/1409] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:40 2022] GET /compute/v2.1/servers/92880065-c226-4118-9326-529eff171df0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:54:40.847651 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1b38f20b-b148-48d7-8cec-03c49588b1cb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:40.848432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1b38f20b-b148-48d7-8cec-03c49588b1cb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:40.862344 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b38f20b-b148-48d7-8cec-03c49588b1cb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:40.863249 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b38f20b-b148-48d7-8cec-03c49588b1cb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:40.870473 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b38f20b-b148-48d7-8cec-03c49588b1cb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:40.871525 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b38f20b-b148-48d7-8cec-03c49588b1cb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:40.877663 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b38f20b-b148-48d7-8cec-03c49588b1cb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:40.877663 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b38f20b-b148-48d7-8cec-03c49588b1cb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:40.926711 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1b38f20b-b148-48d7-8cec-03c49588b1cb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:54:41.017713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-388d9805-e7d2-4564-93b8-700c1fd0085b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:41.029970 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-388d9805-e7d2-4564-93b8-700c1fd0085b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1226 microversion: 2.1 time: 0.235096 Oct 10 18:54:41.032088 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 787/1410] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:40 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1226 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:41.164452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5a2d692c-88d0-48ce-b18b-f8930511cfea tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:41.165367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5a2d692c-88d0-48ce-b18b-f8930511cfea tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:41.191185 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a2d692c-88d0-48ce-b18b-f8930511cfea tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:41.193046 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a2d692c-88d0-48ce-b18b-f8930511cfea tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:41.194217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a2d692c-88d0-48ce-b18b-f8930511cfea tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:41.195626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a2d692c-88d0-48ce-b18b-f8930511cfea tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:41.196319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a2d692c-88d0-48ce-b18b-f8930511cfea tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:41.197650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a2d692c-88d0-48ce-b18b-f8930511cfea tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:41.263835 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1b38f20b-b148-48d7-8cec-03c49588b1cb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 204 len: 0 microversion: 2.1 time: 0.419483 Oct 10 18:54:41.265143 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 624/1411] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:54:40 2022] DELETE /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:54:41.274205 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bbc0befe-af95-4c77-86c3-462414e448af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:41.274918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bbc0befe-af95-4c77-86c3-462414e448af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:41.286787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbc0befe-af95-4c77-86c3-462414e448af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:41.287289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbc0befe-af95-4c77-86c3-462414e448af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:41.287737 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbc0befe-af95-4c77-86c3-462414e448af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:41.292789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbc0befe-af95-4c77-86c3-462414e448af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:41.293324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbc0befe-af95-4c77-86c3-462414e448af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:41.293769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbc0befe-af95-4c77-86c3-462414e448af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:41.490490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5a2d692c-88d0-48ce-b18b-f8930511cfea tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:41.501861 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5a2d692c-88d0-48ce-b18b-f8930511cfea tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1315 microversion: 2.1 time: 0.342872 Oct 10 18:54:41.502621 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 788/1412] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:41 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:41.555720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bbc0befe-af95-4c77-86c3-462414e448af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:41.563491 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bbc0befe-af95-4c77-86c3-462414e448af tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1472 microversion: 2.1 time: 0.293998 Oct 10 18:54:41.564247 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 625/1413] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:41 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1472 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:41.782079 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-0e077613-41bf-4e30-925a-051da87a722d req-704677aa-7026-485b-8567-aabc7ce0c749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51effa0d-d131-46be-ae0a-859e231dd233", "tag": "5bee11d9-0e26-43bf-ae03-9a4ec1c9e853"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:41.798313 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0e077613-41bf-4e30-925a-051da87a722d req-704677aa-7026-485b-8567-aabc7ce0c749 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:41.805914 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0e077613-41bf-4e30-925a-051da87a722d req-704677aa-7026-485b-8567-aabc7ce0c749 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:41.805914 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0e077613-41bf-4e30-925a-051da87a722d req-704677aa-7026-485b-8567-aabc7ce0c749 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:41.816274 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-0e077613-41bf-4e30-925a-051da87a722d req-704677aa-7026-485b-8567-aabc7ce0c749 service nova] Creating event network-changed:5bee11d9-0e26-43bf-ae03-9a4ec1c9e853 for instance 51effa0d-d131-46be-ae0a-859e231dd233 on n-h2-860863-1 Oct 10 18:54:41.821103 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-0e077613-41bf-4e30-925a-051da87a722d req-704677aa-7026-485b-8567-aabc7ce0c749 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045022 Oct 10 18:54:41.821711 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 789/1414] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:42.054478 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a7d873db-e581-49e9-8fc6-a8f1c16b9bf7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:42.055346 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a7d873db-e581-49e9-8fc6-a8f1c16b9bf7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:42.067085 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7d873db-e581-49e9-8fc6-a8f1c16b9bf7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:42.067678 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7d873db-e581-49e9-8fc6-a8f1c16b9bf7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:42.068190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7d873db-e581-49e9-8fc6-a8f1c16b9bf7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:42.068989 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7d873db-e581-49e9-8fc6-a8f1c16b9bf7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:42.069512 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7d873db-e581-49e9-8fc6-a8f1c16b9bf7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:42.070008 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7d873db-e581-49e9-8fc6-a8f1c16b9bf7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:42.138130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a7d873db-e581-49e9-8fc6-a8f1c16b9bf7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:42.146325 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a7d873db-e581-49e9-8fc6-a8f1c16b9bf7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1218 microversion: 2.1 time: 0.095995 Oct 10 18:54:42.160966 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 626/1415] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:42 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:42.531949 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3d7881e3-c8d5-40fd-8661-a1e0d164e2cf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:42.533421 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3d7881e3-c8d5-40fd-8661-a1e0d164e2cf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:42.549266 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d7881e3-c8d5-40fd-8661-a1e0d164e2cf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:42.551605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d7881e3-c8d5-40fd-8661-a1e0d164e2cf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:42.553020 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d7881e3-c8d5-40fd-8661-a1e0d164e2cf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:42.555928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d7881e3-c8d5-40fd-8661-a1e0d164e2cf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:42.565220 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d7881e3-c8d5-40fd-8661-a1e0d164e2cf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:42.565699 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d7881e3-c8d5-40fd-8661-a1e0d164e2cf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:42.589700 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2e1a07fa-3d63-44fb-a6e2-050f4ac5f7e1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:42.592746 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2e1a07fa-3d63-44fb-a6e2-050f4ac5f7e1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:42.603912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e1a07fa-3d63-44fb-a6e2-050f4ac5f7e1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:42.604410 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e1a07fa-3d63-44fb-a6e2-050f4ac5f7e1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:42.607574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e1a07fa-3d63-44fb-a6e2-050f4ac5f7e1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:42.608325 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e1a07fa-3d63-44fb-a6e2-050f4ac5f7e1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:42.608799 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e1a07fa-3d63-44fb-a6e2-050f4ac5f7e1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:42.611709 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e1a07fa-3d63-44fb-a6e2-050f4ac5f7e1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:42.763218 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2e1a07fa-3d63-44fb-a6e2-050f4ac5f7e1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:42.773149 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2e1a07fa-3d63-44fb-a6e2-050f4ac5f7e1 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1472 microversion: 2.1 time: 0.189605 Oct 10 18:54:42.773737 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 627/1416] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:42 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:43.131943 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3d7881e3-c8d5-40fd-8661-a1e0d164e2cf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:43.140246 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3d7881e3-c8d5-40fd-8661-a1e0d164e2cf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1315 microversion: 2.1 time: 0.618426 Oct 10 18:54:43.140847 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 790/1417] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:42 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1315 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:43.170129 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-769488bb-3958-41e0-aa96-6d0e2a9fbd2b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:43.171321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-769488bb-3958-41e0-aa96-6d0e2a9fbd2b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:43.178820 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-769488bb-3958-41e0-aa96-6d0e2a9fbd2b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:43.179302 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-769488bb-3958-41e0-aa96-6d0e2a9fbd2b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:43.179733 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-769488bb-3958-41e0-aa96-6d0e2a9fbd2b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:43.180437 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-769488bb-3958-41e0-aa96-6d0e2a9fbd2b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:43.180912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-769488bb-3958-41e0-aa96-6d0e2a9fbd2b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:43.184690 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-769488bb-3958-41e0-aa96-6d0e2a9fbd2b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:43.186318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:43.245602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-769488bb-3958-41e0-aa96-6d0e2a9fbd2b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:43.253789 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-769488bb-3958-41e0-aa96-6d0e2a9fbd2b tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1274 microversion: 2.1 time: 0.087550 Oct 10 18:54:43.260921 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 628/1418] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:43 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:43.797351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-62a5b953-b0bc-40ca-a8b8-680fee49b6eb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:43.798235 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-62a5b953-b0bc-40ca-a8b8-680fee49b6eb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:43.805915 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-62a5b953-b0bc-40ca-a8b8-680fee49b6eb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:43.807346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-62a5b953-b0bc-40ca-a8b8-680fee49b6eb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:43.808032 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-62a5b953-b0bc-40ca-a8b8-680fee49b6eb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:43.808953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-62a5b953-b0bc-40ca-a8b8-680fee49b6eb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:43.809566 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-62a5b953-b0bc-40ca-a8b8-680fee49b6eb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:43.810172 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-62a5b953-b0bc-40ca-a8b8-680fee49b6eb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:44.170840 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f5cad2e8-ced3-43db-9cb3-77a57c0113bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:44.172724 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f5cad2e8-ced3-43db-9cb3-77a57c0113bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:44.181566 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5cad2e8-ced3-43db-9cb3-77a57c0113bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:44.182417 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5cad2e8-ced3-43db-9cb3-77a57c0113bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:44.183546 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5cad2e8-ced3-43db-9cb3-77a57c0113bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:44.184933 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5cad2e8-ced3-43db-9cb3-77a57c0113bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:44.185988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5cad2e8-ced3-43db-9cb3-77a57c0113bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:44.186721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5cad2e8-ced3-43db-9cb3-77a57c0113bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:44.229284 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-62a5b953-b0bc-40ca-a8b8-680fee49b6eb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:44.242589 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-62a5b953-b0bc-40ca-a8b8-680fee49b6eb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1472 microversion: 2.1 time: 0.447801 Oct 10 18:54:44.243335 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 791/1419] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:43 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1472 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:44.277956 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-14eb89c5-0c79-4d6a-8e26-ada4366600f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:44.279987 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-14eb89c5-0c79-4d6a-8e26-ada4366600f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:44.293014 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-14eb89c5-0c79-4d6a-8e26-ada4366600f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:44.293769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-14eb89c5-0c79-4d6a-8e26-ada4366600f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:44.295392 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-14eb89c5-0c79-4d6a-8e26-ada4366600f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:44.297117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-14eb89c5-0c79-4d6a-8e26-ada4366600f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:44.297886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-14eb89c5-0c79-4d6a-8e26-ada4366600f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:44.298501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-14eb89c5-0c79-4d6a-8e26-ada4366600f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:44.406316 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-14eb89c5-0c79-4d6a-8e26-ada4366600f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:44.416566 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-14eb89c5-0c79-4d6a-8e26-ada4366600f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1280 microversion: 2.1 time: 0.142944 Oct 10 18:54:44.434311 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 792/1420] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:44 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1280 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:44.464856 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f5cad2e8-ced3-43db-9cb3-77a57c0113bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:44.473986 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f5cad2e8-ced3-43db-9cb3-77a57c0113bf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1315 microversion: 2.1 time: 0.314350 Oct 10 18:54:44.474913 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 629/1421] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:44 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:44.601823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-a6416352-188a-4f7a-8808-4ff2c2a799ea req-52643eae-75a0-4359-a0c7-c0e064d2927d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5", "name": "network-vif-deleted", "tag": "c849a4db-bdc3-4389-af5c-2c1c543bc002"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:44.624086 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-a6416352-188a-4f7a-8808-4ff2c2a799ea req-52643eae-75a0-4359-a0c7-c0e064d2927d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:44.627033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-a6416352-188a-4f7a-8808-4ff2c2a799ea req-52643eae-75a0-4359-a0c7-c0e064d2927d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:44.627911 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-a6416352-188a-4f7a-8808-4ff2c2a799ea req-52643eae-75a0-4359-a0c7-c0e064d2927d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:44.646285 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-a6416352-188a-4f7a-8808-4ff2c2a799ea req-52643eae-75a0-4359-a0c7-c0e064d2927d service nova] Creating event network-vif-deleted:c849a4db-bdc3-4389-af5c-2c1c543bc002 for instance 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 on n-h1-860863-1 Oct 10 18:54:44.676247 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-a6416352-188a-4f7a-8808-4ff2c2a799ea req-52643eae-75a0-4359-a0c7-c0e064d2927d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078243 Oct 10 18:54:44.677324 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 793/1422] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:45.270517 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1519584f-4571-405b-a8e1-62edff93cea2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:45.272927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1519584f-4571-405b-a8e1-62edff93cea2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:45.299870 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1519584f-4571-405b-a8e1-62edff93cea2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:45.305787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1519584f-4571-405b-a8e1-62edff93cea2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:45.307835 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1519584f-4571-405b-a8e1-62edff93cea2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:45.308881 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1519584f-4571-405b-a8e1-62edff93cea2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:45.309575 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1519584f-4571-405b-a8e1-62edff93cea2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:45.310387 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1519584f-4571-405b-a8e1-62edff93cea2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:45.364020 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1519584f-4571-405b-a8e1-62edff93cea2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:45.364598 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1519584f-4571-405b-a8e1-62edff93cea2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:45.365374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1519584f-4571-405b-a8e1-62edff93cea2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:45.366124 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-1519584f-4571-405b-a8e1-62edff93cea2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lazy-loading 'fault' on Instance uuid 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:54:45.441677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-17c88e99-0290-4c15-b019-aec5a26b1c22 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:45.442439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-17c88e99-0290-4c15-b019-aec5a26b1c22 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:45.456685 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17c88e99-0290-4c15-b019-aec5a26b1c22 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:45.457117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17c88e99-0290-4c15-b019-aec5a26b1c22 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:45.457756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17c88e99-0290-4c15-b019-aec5a26b1c22 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:45.458486 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17c88e99-0290-4c15-b019-aec5a26b1c22 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:45.458942 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17c88e99-0290-4c15-b019-aec5a26b1c22 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:45.459369 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17c88e99-0290-4c15-b019-aec5a26b1c22 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:45.461654 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1519584f-4571-405b-a8e1-62edff93cea2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:45.470611 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1519584f-4571-405b-a8e1-62edff93cea2 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 200 len: 1306 microversion: 2.1 time: 0.206007 Oct 10 18:54:45.474844 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 630/1423] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:45 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 1306 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:45.496505 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-26e40309-461e-4938-b422-b42dc9dfd7d0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:45.497686 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-26e40309-461e-4938-b422-b42dc9dfd7d0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:45.504250 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:45.506140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26e40309-461e-4938-b422-b42dc9dfd7d0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:45.506849 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26e40309-461e-4938-b422-b42dc9dfd7d0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:45.507630 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26e40309-461e-4938-b422-b42dc9dfd7d0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:45.508759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26e40309-461e-4938-b422-b42dc9dfd7d0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:45.509438 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26e40309-461e-4938-b422-b42dc9dfd7d0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:45.510655 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26e40309-461e-4938-b422-b42dc9dfd7d0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:45.835132 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-26e40309-461e-4938-b422-b42dc9dfd7d0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:45.837142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-17c88e99-0290-4c15-b019-aec5a26b1c22 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:45.846483 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-17c88e99-0290-4c15-b019-aec5a26b1c22 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1322 microversion: 2.1 time: 0.409702 Oct 10 18:54:45.849762 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-26e40309-461e-4938-b422-b42dc9dfd7d0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1315 microversion: 2.1 time: 0.353447 Oct 10 18:54:45.855663 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 631/1424] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:45 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:45.861763 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 794/1425] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:45 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:46.501579 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-063e4ae7-8b0e-4289-ac03-a002cedf855d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:46.502110 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-063e4ae7-8b0e-4289-ac03-a002cedf855d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:46.509251 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-063e4ae7-8b0e-4289-ac03-a002cedf855d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:46.510503 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-063e4ae7-8b0e-4289-ac03-a002cedf855d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:46.510936 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-063e4ae7-8b0e-4289-ac03-a002cedf855d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:46.511845 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-063e4ae7-8b0e-4289-ac03-a002cedf855d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:46.512294 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-063e4ae7-8b0e-4289-ac03-a002cedf855d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:46.512741 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-063e4ae7-8b0e-4289-ac03-a002cedf855d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:46.534941 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-063e4ae7-8b0e-4289-ac03-a002cedf855d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] HTTP exception thrown: Instance 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 could not be found. Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-063e4ae7-8b0e-4289-ac03-a002cedf855d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Request method failure captured: Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 HTTP/1.1 Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGm4gi-GigrCCGP4gZ0L6T7bfFulRKFfLM2g8v9pYuIlN-6kcPDxo1dVOtF12HlrUDwYL2ilR3T2CEZskDG5X4WyXTvGaYXSGu6yuVLVcexzys5KE6QRZju-8W5aaKEyioTybqHJ7jCOt5qQoZ1_926e1tP4yBBHEbyJngUytXsHWSU Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: f536cb88016b414298031238fb251097 Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f536cb88016b414298031238fb251097", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f536cb88016b414298031238fb251097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}] Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: f536cb88016b414298031238fb251097 Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: c62f3c2582904aa2894aa339e7bb882d Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 could not be found. Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5'} Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 could not be found. Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 could not be found. Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:46.536629 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:46.542386 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:46.542386 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:46.542386 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:46.542386 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:46.542386 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:46.542386 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 could not be found. Oct 10 18:54:46.542386 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:46.542386 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-063e4ae7-8b0e-4289-ac03-a002cedf855d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Returning 404 to user: Instance 9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:46.542386 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-063e4ae7-8b0e-4289-ac03-a002cedf855d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5" status: 404 len: 111 microversion: 2.1 time: 0.041605 Oct 10 18:54:46.561198 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 632/1426] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:46 2022] GET /compute/v2.1/servers/9e84f4ef-0fa8-4d43-9195-f7800bf9b8d5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:54:46.569587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7476b753-f9e9-4846-802d-56cd753104ad tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:46.570158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7476b753-f9e9-4846-802d-56cd753104ad tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: d908aa91-59b6-4c75-b6d2-30e97e050a55] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:46.572126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:46.580406 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=12 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:46.580406 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7476b753-f9e9-4846-802d-56cd753104ad tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:46.580406 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7476b753-f9e9-4846-802d-56cd753104ad tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:46.580406 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7476b753-f9e9-4846-802d-56cd753104ad tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:46.580406 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7476b753-f9e9-4846-802d-56cd753104ad tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:46.580406 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7476b753-f9e9-4846-802d-56cd753104ad tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:46.581417 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7476b753-f9e9-4846-802d-56cd753104ad tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:46.625100 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7476b753-f9e9-4846-802d-56cd753104ad tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: d908aa91-59b6-4c75-b6d2-30e97e050a55] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:54:46.836257 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-0dac5132-6dd0-4a31-8088-8a00a5525386 req-186e9fa6-a7f6-4264-9a55-822f0de99018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb00752-884b-40f1-b2e5-f6f490f5cf93", "tag": "5c98fa39-bb29-4e98-b97a-bee8a9c41998"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:46.863225 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-0dac5132-6dd0-4a31-8088-8a00a5525386 req-186e9fa6-a7f6-4264-9a55-822f0de99018 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:46.863713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-0dac5132-6dd0-4a31-8088-8a00a5525386 req-186e9fa6-a7f6-4264-9a55-822f0de99018 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:46.867522 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-0dac5132-6dd0-4a31-8088-8a00a5525386 req-186e9fa6-a7f6-4264-9a55-822f0de99018 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:46.891263 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-0dac5132-6dd0-4a31-8088-8a00a5525386 req-186e9fa6-a7f6-4264-9a55-822f0de99018 service nova] Creating event network-changed:5c98fa39-bb29-4e98-b97a-bee8a9c41998 for instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 on n-h1-860863-1 Oct 10 18:54:46.903426 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-0dac5132-6dd0-4a31-8088-8a00a5525386 req-186e9fa6-a7f6-4264-9a55-822f0de99018 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297559 Oct 10 18:54:46.904528 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 633/1427] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:46.912407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-21e51671-264d-4a44-a232-d36fca80d450 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:46.913317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-21e51671-264d-4a44-a232-d36fca80d450 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:46.922032 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-21e51671-264d-4a44-a232-d36fca80d450 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:46.922815 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-21e51671-264d-4a44-a232-d36fca80d450 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:46.923414 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-21e51671-264d-4a44-a232-d36fca80d450 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:46.924297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-21e51671-264d-4a44-a232-d36fca80d450 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:46.924933 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-21e51671-264d-4a44-a232-d36fca80d450 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:46.925503 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-21e51671-264d-4a44-a232-d36fca80d450 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:46.942622 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7476b753-f9e9-4846-802d-56cd753104ad tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55" status: 204 len: 0 microversion: 2.1 time: 0.376724 Oct 10 18:54:46.947030 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 795/1428] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:54:46 2022] DELETE /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:54:46.952914 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-84956480-bd35-4126-ad0c-3f91481be60d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:46.954230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-84956480-bd35-4126-ad0c-3f91481be60d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:46.969231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84956480-bd35-4126-ad0c-3f91481be60d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:46.974739 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84956480-bd35-4126-ad0c-3f91481be60d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:46.975433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84956480-bd35-4126-ad0c-3f91481be60d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:46.976354 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84956480-bd35-4126-ad0c-3f91481be60d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:46.976998 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84956480-bd35-4126-ad0c-3f91481be60d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:46.977863 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84956480-bd35-4126-ad0c-3f91481be60d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:47.318346 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-21e51671-264d-4a44-a232-d36fca80d450 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:47.330188 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-21e51671-264d-4a44-a232-d36fca80d450 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1315 microversion: 2.1 time: 0.424237 Oct 10 18:54:47.341866 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 634/1429] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:46 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:47.348186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4f38b2b7-0af8-43ec-9cb3-7efbb373bc1c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:47.348186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4f38b2b7-0af8-43ec-9cb3-7efbb373bc1c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:47.352378 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f38b2b7-0af8-43ec-9cb3-7efbb373bc1c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:47.352904 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f38b2b7-0af8-43ec-9cb3-7efbb373bc1c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:47.353372 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f38b2b7-0af8-43ec-9cb3-7efbb373bc1c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:47.354085 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f38b2b7-0af8-43ec-9cb3-7efbb373bc1c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:47.354541 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f38b2b7-0af8-43ec-9cb3-7efbb373bc1c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:47.354958 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f38b2b7-0af8-43ec-9cb3-7efbb373bc1c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:47.383095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4f38b2b7-0af8-43ec-9cb3-7efbb373bc1c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:54:47.664734 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4f38b2b7-0af8-43ec-9cb3-7efbb373bc1c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 204 len: 0 microversion: 2.1 time: 0.322450 Oct 10 18:54:47.672593 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 635/1430] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:54:47 2022] DELETE /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:54:47.679566 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c10d6b95-f5d0-4435-abf4-1f473159ec94 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:47.680915 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c10d6b95-f5d0-4435-abf4-1f473159ec94 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: d908aa91-59b6-4c75-b6d2-30e97e050a55] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:47.692502 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-84956480-bd35-4126-ad0c-3f91481be60d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:47.696382 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c10d6b95-f5d0-4435-abf4-1f473159ec94 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:47.698027 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c10d6b95-f5d0-4435-abf4-1f473159ec94 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:47.698568 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c10d6b95-f5d0-4435-abf4-1f473159ec94 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:47.700322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c10d6b95-f5d0-4435-abf4-1f473159ec94 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:47.701065 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c10d6b95-f5d0-4435-abf4-1f473159ec94 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:47.701719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c10d6b95-f5d0-4435-abf4-1f473159ec94 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:47.705449 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-84956480-bd35-4126-ad0c-3f91481be60d tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1322 microversion: 2.1 time: 0.756129 Oct 10 18:54:47.706547 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 796/1431] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:46 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1322 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:47.892609 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c10d6b95-f5d0-4435-abf4-1f473159ec94 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:47.903820 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c10d6b95-f5d0-4435-abf4-1f473159ec94 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55" status: 200 len: 1474 microversion: 2.1 time: 0.229129 Oct 10 18:54:47.916562 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 636/1432] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:47 2022] GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55 => generated 1474 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:48.356524 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b71c1e8c-c379-48f2-9c8a-650387e8e665 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:48.357525 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b71c1e8c-c379-48f2-9c8a-650387e8e665 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:48.365173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b71c1e8c-c379-48f2-9c8a-650387e8e665 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:48.377836 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b71c1e8c-c379-48f2-9c8a-650387e8e665 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:48.379575 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b71c1e8c-c379-48f2-9c8a-650387e8e665 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:48.392287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b71c1e8c-c379-48f2-9c8a-650387e8e665 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:48.397681 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b71c1e8c-c379-48f2-9c8a-650387e8e665 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:48.401179 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b71c1e8c-c379-48f2-9c8a-650387e8e665 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:48.735259 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-07cc6570-aae7-4255-a7dd-0ecb9f5751a6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:48.737965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-07cc6570-aae7-4255-a7dd-0ecb9f5751a6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:48.746391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07cc6570-aae7-4255-a7dd-0ecb9f5751a6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:48.747549 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07cc6570-aae7-4255-a7dd-0ecb9f5751a6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:48.748391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07cc6570-aae7-4255-a7dd-0ecb9f5751a6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:48.750249 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07cc6570-aae7-4255-a7dd-0ecb9f5751a6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:48.751356 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07cc6570-aae7-4255-a7dd-0ecb9f5751a6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:48.754560 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-07cc6570-aae7-4255-a7dd-0ecb9f5751a6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:48.963344 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b71c1e8c-c379-48f2-9c8a-650387e8e665 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:48.971445 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b71c1e8c-c379-48f2-9c8a-650387e8e665 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1315 microversion: 2.1 time: 0.619585 Oct 10 18:54:48.973987 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 797/1433] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:48 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:48.979297 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1a29ac66-8118-43d3-a6e9-07e668c8879a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:48.981410 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1a29ac66-8118-43d3-a6e9-07e668c8879a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: d908aa91-59b6-4c75-b6d2-30e97e050a55] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:48.987575 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a29ac66-8118-43d3-a6e9-07e668c8879a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:48.988071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a29ac66-8118-43d3-a6e9-07e668c8879a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:48.988510 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a29ac66-8118-43d3-a6e9-07e668c8879a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:48.989251 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a29ac66-8118-43d3-a6e9-07e668c8879a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:48.989709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a29ac66-8118-43d3-a6e9-07e668c8879a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:48.990170 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a29ac66-8118-43d3-a6e9-07e668c8879a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:49.015120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-07cc6570-aae7-4255-a7dd-0ecb9f5751a6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:49.031576 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-07cc6570-aae7-4255-a7dd-0ecb9f5751a6 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1322 microversion: 2.1 time: 0.306954 Oct 10 18:54:49.032439 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 637/1434] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:48 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:49.607036 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1a29ac66-8118-43d3-a6e9-07e668c8879a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:49.643570 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1a29ac66-8118-43d3-a6e9-07e668c8879a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55" status: 200 len: 1474 microversion: 2.1 time: 0.664645 Oct 10 18:54:49.646381 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 798/1435] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:48 2022] GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55 => generated 1474 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:49.997871 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-49b04b3e-ec9e-45f9-a31c-32ec52b47d27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:49.998519 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-49b04b3e-ec9e-45f9-a31c-32ec52b47d27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:50.001260 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:50.002632 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=14 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:50.018356 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-49b04b3e-ec9e-45f9-a31c-32ec52b47d27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:50.018857 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-49b04b3e-ec9e-45f9-a31c-32ec52b47d27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:50.019290 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-49b04b3e-ec9e-45f9-a31c-32ec52b47d27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:50.020012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-49b04b3e-ec9e-45f9-a31c-32ec52b47d27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:50.020465 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-49b04b3e-ec9e-45f9-a31c-32ec52b47d27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:50.020925 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-49b04b3e-ec9e-45f9-a31c-32ec52b47d27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:50.063689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e7b1a757-76c9-4d00-a2c5-3c5408aca1b7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:50.065295 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e7b1a757-76c9-4d00-a2c5-3c5408aca1b7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:50.080195 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e7b1a757-76c9-4d00-a2c5-3c5408aca1b7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:50.081503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e7b1a757-76c9-4d00-a2c5-3c5408aca1b7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:50.083921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e7b1a757-76c9-4d00-a2c5-3c5408aca1b7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:50.085831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e7b1a757-76c9-4d00-a2c5-3c5408aca1b7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:50.089094 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e7b1a757-76c9-4d00-a2c5-3c5408aca1b7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:50.089825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e7b1a757-76c9-4d00-a2c5-3c5408aca1b7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:50.131656 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:50.408584 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-49b04b3e-ec9e-45f9-a31c-32ec52b47d27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:50.432011 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-49b04b3e-ec9e-45f9-a31c-32ec52b47d27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1315 microversion: 2.1 time: 0.440576 Oct 10 18:54:50.433593 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 638/1436] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:49 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:50.678970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b16463c1-3461-41c6-a9bb-56aec10f4804 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:50.679899 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b16463c1-3461-41c6-a9bb-56aec10f4804 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: d908aa91-59b6-4c75-b6d2-30e97e050a55] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:50.688114 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b16463c1-3461-41c6-a9bb-56aec10f4804 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:50.688677 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b16463c1-3461-41c6-a9bb-56aec10f4804 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:50.689256 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b16463c1-3461-41c6-a9bb-56aec10f4804 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:50.689815 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b16463c1-3461-41c6-a9bb-56aec10f4804 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:50.690273 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b16463c1-3461-41c6-a9bb-56aec10f4804 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:50.690696 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b16463c1-3461-41c6-a9bb-56aec10f4804 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:50.895858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e7b1a757-76c9-4d00-a2c5-3c5408aca1b7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:50.908556 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e7b1a757-76c9-4d00-a2c5-3c5408aca1b7 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1322 microversion: 2.1 time: 0.856918 Oct 10 18:54:50.912438 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 799/1437] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:50 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1322 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:50.944464 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b16463c1-3461-41c6-a9bb-56aec10f4804 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:50.974906 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b16463c1-3461-41c6-a9bb-56aec10f4804 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55" status: 200 len: 1474 microversion: 2.1 time: 0.307245 Oct 10 18:54:50.976941 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 639/1438] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:50 2022] GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55 => generated 1474 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:51.448890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-1395dddd-e0b1-43aa-8cb0-166e877a5fe3 req-795c7aa1-29bb-4b5a-a520-8889c9c1df9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d908aa91-59b6-4c75-b6d2-30e97e050a55", "name": "network-vif-deleted", "tag": "b0f98a85-8566-4775-a260-badc6b8f6997"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:51.456471 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-51b29dad-b25a-44a7-9500-4fa809582d0c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:51.457676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-51b29dad-b25a-44a7-9500-4fa809582d0c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:51.479549 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51b29dad-b25a-44a7-9500-4fa809582d0c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:51.482556 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51b29dad-b25a-44a7-9500-4fa809582d0c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:51.484753 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51b29dad-b25a-44a7-9500-4fa809582d0c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:51.486154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1395dddd-e0b1-43aa-8cb0-166e877a5fe3 req-795c7aa1-29bb-4b5a-a520-8889c9c1df9d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:51.493217 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51b29dad-b25a-44a7-9500-4fa809582d0c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:51.494041 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51b29dad-b25a-44a7-9500-4fa809582d0c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:51.495504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1395dddd-e0b1-43aa-8cb0-166e877a5fe3 req-795c7aa1-29bb-4b5a-a520-8889c9c1df9d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:51.496265 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51b29dad-b25a-44a7-9500-4fa809582d0c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:51.496906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1395dddd-e0b1-43aa-8cb0-166e877a5fe3 req-795c7aa1-29bb-4b5a-a520-8889c9c1df9d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:51.521887 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-1395dddd-e0b1-43aa-8cb0-166e877a5fe3 req-795c7aa1-29bb-4b5a-a520-8889c9c1df9d service nova] Creating event network-vif-deleted:b0f98a85-8566-4775-a260-badc6b8f6997 for instance d908aa91-59b6-4c75-b6d2-30e97e050a55 on n-h2-860863-1 Oct 10 18:54:51.539892 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-1395dddd-e0b1-43aa-8cb0-166e877a5fe3 req-795c7aa1-29bb-4b5a-a520-8889c9c1df9d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094788 Oct 10 18:54:51.550533 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 800/1439] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:51.875136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-51b29dad-b25a-44a7-9500-4fa809582d0c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:51.892816 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-51b29dad-b25a-44a7-9500-4fa809582d0c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1315 microversion: 2.1 time: 0.434496 Oct 10 18:54:51.892816 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 640/1440] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:51 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:51.933930 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4ef617af-32cf-4daa-b553-b3a809c166b4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:51.935027 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4ef617af-32cf-4daa-b553-b3a809c166b4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:51.942429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ef617af-32cf-4daa-b553-b3a809c166b4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:51.943053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ef617af-32cf-4daa-b553-b3a809c166b4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:51.943591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ef617af-32cf-4daa-b553-b3a809c166b4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:51.944557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ef617af-32cf-4daa-b553-b3a809c166b4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:51.945149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ef617af-32cf-4daa-b553-b3a809c166b4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:51.945798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ef617af-32cf-4daa-b553-b3a809c166b4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:51.997789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-882f1ae9-d768-49b6-9d9e-bf7d826914d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:51.999785 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-882f1ae9-d768-49b6-9d9e-bf7d826914d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: d908aa91-59b6-4c75-b6d2-30e97e050a55] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:52.006502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-882f1ae9-d768-49b6-9d9e-bf7d826914d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:52.007002 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-882f1ae9-d768-49b6-9d9e-bf7d826914d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:52.007424 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-882f1ae9-d768-49b6-9d9e-bf7d826914d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:52.008749 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-882f1ae9-d768-49b6-9d9e-bf7d826914d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:52.009971 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-882f1ae9-d768-49b6-9d9e-bf7d826914d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:52.010591 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-882f1ae9-d768-49b6-9d9e-bf7d826914d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:52.057265 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-882f1ae9-d768-49b6-9d9e-bf7d826914d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:52.057892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-882f1ae9-d768-49b6-9d9e-bf7d826914d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:52.058450 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-882f1ae9-d768-49b6-9d9e-bf7d826914d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:52.059386 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-882f1ae9-d768-49b6-9d9e-bf7d826914d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lazy-loading 'fault' on Instance uuid d908aa91-59b6-4c75-b6d2-30e97e050a55 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:54:52.171242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-882f1ae9-d768-49b6-9d9e-bf7d826914d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:52.186321 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-882f1ae9-d768-49b6-9d9e-bf7d826914d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55" status: 200 len: 1309 microversion: 2.1 time: 0.192301 Oct 10 18:54:52.190908 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 641/1441] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:51 2022] GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55 => generated 1309 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:52.365728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4ef617af-32cf-4daa-b553-b3a809c166b4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:52.378523 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4ef617af-32cf-4daa-b553-b3a809c166b4 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1322 microversion: 2.1 time: 0.448784 Oct 10 18:54:52.380781 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 801/1442] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:51 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:52.417320 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-f50076fe-384c-4c4c-9a28-409e9a23e286 req-880c6b9e-d32e-419e-9b82-47d961c9c208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51effa0d-d131-46be-ae0a-859e231dd233", "name": "network-vif-plugged", "status": "completed", "tag": "5bee11d9-0e26-43bf-ae03-9a4ec1c9e853"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:52.429477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f50076fe-384c-4c4c-9a28-409e9a23e286 req-880c6b9e-d32e-419e-9b82-47d961c9c208 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:52.429978 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f50076fe-384c-4c4c-9a28-409e9a23e286 req-880c6b9e-d32e-419e-9b82-47d961c9c208 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:52.433038 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f50076fe-384c-4c4c-9a28-409e9a23e286 req-880c6b9e-d32e-419e-9b82-47d961c9c208 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:52.472947 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-f50076fe-384c-4c4c-9a28-409e9a23e286 req-880c6b9e-d32e-419e-9b82-47d961c9c208 service nova] Creating event network-vif-plugged:5bee11d9-0e26-43bf-ae03-9a4ec1c9e853 for instance 51effa0d-d131-46be-ae0a-859e231dd233 on n-h2-860863-1 Oct 10 18:54:52.484296 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-f50076fe-384c-4c4c-9a28-409e9a23e286 req-880c6b9e-d32e-419e-9b82-47d961c9c208 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094951 Oct 10 18:54:52.485467 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 642/1443] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:52.897580 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-88dbcf36-56f7-41d7-94ba-3c448897038a tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd51244e-c9d2-48f6-9648-4cc85eefbdd8"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:52.901997 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-88dbcf36-56f7-41d7-94ba-3c448897038a tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:52.914603 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-32adf478-caa1-451c-b327-01846245c2a8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:52.916679 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-32adf478-caa1-451c-b327-01846245c2a8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:52.930719 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88dbcf36-56f7-41d7-94ba-3c448897038a tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:52.930719 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88dbcf36-56f7-41d7-94ba-3c448897038a tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:52.933619 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-32adf478-caa1-451c-b327-01846245c2a8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:52.936203 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88dbcf36-56f7-41d7-94ba-3c448897038a tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:52.937243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88dbcf36-56f7-41d7-94ba-3c448897038a tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:52.938970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-32adf478-caa1-451c-b327-01846245c2a8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:52.939616 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88dbcf36-56f7-41d7-94ba-3c448897038a tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:52.940235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-32adf478-caa1-451c-b327-01846245c2a8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:52.941512 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-32adf478-caa1-451c-b327-01846245c2a8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:52.941905 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88dbcf36-56f7-41d7-94ba-3c448897038a tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:52.946661 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-32adf478-caa1-451c-b327-01846245c2a8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:52.947346 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-32adf478-caa1-451c-b327-01846245c2a8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:53.224894 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-32adf478-caa1-451c-b327-01846245c2a8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:53.237380 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-32adf478-caa1-451c-b327-01846245c2a8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1315 microversion: 2.1 time: 0.328216 Oct 10 18:54:53.241393 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 643/1444] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:52 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:53.261110 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-160509d1-d44a-43e1-b862-e50c5999a8ac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:53.261814 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-160509d1-d44a-43e1-b862-e50c5999a8ac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: d908aa91-59b6-4c75-b6d2-30e97e050a55] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:53.268699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-160509d1-d44a-43e1-b862-e50c5999a8ac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:53.270155 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-160509d1-d44a-43e1-b862-e50c5999a8ac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:53.270155 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-160509d1-d44a-43e1-b862-e50c5999a8ac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:53.271023 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-160509d1-d44a-43e1-b862-e50c5999a8ac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:53.271661 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-160509d1-d44a-43e1-b862-e50c5999a8ac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:53.272244 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-160509d1-d44a-43e1-b862-e50c5999a8ac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:53.291720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:53.341853 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-160509d1-d44a-43e1-b862-e50c5999a8ac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:53.342681 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-160509d1-d44a-43e1-b862-e50c5999a8ac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:53.343359 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-160509d1-d44a-43e1-b862-e50c5999a8ac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:53.345140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-160509d1-d44a-43e1-b862-e50c5999a8ac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lazy-loading 'fault' on Instance uuid d908aa91-59b6-4c75-b6d2-30e97e050a55 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:54:53.409389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-160509d1-d44a-43e1-b862-e50c5999a8ac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:53.429310 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-160509d1-d44a-43e1-b862-e50c5999a8ac tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55" status: 200 len: 1309 microversion: 2.1 time: 0.187464 Oct 10 18:54:53.453036 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 644/1445] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:53 2022] GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55 => generated 1309 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:53.463321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ab1d3c57-7398-4592-808a-0fec5ed12963 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:53.463955 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ab1d3c57-7398-4592-808a-0fec5ed12963 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:53.470658 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab1d3c57-7398-4592-808a-0fec5ed12963 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:53.471381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab1d3c57-7398-4592-808a-0fec5ed12963 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:53.471993 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab1d3c57-7398-4592-808a-0fec5ed12963 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:53.472912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab1d3c57-7398-4592-808a-0fec5ed12963 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:53.473750 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab1d3c57-7398-4592-808a-0fec5ed12963 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:53.475079 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab1d3c57-7398-4592-808a-0fec5ed12963 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:53.644474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ab1d3c57-7398-4592-808a-0fec5ed12963 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:53.656578 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ab1d3c57-7398-4592-808a-0fec5ed12963 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1322 microversion: 2.1 time: 0.201905 Oct 10 18:54:53.657449 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 645/1446] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:53 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:53.672227 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-59ed6b17-2b57-498c-b2cd-1bf4293820d1 req-2d5e1242-9f1c-4519-9742-bf9cbece5af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f72bf2-33cf-49a6-9b20-7fafcee472cd", "name": "network-vif-deleted", "tag": "34c30487-9b21-45bd-8ec6-5e68a0c5a60f"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:53.688524 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-59ed6b17-2b57-498c-b2cd-1bf4293820d1 req-2d5e1242-9f1c-4519-9742-bf9cbece5af0 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:53.694405 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-59ed6b17-2b57-498c-b2cd-1bf4293820d1 req-2d5e1242-9f1c-4519-9742-bf9cbece5af0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:53.694852 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-59ed6b17-2b57-498c-b2cd-1bf4293820d1 req-2d5e1242-9f1c-4519-9742-bf9cbece5af0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:53.725121 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-59ed6b17-2b57-498c-b2cd-1bf4293820d1 req-2d5e1242-9f1c-4519-9742-bf9cbece5af0 service nova] Creating event network-vif-deleted:34c30487-9b21-45bd-8ec6-5e68a0c5a60f for instance b2f72bf2-33cf-49a6-9b20-7fafcee472cd on n-h1-860863-1 Oct 10 18:54:53.732785 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-59ed6b17-2b57-498c-b2cd-1bf4293820d1 req-2d5e1242-9f1c-4519-9742-bf9cbece5af0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071923 Oct 10 18:54:53.733864 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 646/1447] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:53.925103 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-88dbcf36-56f7-41d7-94ba-3c448897038a tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "POST /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.032259 Oct 10 18:54:53.929037 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 802/1448] 10.222.0.43 () {60 vars in 1323 bytes} [Mon Oct 10 18:54:52 2022] POST /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments => generated 194 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:54.265057 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c735578c-e184-4fbc-9a47-d56ead88a03a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:54.266730 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c735578c-e184-4fbc-9a47-d56ead88a03a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:54.274886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c735578c-e184-4fbc-9a47-d56ead88a03a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:54.276601 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c735578c-e184-4fbc-9a47-d56ead88a03a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:54.277598 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c735578c-e184-4fbc-9a47-d56ead88a03a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:54.278657 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c735578c-e184-4fbc-9a47-d56ead88a03a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:54.279270 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c735578c-e184-4fbc-9a47-d56ead88a03a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:54.279859 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c735578c-e184-4fbc-9a47-d56ead88a03a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:54.471096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-44d148d5-d154-43d6-b639-bac23fa35f5a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:54.471971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-44d148d5-d154-43d6-b639-bac23fa35f5a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: d908aa91-59b6-4c75-b6d2-30e97e050a55] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:54.484305 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:54:54.490683 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44d148d5-d154-43d6-b639-bac23fa35f5a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:54.491575 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44d148d5-d154-43d6-b639-bac23fa35f5a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:54.494276 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44d148d5-d154-43d6-b639-bac23fa35f5a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:54.496276 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44d148d5-d154-43d6-b639-bac23fa35f5a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:54.497791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44d148d5-d154-43d6-b639-bac23fa35f5a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:54.498491 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44d148d5-d154-43d6-b639-bac23fa35f5a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:54.519776 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-44d148d5-d154-43d6-b639-bac23fa35f5a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] HTTP exception thrown: Instance d908aa91-59b6-4c75-b6d2-30e97e050a55 could not be found. Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-44d148d5-d154-43d6-b639-bac23fa35f5a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Request method failure captured: Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55 HTTP/1.1 Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGm4gi-GigrCCGP4gZ0L6T7bfFulRKFfLM2g8v9pYuIlN-6kcPDxo1dVOtF12HlrUDwYL2ilR3T2CEZskDG5X4WyXTvGaYXSGu6yuVLVcexzys5KE6QRZju-8W5aaKEyioTybqHJ7jCOt5qQoZ1_926e1tP4yBBHEbyJngUytXsHWSU Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: f536cb88016b414298031238fb251097 Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f536cb88016b414298031238fb251097", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f536cb88016b414298031238fb251097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}] Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: f536cb88016b414298031238fb251097 Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c62f3c2582904aa2894aa339e7bb882d Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance d908aa91-59b6-4c75-b6d2-30e97e050a55 could not be found. Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'd908aa91-59b6-4c75-b6d2-30e97e050a55'} Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d908aa91-59b6-4c75-b6d2-30e97e050a55 could not be found. Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d908aa91-59b6-4c75-b6d2-30e97e050a55 could not be found. Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:54.523448 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:54.529265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:54.529265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:54.529265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:54.529265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:54.529265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:54.529265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d908aa91-59b6-4c75-b6d2-30e97e050a55 could not be found. Oct 10 18:54:54.529265 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:54:54.531698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-44d148d5-d154-43d6-b639-bac23fa35f5a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Returning 404 to user: Instance d908aa91-59b6-4c75-b6d2-30e97e050a55 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:54.532932 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-44d148d5-d154-43d6-b639-bac23fa35f5a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55" status: 404 len: 111 microversion: 2.1 time: 0.067304 Oct 10 18:54:54.533669 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 803/1449] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:54 2022] GET /compute/v2.1/servers/d908aa91-59b6-4c75-b6d2-30e97e050a55 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:54:54.539649 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-b9a0a62d-71e7-46fd-8671-3b16b6dc5074 req-01eb9c94-fe01-4c58-bccf-22939ac67acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb00752-884b-40f1-b2e5-f6f490f5cf93", "name": "network-vif-plugged", "status": "completed", "tag": "5c98fa39-bb29-4e98-b97a-bee8a9c41998"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:54.565776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b9a0a62d-71e7-46fd-8671-3b16b6dc5074 req-01eb9c94-fe01-4c58-bccf-22939ac67acb service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:54.567043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c735578c-e184-4fbc-9a47-d56ead88a03a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:54.568157 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b9a0a62d-71e7-46fd-8671-3b16b6dc5074 req-01eb9c94-fe01-4c58-bccf-22939ac67acb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:54.571524 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b9a0a62d-71e7-46fd-8671-3b16b6dc5074 req-01eb9c94-fe01-4c58-bccf-22939ac67acb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:54.595436 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c735578c-e184-4fbc-9a47-d56ead88a03a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1315 microversion: 2.1 time: 0.336971 Oct 10 18:54:54.598234 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 647/1450] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:54 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:54.603389 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-b9a0a62d-71e7-46fd-8671-3b16b6dc5074 req-01eb9c94-fe01-4c58-bccf-22939ac67acb service nova] Creating event network-vif-plugged:5c98fa39-bb29-4e98-b97a-bee8a9c41998 for instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 on n-h1-860863-1 Oct 10 18:54:54.615394 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-b9a0a62d-71e7-46fd-8671-3b16b6dc5074 req-01eb9c94-fe01-4c58-bccf-22939ac67acb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080341 Oct 10 18:54:54.620514 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 804/1451] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:54:54.639793 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0888042a-c3a4-4289-b36c-3aa93df6defd tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:54.649060 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0888042a-c3a4-4289-b36c-3aa93df6defd tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: b2f72bf2-33cf-49a6-9b20-7fafcee472cd] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:54.674917 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0888042a-c3a4-4289-b36c-3aa93df6defd tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:54.677747 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0888042a-c3a4-4289-b36c-3aa93df6defd tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:54.677747 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0888042a-c3a4-4289-b36c-3aa93df6defd tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:54.680524 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-88c093a5-7643-42a5-981f-2281c51d3a94 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:54.681805 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-88c093a5-7643-42a5-981f-2281c51d3a94 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:54.686605 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0888042a-c3a4-4289-b36c-3aa93df6defd tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:54.689186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0888042a-c3a4-4289-b36c-3aa93df6defd tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:54.689744 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0888042a-c3a4-4289-b36c-3aa93df6defd tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:54.703138 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88c093a5-7643-42a5-981f-2281c51d3a94 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:54.703699 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88c093a5-7643-42a5-981f-2281c51d3a94 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:54.704153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88c093a5-7643-42a5-981f-2281c51d3a94 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:54.710568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88c093a5-7643-42a5-981f-2281c51d3a94 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:54.711067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88c093a5-7643-42a5-981f-2281c51d3a94 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:54.711514 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88c093a5-7643-42a5-981f-2281c51d3a94 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:54.739827 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-0888042a-c3a4-4289-b36c-3aa93df6defd tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] HTTP exception thrown: Instance b2f72bf2-33cf-49a6-9b20-7fafcee472cd could not be found. Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0888042a-c3a4-4289-b36c-3aa93df6defd tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Request method failure captured: Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd HTTP/1.1 Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGm4gi-GigrCCGP4gZ0L6T7bfFulRKFfLM2g8v9pYuIlN-6kcPDxo1dVOtF12HlrUDwYL2ilR3T2CEZskDG5X4WyXTvGaYXSGu6yuVLVcexzys5KE6QRZju-8W5aaKEyioTybqHJ7jCOt5qQoZ1_926e1tP4yBBHEbyJngUytXsHWSU Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: f536cb88016b414298031238fb251097 Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f536cb88016b414298031238fb251097", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f536cb88016b414298031238fb251097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}] Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: f536cb88016b414298031238fb251097 Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: c62f3c2582904aa2894aa339e7bb882d Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance b2f72bf2-33cf-49a6-9b20-7fafcee472cd could not be found. Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'b2f72bf2-33cf-49a6-9b20-7fafcee472cd'} Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2f72bf2-33cf-49a6-9b20-7fafcee472cd could not be found. Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2f72bf2-33cf-49a6-9b20-7fafcee472cd could not be found. Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:54:54.743218 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:54.750759 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:54:54.750759 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:54:54.750759 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:54:54.750759 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:54:54.750759 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:54:54.750759 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2f72bf2-33cf-49a6-9b20-7fafcee472cd could not be found. Oct 10 18:54:54.750759 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:54:54.753120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0888042a-c3a4-4289-b36c-3aa93df6defd tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Returning 404 to user: Instance b2f72bf2-33cf-49a6-9b20-7fafcee472cd could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:54:54.756447 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0888042a-c3a4-4289-b36c-3aa93df6defd tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd" status: 404 len: 111 microversion: 2.1 time: 0.142320 Oct 10 18:54:54.761509 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 648/1452] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:54 2022] GET /compute/v2.1/servers/b2f72bf2-33cf-49a6-9b20-7fafcee472cd => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:54:54.770593 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-72acabb9-7c17-44b1-b8a8-ea2245d88acb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:54.934125 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-72acabb9-7c17-44b1-b8a8-ea2245d88acb tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/e85081cb-1236-4f01-9f84-23bbf81790d0" status: 204 len: 0 microversion: 2.1 time: 0.167240 Oct 10 18:54:54.934961 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 649/1453] 10.222.0.43 () {58 vars in 1266 bytes} [Mon Oct 10 18:54:54 2022] DELETE /compute/v2.1/os-server-groups/e85081cb-1236-4f01-9f84-23bbf81790d0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 18:54:54.943537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-595e12e8-0ebd-49cb-9e93-b87909053a35 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:54.944295 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-595e12e8-0ebd-49cb-9e93-b87909053a35 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 24f13450-d68f-4d4a-a1fd-c2da9dfd523f] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:54.963103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-595e12e8-0ebd-49cb-9e93-b87909053a35 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:54.967928 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-595e12e8-0ebd-49cb-9e93-b87909053a35 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:54.967928 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-595e12e8-0ebd-49cb-9e93-b87909053a35 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:54.968174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-595e12e8-0ebd-49cb-9e93-b87909053a35 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:54.969363 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-595e12e8-0ebd-49cb-9e93-b87909053a35 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:54.969820 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-595e12e8-0ebd-49cb-9e93-b87909053a35 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:55.080385 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-595e12e8-0ebd-49cb-9e93-b87909053a35 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 24f13450-d68f-4d4a-a1fd-c2da9dfd523f] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:54:55.117108 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-88c093a5-7643-42a5-981f-2281c51d3a94 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:55.128128 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-88c093a5-7643-42a5-981f-2281c51d3a94 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1322 microversion: 2.1 time: 0.452336 Oct 10 18:54:55.148901 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 805/1454] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:54 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:55.504042 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-595e12e8-0ebd-49cb-9e93-b87909053a35 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "DELETE /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f" status: 204 len: 0 microversion: 2.1 time: 0.564414 Oct 10 18:54:55.504881 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 650/1455] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:54:54 2022] DELETE /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:54:55.514247 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9c07f45c-b29b-437e-9b05-21b0d8371797 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:55.514743 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9c07f45c-b29b-437e-9b05-21b0d8371797 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:55.538756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c07f45c-b29b-437e-9b05-21b0d8371797 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:55.539428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c07f45c-b29b-437e-9b05-21b0d8371797 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:55.540036 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c07f45c-b29b-437e-9b05-21b0d8371797 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:55.541020 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c07f45c-b29b-437e-9b05-21b0d8371797 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:55.544616 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c07f45c-b29b-437e-9b05-21b0d8371797 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:55.554777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c07f45c-b29b-437e-9b05-21b0d8371797 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:55.586279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9c07f45c-b29b-437e-9b05-21b0d8371797 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:54:55.625288 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1685ff6e-10b2-4bf5-8374-2f1e3e40b568 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:55.626313 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1685ff6e-10b2-4bf5-8374-2f1e3e40b568 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:55.645726 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1685ff6e-10b2-4bf5-8374-2f1e3e40b568 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:55.646880 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1685ff6e-10b2-4bf5-8374-2f1e3e40b568 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:55.647544 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1685ff6e-10b2-4bf5-8374-2f1e3e40b568 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:55.648980 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1685ff6e-10b2-4bf5-8374-2f1e3e40b568 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:55.651010 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1685ff6e-10b2-4bf5-8374-2f1e3e40b568 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:55.654164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1685ff6e-10b2-4bf5-8374-2f1e3e40b568 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:55.916933 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1685ff6e-10b2-4bf5-8374-2f1e3e40b568 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:55.926530 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1685ff6e-10b2-4bf5-8374-2f1e3e40b568 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1503 microversion: 2.1 time: 0.305873 Oct 10 18:54:55.927521 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 651/1456] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:55 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:55.951136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0a0aa6c3-fd82-4360-a01b-5889ab965122 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:55.953965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0a0aa6c3-fd82-4360-a01b-5889ab965122 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:55.965241 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0a0aa6c3-fd82-4360-a01b-5889ab965122 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:55.967537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0a0aa6c3-fd82-4360-a01b-5889ab965122 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:55.967537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0a0aa6c3-fd82-4360-a01b-5889ab965122 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:55.967982 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0a0aa6c3-fd82-4360-a01b-5889ab965122 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:55.969313 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0a0aa6c3-fd82-4360-a01b-5889ab965122 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:55.969752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0a0aa6c3-fd82-4360-a01b-5889ab965122 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:55.988390 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9c07f45c-b29b-437e-9b05-21b0d8371797 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "DELETE /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 204 len: 0 microversion: 2.1 time: 0.478393 Oct 10 18:54:55.989103 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 806/1457] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:54:55 2022] DELETE /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:54:55.999720 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ac6010b6-dede-47d3-bf51-18e891bf5926 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:56.000492 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ac6010b6-dede-47d3-bf51-18e891bf5926 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 24f13450-d68f-4d4a-a1fd-c2da9dfd523f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:56.008919 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac6010b6-dede-47d3-bf51-18e891bf5926 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:56.010254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac6010b6-dede-47d3-bf51-18e891bf5926 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:56.010852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac6010b6-dede-47d3-bf51-18e891bf5926 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:56.011947 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac6010b6-dede-47d3-bf51-18e891bf5926 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:56.012829 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac6010b6-dede-47d3-bf51-18e891bf5926 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:56.013521 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac6010b6-dede-47d3-bf51-18e891bf5926 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:56.296345 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0a0aa6c3-fd82-4360-a01b-5889ab965122 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "POST /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233/action" status: 202 len: 0 microversion: 2.1 time: 0.349592 Oct 10 18:54:56.298834 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 652/1458] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:54:55 2022] POST /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:54:56.315535 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8c3ef35d-239d-40ca-abc6-128da639e79a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:56.316247 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8c3ef35d-239d-40ca-abc6-128da639e79a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:56.334488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c3ef35d-239d-40ca-abc6-128da639e79a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:56.334985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c3ef35d-239d-40ca-abc6-128da639e79a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:56.335421 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c3ef35d-239d-40ca-abc6-128da639e79a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:56.336135 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c3ef35d-239d-40ca-abc6-128da639e79a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:56.336604 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c3ef35d-239d-40ca-abc6-128da639e79a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:56.352384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c3ef35d-239d-40ca-abc6-128da639e79a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:56.455540 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ac6010b6-dede-47d3-bf51-18e891bf5926 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:56.471133 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ac6010b6-dede-47d3-bf51-18e891bf5926 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f" status: 200 len: 1473 microversion: 2.1 time: 0.476335 Oct 10 18:54:56.491267 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 807/1459] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:55 2022] GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f => generated 1473 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:54:56.503114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fafb428b-9ee5-452e-ac74-2804c34eecf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:56.503746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fafb428b-9ee5-452e-ac74-2804c34eecf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:56.520036 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fafb428b-9ee5-452e-ac74-2804c34eecf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:56.524363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fafb428b-9ee5-452e-ac74-2804c34eecf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:56.524363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fafb428b-9ee5-452e-ac74-2804c34eecf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:56.524363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fafb428b-9ee5-452e-ac74-2804c34eecf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:56.524363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fafb428b-9ee5-452e-ac74-2804c34eecf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:56.525587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fafb428b-9ee5-452e-ac74-2804c34eecf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:56.820146 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fafb428b-9ee5-452e-ac74-2804c34eecf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:56.829837 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fafb428b-9ee5-452e-ac74-2804c34eecf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1508 microversion: 2.1 time: 0.337202 Oct 10 18:54:56.843668 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 808/1460] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:56 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:56.889053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8c3ef35d-239d-40ca-abc6-128da639e79a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:56.917137 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8c3ef35d-239d-40ca-abc6-128da639e79a tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1322 microversion: 2.1 time: 0.612350 Oct 10 18:54:56.918507 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 653/1461] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:56 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:57.501896 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-29195a71-3c5d-4017-8003-1572d73d6e46 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:57.504108 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-29195a71-3c5d-4017-8003-1572d73d6e46 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 24f13450-d68f-4d4a-a1fd-c2da9dfd523f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:57.519186 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29195a71-3c5d-4017-8003-1572d73d6e46 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:57.523071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29195a71-3c5d-4017-8003-1572d73d6e46 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:57.523071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29195a71-3c5d-4017-8003-1572d73d6e46 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:57.525512 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29195a71-3c5d-4017-8003-1572d73d6e46 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:57.526180 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29195a71-3c5d-4017-8003-1572d73d6e46 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:57.528343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29195a71-3c5d-4017-8003-1572d73d6e46 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:57.857505 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-01fb4584-0027-4059-9bcc-f178b96c9f82 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:57.858394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-01fb4584-0027-4059-9bcc-f178b96c9f82 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:57.873017 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-01fb4584-0027-4059-9bcc-f178b96c9f82 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:57.874646 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-01fb4584-0027-4059-9bcc-f178b96c9f82 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:57.876886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-01fb4584-0027-4059-9bcc-f178b96c9f82 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:57.877861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-01fb4584-0027-4059-9bcc-f178b96c9f82 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:57.881221 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-01fb4584-0027-4059-9bcc-f178b96c9f82 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:57.881888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-01fb4584-0027-4059-9bcc-f178b96c9f82 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:58.539595 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-01fb4584-0027-4059-9bcc-f178b96c9f82 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:58.565449 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-01fb4584-0027-4059-9bcc-f178b96c9f82 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1508 microversion: 2.1 time: 0.713877 Oct 10 18:54:58.566033 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 654/1462] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:57 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1508 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:58.593741 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-33457d15-c11a-4f02-95bd-f2fe76835a00 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:58.595154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-33457d15-c11a-4f02-95bd-f2fe76835a00 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:58.610716 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33457d15-c11a-4f02-95bd-f2fe76835a00 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:58.616888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33457d15-c11a-4f02-95bd-f2fe76835a00 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:58.616888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33457d15-c11a-4f02-95bd-f2fe76835a00 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:58.616888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33457d15-c11a-4f02-95bd-f2fe76835a00 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:58.616888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33457d15-c11a-4f02-95bd-f2fe76835a00 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:58.616888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33457d15-c11a-4f02-95bd-f2fe76835a00 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:58.831812 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-29195a71-3c5d-4017-8003-1572d73d6e46 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:58.844046 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-29195a71-3c5d-4017-8003-1572d73d6e46 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f" status: 200 len: 1473 microversion: 2.1 time: 1.353879 Oct 10 18:54:58.850921 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 809/1463] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:57 2022] GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f => generated 1473 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:59.022577 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-33457d15-c11a-4f02-95bd-f2fe76835a00 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:59.034952 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-33457d15-c11a-4f02-95bd-f2fe76835a00 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1471 microversion: 2.1 time: 0.450848 Oct 10 18:54:59.035547 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 655/1464] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:58 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1471 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:59.060940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bc3b3579-cb49-4d5e-9f04-3e2de1f7f278 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:54:59.061734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bc3b3579-cb49-4d5e-9f04-3e2de1f7f278 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:59.078748 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc3b3579-cb49-4d5e-9f04-3e2de1f7f278 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:59.081723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc3b3579-cb49-4d5e-9f04-3e2de1f7f278 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:59.082864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc3b3579-cb49-4d5e-9f04-3e2de1f7f278 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:59.083846 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc3b3579-cb49-4d5e-9f04-3e2de1f7f278 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:59.085079 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc3b3579-cb49-4d5e-9f04-3e2de1f7f278 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:59.087732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc3b3579-cb49-4d5e-9f04-3e2de1f7f278 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:59.144375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-bc3b3579-cb49-4d5e-9f04-3e2de1f7f278 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lazy-loading 'flavor' on Instance uuid cfb00752-884b-40f1-b2e5-f6f490f5cf93 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:54:59.475194 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bc3b3579-cb49-4d5e-9f04-3e2de1f7f278 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93/action" status: 202 len: 0 microversion: 2.1 time: 0.418583 Oct 10 18:54:59.480415 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 810/1465] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:54:59 2022] POST /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 18:54:59.487430 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a6e10d81-aa54-4409-b8d8-c81661e4265b tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:59.488229 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a6e10d81-aa54-4409-b8d8-c81661e4265b tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:59.497533 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6e10d81-aa54-4409-b8d8-c81661e4265b tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:59.500715 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6e10d81-aa54-4409-b8d8-c81661e4265b tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:59.504333 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6e10d81-aa54-4409-b8d8-c81661e4265b tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:59.505500 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6e10d81-aa54-4409-b8d8-c81661e4265b tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:59.506264 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6e10d81-aa54-4409-b8d8-c81661e4265b tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:59.506926 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6e10d81-aa54-4409-b8d8-c81661e4265b tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:59.615407 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8241dd7e-3b8f-48a1-a451-558681c5362d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:54:59.616632 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8241dd7e-3b8f-48a1-a451-558681c5362d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:54:59.639959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8241dd7e-3b8f-48a1-a451-558681c5362d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:59.647452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8241dd7e-3b8f-48a1-a451-558681c5362d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:59.647452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8241dd7e-3b8f-48a1-a451-558681c5362d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:59.647452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8241dd7e-3b8f-48a1-a451-558681c5362d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:54:59.647452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8241dd7e-3b8f-48a1-a451-558681c5362d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:54:59.647452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8241dd7e-3b8f-48a1-a451-558681c5362d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:54:59.982252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8241dd7e-3b8f-48a1-a451-558681c5362d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:54:59.991203 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8241dd7e-3b8f-48a1-a451-558681c5362d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1488 microversion: 2.1 time: 0.400225 Oct 10 18:54:59.994109 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 811/1466] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:59 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1488 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:54:59.999814 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b0a25913-df94-4ea3-80b4-f997160f30fc tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:00.000714 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b0a25913-df94-4ea3-80b4-f997160f30fc tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 24f13450-d68f-4d4a-a1fd-c2da9dfd523f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:00.007287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0a25913-df94-4ea3-80b4-f997160f30fc tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:00.007832 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0a25913-df94-4ea3-80b4-f997160f30fc tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:00.008261 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0a25913-df94-4ea3-80b4-f997160f30fc tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:00.009206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0a25913-df94-4ea3-80b4-f997160f30fc tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:00.010473 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0a25913-df94-4ea3-80b4-f997160f30fc tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:00.011051 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0a25913-df94-4ea3-80b4-f997160f30fc tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:00.485369 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b0a25913-df94-4ea3-80b4-f997160f30fc tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:00.503523 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b0a25913-df94-4ea3-80b4-f997160f30fc tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f" status: 200 len: 1473 microversion: 2.1 time: 0.507895 Oct 10 18:55:00.529851 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 812/1467] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:59 2022] GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f => generated 1473 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:00.542394 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e620d8cd-6a5d-4075-9682-d93c8c4c5312 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:00.543448 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e620d8cd-6a5d-4075-9682-d93c8c4c5312 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:00.555346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e620d8cd-6a5d-4075-9682-d93c8c4c5312 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:00.558627 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e620d8cd-6a5d-4075-9682-d93c8c4c5312 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:00.559289 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e620d8cd-6a5d-4075-9682-d93c8c4c5312 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:00.563265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e620d8cd-6a5d-4075-9682-d93c8c4c5312 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:00.564276 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e620d8cd-6a5d-4075-9682-d93c8c4c5312 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:00.565049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e620d8cd-6a5d-4075-9682-d93c8c4c5312 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:00.652172 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:00.669421 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e620d8cd-6a5d-4075-9682-d93c8c4c5312 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:55:00.706240 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a6e10d81-aa54-4409-b8d8-c81661e4265b tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1630 microversion: 2.1 time: 1.212636 Oct 10 18:55:00.708113 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 656/1468] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:54:59 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1630 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:00.715614 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-7d186e16-343a-4927-a36c-23fa40a03acc req-8ecf383a-33cb-48b3-851d-4c1800d7439c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b378d3-5727-40a4-b211-c0dbcdbe4d93", "name": "network-vif-deleted", "tag": "673afa70-c6a7-45ff-8ba0-6d9a0316b758"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:00.780303 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7d186e16-343a-4927-a36c-23fa40a03acc req-8ecf383a-33cb-48b3-851d-4c1800d7439c service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:00.780855 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7d186e16-343a-4927-a36c-23fa40a03acc req-8ecf383a-33cb-48b3-851d-4c1800d7439c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:00.781555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7d186e16-343a-4927-a36c-23fa40a03acc req-8ecf383a-33cb-48b3-851d-4c1800d7439c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:00.837101 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-7d186e16-343a-4927-a36c-23fa40a03acc req-8ecf383a-33cb-48b3-851d-4c1800d7439c service nova] Creating event network-vif-deleted:673afa70-c6a7-45ff-8ba0-6d9a0316b758 for instance 95b378d3-5727-40a4-b211-c0dbcdbe4d93 on n-h2-860863-1 Oct 10 18:55:00.861458 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-7d186e16-343a-4927-a36c-23fa40a03acc req-8ecf383a-33cb-48b3-851d-4c1800d7439c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149358 Oct 10 18:55:00.861458 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 657/1469] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:00.872466 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-7b3c910f-63cb-433d-a59a-a4ee947aea92 req-b0ceab4f-b37e-4200-9553-1b42bbf020fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f13450-d68f-4d4a-a1fd-c2da9dfd523f", "name": "network-vif-deleted", "tag": "3d9104eb-ed91-4902-9529-aba084d49c09"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:00.919680 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7b3c910f-63cb-433d-a59a-a4ee947aea92 req-b0ceab4f-b37e-4200-9553-1b42bbf020fa service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:00.920171 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7b3c910f-63cb-433d-a59a-a4ee947aea92 req-b0ceab4f-b37e-4200-9553-1b42bbf020fa service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:00.920686 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7b3c910f-63cb-433d-a59a-a4ee947aea92 req-b0ceab4f-b37e-4200-9553-1b42bbf020fa service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:00.975268 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-7b3c910f-63cb-433d-a59a-a4ee947aea92 req-b0ceab4f-b37e-4200-9553-1b42bbf020fa service nova] Creating event network-vif-deleted:3d9104eb-ed91-4902-9529-aba084d49c09 for instance 24f13450-d68f-4d4a-a1fd-c2da9dfd523f on n-h2-860863-1 Oct 10 18:55:01.003451 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-7b3c910f-63cb-433d-a59a-a4ee947aea92 req-b0ceab4f-b37e-4200-9553-1b42bbf020fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142234 Oct 10 18:55:01.008068 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 658/1470] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:01.260729 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e620d8cd-6a5d-4075-9682-d93c8c4c5312 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 204 len: 0 microversion: 2.1 time: 0.728945 Oct 10 18:55:01.265343 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 813/1471] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:55:00 2022] DELETE /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:55:01.276242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8717d9b9-953f-4604-bb06-940efa6ec3b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:01.277245 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8717d9b9-953f-4604-bb06-940efa6ec3b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:01.284965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8717d9b9-953f-4604-bb06-940efa6ec3b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:01.285457 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8717d9b9-953f-4604-bb06-940efa6ec3b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:01.285892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8717d9b9-953f-4604-bb06-940efa6ec3b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:01.286600 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8717d9b9-953f-4604-bb06-940efa6ec3b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:01.287057 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8717d9b9-953f-4604-bb06-940efa6ec3b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:01.287479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8717d9b9-953f-4604-bb06-940efa6ec3b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:01.537062 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b92041d8-438d-446c-89b5-d4e149557d71 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:01.538015 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b92041d8-438d-446c-89b5-d4e149557d71 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 24f13450-d68f-4d4a-a1fd-c2da9dfd523f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:01.547978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b92041d8-438d-446c-89b5-d4e149557d71 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:01.550992 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b92041d8-438d-446c-89b5-d4e149557d71 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:01.551681 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b92041d8-438d-446c-89b5-d4e149557d71 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:01.553648 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b92041d8-438d-446c-89b5-d4e149557d71 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:01.554287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b92041d8-438d-446c-89b5-d4e149557d71 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:01.569337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b92041d8-438d-446c-89b5-d4e149557d71 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:01.621423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b92041d8-438d-446c-89b5-d4e149557d71 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:01.622175 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b92041d8-438d-446c-89b5-d4e149557d71 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:01.622769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b92041d8-438d-446c-89b5-d4e149557d71 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:01.623378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-b92041d8-438d-446c-89b5-d4e149557d71 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lazy-loading 'fault' on Instance uuid 24f13450-d68f-4d4a-a1fd-c2da9dfd523f {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:01.658884 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8717d9b9-953f-4604-bb06-940efa6ec3b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:01.668282 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8717d9b9-953f-4604-bb06-940efa6ec3b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1494 microversion: 2.1 time: 0.401764 Oct 10 18:55:01.674437 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 659/1472] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:01 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1494 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:01.715836 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b92041d8-438d-446c-89b5-d4e149557d71 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:01.724966 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b92041d8-438d-446c-89b5-d4e149557d71 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f" status: 200 len: 1308 microversion: 2.1 time: 0.194186 Oct 10 18:55:01.740563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9504edd8-41dd-4106-b43d-4a7ec7cb4781 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:01.740563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9504edd8-41dd-4106-b43d-4a7ec7cb4781 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:01.741890 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 814/1473] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:01 2022] GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f => generated 1308 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:01.749620 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9504edd8-41dd-4106-b43d-4a7ec7cb4781 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:01.750114 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9504edd8-41dd-4106-b43d-4a7ec7cb4781 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:01.750545 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9504edd8-41dd-4106-b43d-4a7ec7cb4781 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:01.751259 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9504edd8-41dd-4106-b43d-4a7ec7cb4781 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:01.751714 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9504edd8-41dd-4106-b43d-4a7ec7cb4781 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:01.752136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9504edd8-41dd-4106-b43d-4a7ec7cb4781 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:02.203562 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9504edd8-41dd-4106-b43d-4a7ec7cb4781 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1613 microversion: 2.1 time: 0.471164 Oct 10 18:55:02.204063 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 660/1474] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:01 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1613 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:55:02.233183 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-83fddf72-b65c-4ecb-adaf-9feec97fafd9 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:02.234071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-83fddf72-b65c-4ecb-adaf-9feec97fafd9 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:02.253108 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83fddf72-b65c-4ecb-adaf-9feec97fafd9 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:02.254063 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83fddf72-b65c-4ecb-adaf-9feec97fafd9 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:02.254689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83fddf72-b65c-4ecb-adaf-9feec97fafd9 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:02.255613 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83fddf72-b65c-4ecb-adaf-9feec97fafd9 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:02.256356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83fddf72-b65c-4ecb-adaf-9feec97fafd9 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:02.258688 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83fddf72-b65c-4ecb-adaf-9feec97fafd9 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:02.416641 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-83fddf72-b65c-4ecb-adaf-9feec97fafd9 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] HTTP exception thrown: Cannot 'migrate' instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 while it is in vm_state suspended Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-83fddf72-b65c-4ecb-adaf-9feec97fafd9 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Request method failure captured: Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93/action HTTP/1.1 Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 15 Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGpT7HDhycSKBwNBA-cXZA3PMefCEMxr_6df4-mlNbFJof9URbLGF6qLLVqVQ2N4MWF0urARbVROjiMJcyFSQrJSGVM05NAL8-jxz7BffL4ZKbEj8GBm3_WTdItg2PntkS2E9ULzgs3nMTcor8t5GBjJId6qlCrZIVDGG3LQJkDQSQY Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 3368577bc381452fba1e63525293dd8f Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3368577bc381452fba1e63525293dd8f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3368577bc381452fba1e63525293dd8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3368577bc381452fba1e63525293dd8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3368577bc381452fba1e63525293dd8f"}]}] Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 3368577bc381452fba1e63525293dd8f Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersAdminNegativeTestJSON-1330594175-project-admin Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: d048273dae0840238da50cca18cb36c4 Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1330594175-project-admin Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: {"migrate": {}} Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: exception: Cannot 'migrate' instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 while it is in vm_state suspended Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'cfb00752-884b-40f1-b2e5-f6f490f5cf93', 'body': {'migrate': {}}} Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 in vm_state suspended. Cannot resize while the instance is in this state. Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:55:02.426717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 while it is in vm_state suspended Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 while it is in vm_state suspended Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-83fddf72-b65c-4ecb-adaf-9feec97fafd9 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Returning 409 to user: Cannot 'migrate' instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 while it is in vm_state suspended {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-83fddf72-b65c-4ecb-adaf-9feec97fafd9 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93/action" status: 409 len: 148 microversion: 2.1 time: 0.203120 Oct 10 18:55:02.440351 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 815/1475] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:55:02 2022] POST /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93/action => generated 148 bytes in 205 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:55:02.444408 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d994b8d9-182d-4f92-bd09-7b9d5aa9bdff tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d994b8d9-182d-4f92-bd09-7b9d5aa9bdff tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Request method failure captured: Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e/action HTTP/1.1 Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 39 Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGpT7HDhycSKBwNBA-cXZA3PMefCEMxr_6df4-mlNbFJof9URbLGF6qLLVqVQ2N4MWF0urARbVROjiMJcyFSQrJSGVM05NAL8-jxz7BffL4ZKbEj8GBm3_WTdItg2PntkS2E9ULzgs3nMTcor8t5GBjJId6qlCrZIVDGG3LQJkDQSQY Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 3368577bc381452fba1e63525293dd8f Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3368577bc381452fba1e63525293dd8f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3368577bc381452fba1e63525293dd8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3368577bc381452fba1e63525293dd8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3368577bc381452fba1e63525293dd8f"}]}] Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 3368577bc381452fba1e63525293dd8f Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersAdminNegativeTestJSON-1330594175-project-admin Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: d048273dae0840238da50cca18cb36c4 Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1330594175-project-admin Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: {"os-resetState": {"state": "invalid"}} Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '5365436c-bee1-4eba-8561-14ce05700e6e', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise error Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi 'invalid' Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 18:55:02.458541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 18:55:02.470401 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 10 18:55:02.470401 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.470401 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:02.470401 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.470401 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:02.470401 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:02.470401 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:02.470401 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 18:55:02.470401 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 18:55:02.470401 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 10 18:55:02.470401 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.470401 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d994b8d9-182d-4f92-bd09-7b9d5aa9bdff tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:55:02.470401 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d994b8d9-182d-4f92-bd09-7b9d5aa9bdff tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e/action" status: 400 len: 144 microversion: 2.1 time: 0.020588 Oct 10 18:55:02.470401 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 661/1476] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:55:02 2022] POST /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e/action => generated 144 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:55:02.479242 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-91c9e0a8-dee5-4ef0-8ee2-deb13a00dbd7 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-91c9e0a8-dee5-4ef0-8ee2-deb13a00dbd7 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Request method failure captured: Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e/action HTTP/1.1 Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 31 Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGpT7HDhycSKBwNBA-cXZA3PMefCEMxr_6df4-mlNbFJof9URbLGF6qLLVqVQ2N4MWF0urARbVROjiMJcyFSQrJSGVM05NAL8-jxz7BffL4ZKbEj8GBm3_WTdItg2PntkS2E9ULzgs3nMTcor8t5GBjJId6qlCrZIVDGG3LQJkDQSQY Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 3368577bc381452fba1e63525293dd8f Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3368577bc381452fba1e63525293dd8f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3368577bc381452fba1e63525293dd8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3368577bc381452fba1e63525293dd8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3368577bc381452fba1e63525293dd8f"}]}] Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 3368577bc381452fba1e63525293dd8f Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersAdminNegativeTestJSON-1330594175-project-admin Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: d048273dae0840238da50cca18cb36c4 Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1330594175-project-admin Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: {"os-resetState": {"state": 1}} Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '5365436c-bee1-4eba-8561-14ce05700e6e', 'body': {'os-resetState': {'state': 1}}} Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise error Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi 1 Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 10 18:55:02.483272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.489378 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:02.489378 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.489378 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:02.489378 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:02.489378 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:02.489378 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 10 18:55:02.489378 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 10 18:55:02.489378 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 10 18:55:02.489378 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.489378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-91c9e0a8-dee5-4ef0-8ee2-deb13a00dbd7 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:55:02.489378 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-91c9e0a8-dee5-4ef0-8ee2-deb13a00dbd7 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e/action" status: 400 len: 120 microversion: 2.1 time: 0.012009 Oct 10 18:55:02.496967 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 816/1477] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:55:02 2022] POST /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e/action => generated 120 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:55:02.499096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f7165f75-c89d-4457-a32f-a1bbcc07ee45 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:02.505076 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f7165f75-c89d-4457-a32f-a1bbcc07ee45 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Failed to fetch instance by id 999 {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 18:55:02.505892 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-f7165f75-c89d-4457-a32f-a1bbcc07ee45 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f7165f75-c89d-4457-a32f-a1bbcc07ee45 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Request method failure captured: Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 37 Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGpT7HDhycSKBwNBA-cXZA3PMefCEMxr_6df4-mlNbFJof9URbLGF6qLLVqVQ2N4MWF0urARbVROjiMJcyFSQrJSGVM05NAL8-jxz7BffL4ZKbEj8GBm3_WTdItg2PntkS2E9ULzgs3nMTcor8t5GBjJId6qlCrZIVDGG3LQJkDQSQY Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 3368577bc381452fba1e63525293dd8f Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3368577bc381452fba1e63525293dd8f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3368577bc381452fba1e63525293dd8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3368577bc381452fba1e63525293dd8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3368577bc381452fba1e63525293dd8f"}]}] Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 3368577bc381452fba1e63525293dd8f Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1330594175 Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersAdminNegativeTestJSON-1330594175-project-admin Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: d048273dae0840238da50cca18cb36c4 Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1330594175-project-admin Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: {"os-resetState": {"state": "error"}} Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 999 could not be found. Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:02.507607 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:55:02.515094 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:55:02.515094 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 10 18:55:02.515094 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:02.515094 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f7165f75-c89d-4457-a32f-a1bbcc07ee45 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:55:02.515094 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f7165f75-c89d-4457-a32f-a1bbcc07ee45 tempest-ServersAdminNegativeTestJSON-1330594175 tempest-ServersAdminNegativeTestJSON-1330594175-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.016983 Oct 10 18:55:02.515094 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 662/1478] 10.222.0.43 () {60 vars in 1179 bytes} [Mon Oct 10 18:55:02 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:55:02.520072 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fb19de29-85f0-4768-9f92-3b439be6a2f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:02.520888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fb19de29-85f0-4768-9f92-3b439be6a2f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:02.539484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb19de29-85f0-4768-9f92-3b439be6a2f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:02.539982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb19de29-85f0-4768-9f92-3b439be6a2f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:02.541456 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb19de29-85f0-4768-9f92-3b439be6a2f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:02.545886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb19de29-85f0-4768-9f92-3b439be6a2f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:02.546604 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb19de29-85f0-4768-9f92-3b439be6a2f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:02.547371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb19de29-85f0-4768-9f92-3b439be6a2f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:02.622673 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fb19de29-85f0-4768-9f92-3b439be6a2f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:55:02.703459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6100b1fc-290b-4514-832a-3f4820020073 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:02.704887 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6100b1fc-290b-4514-832a-3f4820020073 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:02.714314 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6100b1fc-290b-4514-832a-3f4820020073 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:02.715080 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6100b1fc-290b-4514-832a-3f4820020073 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:02.715783 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6100b1fc-290b-4514-832a-3f4820020073 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:02.717140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6100b1fc-290b-4514-832a-3f4820020073 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:02.717829 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6100b1fc-290b-4514-832a-3f4820020073 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:02.719482 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6100b1fc-290b-4514-832a-3f4820020073 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:02.966692 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fb19de29-85f0-4768-9f92-3b439be6a2f3 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 204 len: 0 microversion: 2.1 time: 0.449968 Oct 10 18:55:02.967599 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 817/1479] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:55:02 2022] DELETE /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:55:02.979046 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-857ad16b-e711-463f-8ff6-dae1354758b9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:02.979980 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-857ad16b-e711-463f-8ff6-dae1354758b9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 24f13450-d68f-4d4a-a1fd-c2da9dfd523f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:03.018315 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-857ad16b-e711-463f-8ff6-dae1354758b9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:03.021220 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-857ad16b-e711-463f-8ff6-dae1354758b9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:03.021836 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-857ad16b-e711-463f-8ff6-dae1354758b9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:03.022582 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-857ad16b-e711-463f-8ff6-dae1354758b9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:03.023050 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-857ad16b-e711-463f-8ff6-dae1354758b9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:03.023482 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-857ad16b-e711-463f-8ff6-dae1354758b9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:03.098562 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-857ad16b-e711-463f-8ff6-dae1354758b9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:03.099680 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-857ad16b-e711-463f-8ff6-dae1354758b9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:03.100648 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-857ad16b-e711-463f-8ff6-dae1354758b9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:03.106039 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-857ad16b-e711-463f-8ff6-dae1354758b9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lazy-loading 'fault' on Instance uuid 24f13450-d68f-4d4a-a1fd-c2da9dfd523f {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:03.269016 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-857ad16b-e711-463f-8ff6-dae1354758b9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:03.281718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6100b1fc-290b-4514-832a-3f4820020073 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:03.284316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:03.306568 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-857ad16b-e711-463f-8ff6-dae1354758b9 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f" status: 200 len: 1308 microversion: 2.1 time: 0.331144 Oct 10 18:55:03.321195 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6100b1fc-290b-4514-832a-3f4820020073 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1494 microversion: 2.1 time: 0.606820 Oct 10 18:55:03.333227 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 663/1480] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:02 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1494 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:55:03.344457 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 818/1481] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:02 2022] GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:03.346333 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b7b004e7-be95-4be4-a8c5-0e308b4ed372 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:03.347263 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b7b004e7-be95-4be4-a8c5-0e308b4ed372 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:03.358204 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b7b004e7-be95-4be4-a8c5-0e308b4ed372 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:03.358957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b7b004e7-be95-4be4-a8c5-0e308b4ed372 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:03.359694 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b7b004e7-be95-4be4-a8c5-0e308b4ed372 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:03.360721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b7b004e7-be95-4be4-a8c5-0e308b4ed372 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:03.361458 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b7b004e7-be95-4be4-a8c5-0e308b4ed372 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:03.362896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b7b004e7-be95-4be4-a8c5-0e308b4ed372 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:03.752497 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b7b004e7-be95-4be4-a8c5-0e308b4ed372 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:03.765913 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b7b004e7-be95-4be4-a8c5-0e308b4ed372 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1468 microversion: 2.1 time: 0.428765 Oct 10 18:55:03.769824 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 664/1482] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:03 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1468 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:04.011476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-51b1d4c2-c1f4-4e91-af60-17d10ebe4fef req-04388de5-8cff-4a6e-9151-310f1aac53d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51effa0d-d131-46be-ae0a-859e231dd233", "name": "network-vif-deleted", "tag": "5bee11d9-0e26-43bf-ae03-9a4ec1c9e853"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:04.031798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-51b1d4c2-c1f4-4e91-af60-17d10ebe4fef req-04388de5-8cff-4a6e-9151-310f1aac53d5 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:04.034789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-51b1d4c2-c1f4-4e91-af60-17d10ebe4fef req-04388de5-8cff-4a6e-9151-310f1aac53d5 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:04.035538 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-51b1d4c2-c1f4-4e91-af60-17d10ebe4fef req-04388de5-8cff-4a6e-9151-310f1aac53d5 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:04.060490 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-51b1d4c2-c1f4-4e91-af60-17d10ebe4fef req-04388de5-8cff-4a6e-9151-310f1aac53d5 service nova] Creating event network-vif-deleted:5bee11d9-0e26-43bf-ae03-9a4ec1c9e853 for instance 51effa0d-d131-46be-ae0a-859e231dd233 on n-h2-860863-1 Oct 10 18:55:04.075135 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-51b1d4c2-c1f4-4e91-af60-17d10ebe4fef req-04388de5-8cff-4a6e-9151-310f1aac53d5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068624 Oct 10 18:55:04.081332 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 819/1483] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:04.351506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3e791498-665c-4b62-8f79-b26b52c10024 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:04.352910 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3e791498-665c-4b62-8f79-b26b52c10024 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 24f13450-d68f-4d4a-a1fd-c2da9dfd523f] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:04.353122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e1630118-6975-4b6b-b20f-e4ac374bcfd9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:04.354012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e1630118-6975-4b6b-b20f-e4ac374bcfd9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:04.366140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1630118-6975-4b6b-b20f-e4ac374bcfd9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:04.366404 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3e791498-665c-4b62-8f79-b26b52c10024 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:04.366877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3e791498-665c-4b62-8f79-b26b52c10024 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:04.367317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3e791498-665c-4b62-8f79-b26b52c10024 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:04.368147 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3e791498-665c-4b62-8f79-b26b52c10024 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:04.368529 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3e791498-665c-4b62-8f79-b26b52c10024 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:04.369520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3e791498-665c-4b62-8f79-b26b52c10024 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:04.369668 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1630118-6975-4b6b-b20f-e4ac374bcfd9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:04.370543 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1630118-6975-4b6b-b20f-e4ac374bcfd9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:04.371639 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1630118-6975-4b6b-b20f-e4ac374bcfd9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:04.388034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1630118-6975-4b6b-b20f-e4ac374bcfd9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:04.390368 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1630118-6975-4b6b-b20f-e4ac374bcfd9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:04.516486 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3e791498-665c-4b62-8f79-b26b52c10024 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:04.518090 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3e791498-665c-4b62-8f79-b26b52c10024 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:04.521494 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3e791498-665c-4b62-8f79-b26b52c10024 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:04.521494 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-3e791498-665c-4b62-8f79-b26b52c10024 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lazy-loading 'fault' on Instance uuid 24f13450-d68f-4d4a-a1fd-c2da9dfd523f {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:04.586598 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3e791498-665c-4b62-8f79-b26b52c10024 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:04.589030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e1630118-6975-4b6b-b20f-e4ac374bcfd9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:04.600805 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3e791498-665c-4b62-8f79-b26b52c10024 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f" status: 200 len: 1308 microversion: 2.1 time: 0.253099 Oct 10 18:55:04.607012 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e1630118-6975-4b6b-b20f-e4ac374bcfd9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1285 microversion: 2.1 time: 0.258861 Oct 10 18:55:04.610074 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 820/1484] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:04 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1285 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:04.610500 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 665/1485] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:04 2022] GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:04.807802 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bee476b1-122b-4144-ab0d-b7f6dadbcdc9 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:04.813319 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bee476b1-122b-4144-ab0d-b7f6dadbcdc9 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:04.825136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bee476b1-122b-4144-ab0d-b7f6dadbcdc9 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:04.825625 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bee476b1-122b-4144-ab0d-b7f6dadbcdc9 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:04.830418 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bee476b1-122b-4144-ab0d-b7f6dadbcdc9 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:04.841797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bee476b1-122b-4144-ab0d-b7f6dadbcdc9 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:04.841797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bee476b1-122b-4144-ab0d-b7f6dadbcdc9 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:04.843560 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bee476b1-122b-4144-ab0d-b7f6dadbcdc9 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:05.143786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bee476b1-122b-4144-ab0d-b7f6dadbcdc9 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:05.159876 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bee476b1-122b-4144-ab0d-b7f6dadbcdc9 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1468 microversion: 2.1 time: 0.367177 Oct 10 18:55:05.161978 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 666/1486] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:04 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1468 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:05.631199 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e461e4ab-f049-4a10-8454-694d137cb817 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:05.637433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e461e4ab-f049-4a10-8454-694d137cb817 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 24f13450-d68f-4d4a-a1fd-c2da9dfd523f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:05.637887 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e1ac996a-728a-43bc-af19-18fa1b2adc87 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:05.638999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e1ac996a-728a-43bc-af19-18fa1b2adc87 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:05.655035 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e461e4ab-f049-4a10-8454-694d137cb817 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:05.658603 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e1ac996a-728a-43bc-af19-18fa1b2adc87 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:05.661160 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e1ac996a-728a-43bc-af19-18fa1b2adc87 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:05.662853 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e461e4ab-f049-4a10-8454-694d137cb817 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:05.663667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e1ac996a-728a-43bc-af19-18fa1b2adc87 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:05.666996 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e461e4ab-f049-4a10-8454-694d137cb817 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:05.673791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e461e4ab-f049-4a10-8454-694d137cb817 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:05.674517 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e1ac996a-728a-43bc-af19-18fa1b2adc87 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:05.675183 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e1ac996a-728a-43bc-af19-18fa1b2adc87 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:05.675847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e461e4ab-f049-4a10-8454-694d137cb817 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:05.676467 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e1ac996a-728a-43bc-af19-18fa1b2adc87 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:05.677167 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e461e4ab-f049-4a10-8454-694d137cb817 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:05.737882 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-e461e4ab-f049-4a10-8454-694d137cb817 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] HTTP exception thrown: Instance 24f13450-d68f-4d4a-a1fd-c2da9dfd523f could not be found. Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e461e4ab-f049-4a10-8454-694d137cb817 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Request method failure captured: Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f HTTP/1.1 Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGm4gi-GigrCCGP4gZ0L6T7bfFulRKFfLM2g8v9pYuIlN-6kcPDxo1dVOtF12HlrUDwYL2ilR3T2CEZskDG5X4WyXTvGaYXSGu6yuVLVcexzys5KE6QRZju-8W5aaKEyioTybqHJ7jCOt5qQoZ1_926e1tP4yBBHEbyJngUytXsHWSU Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: f536cb88016b414298031238fb251097 Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f536cb88016b414298031238fb251097", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f536cb88016b414298031238fb251097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}] Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: f536cb88016b414298031238fb251097 Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c62f3c2582904aa2894aa339e7bb882d Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 24f13450-d68f-4d4a-a1fd-c2da9dfd523f could not be found. Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '24f13450-d68f-4d4a-a1fd-c2da9dfd523f'} Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f13450-d68f-4d4a-a1fd-c2da9dfd523f could not be found. Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f13450-d68f-4d4a-a1fd-c2da9dfd523f could not be found. Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:05.742198 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:05.748375 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:05.748375 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:05.748375 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:05.748375 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:55:05.748375 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:55:05.748375 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f13450-d68f-4d4a-a1fd-c2da9dfd523f could not be found. Oct 10 18:55:05.748375 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:05.751486 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e461e4ab-f049-4a10-8454-694d137cb817 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Returning 404 to user: Instance 24f13450-d68f-4d4a-a1fd-c2da9dfd523f could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:55:05.761089 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e461e4ab-f049-4a10-8454-694d137cb817 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f" status: 404 len: 111 microversion: 2.1 time: 0.133745 Oct 10 18:55:05.765248 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 821/1487] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:05 2022] GET /compute/v2.1/servers/24f13450-d68f-4d4a-a1fd-c2da9dfd523f => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:55:05.771697 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f6c8f016-29a6-4ca5-a703-ac02f526474a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:05.772323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f6c8f016-29a6-4ca5-a703-ac02f526474a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 95b378d3-5727-40a4-b211-c0dbcdbe4d93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:05.798718 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f6c8f016-29a6-4ca5-a703-ac02f526474a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:05.798917 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f6c8f016-29a6-4ca5-a703-ac02f526474a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:05.801883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f6c8f016-29a6-4ca5-a703-ac02f526474a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:05.807455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f6c8f016-29a6-4ca5-a703-ac02f526474a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:05.808124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f6c8f016-29a6-4ca5-a703-ac02f526474a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:05.808628 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e1ac996a-728a-43bc-af19-18fa1b2adc87 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:05.810381 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f6c8f016-29a6-4ca5-a703-ac02f526474a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:05.810742 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e1ac996a-728a-43bc-af19-18fa1b2adc87 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:05.811394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e1ac996a-728a-43bc-af19-18fa1b2adc87 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:05.815550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-e1ac996a-728a-43bc-af19-18fa1b2adc87 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lazy-loading 'fault' on Instance uuid 51effa0d-d131-46be-ae0a-859e231dd233 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-f6c8f016-29a6-4ca5-a703-ac02f526474a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] HTTP exception thrown: Instance 95b378d3-5727-40a4-b211-c0dbcdbe4d93 could not be found. Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f6c8f016-29a6-4ca5-a703-ac02f526474a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Request method failure captured: Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 HTTP/1.1 Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGm4gi-GigrCCGP4gZ0L6T7bfFulRKFfLM2g8v9pYuIlN-6kcPDxo1dVOtF12HlrUDwYL2ilR3T2CEZskDG5X4WyXTvGaYXSGu6yuVLVcexzys5KE6QRZju-8W5aaKEyioTybqHJ7jCOt5qQoZ1_926e1tP4yBBHEbyJngUytXsHWSU Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: f536cb88016b414298031238fb251097 Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f536cb88016b414298031238fb251097", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f536cb88016b414298031238fb251097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}] Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: f536cb88016b414298031238fb251097 Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c62f3c2582904aa2894aa339e7bb882d Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 95b378d3-5727-40a4-b211-c0dbcdbe4d93 could not be found. Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '95b378d3-5727-40a4-b211-c0dbcdbe4d93'} Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b378d3-5727-40a4-b211-c0dbcdbe4d93 could not be found. Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:55:05.861719 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:55:05.866890 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b378d3-5727-40a4-b211-c0dbcdbe4d93 could not be found. Oct 10 18:55:05.866890 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:05.866890 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:05.866890 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:05.866890 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:05.866890 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:05.866890 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:05.866890 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:55:05.866890 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:55:05.866890 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b378d3-5727-40a4-b211-c0dbcdbe4d93 could not be found. Oct 10 18:55:05.866890 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:05.866890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f6c8f016-29a6-4ca5-a703-ac02f526474a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Returning 404 to user: Instance 95b378d3-5727-40a4-b211-c0dbcdbe4d93 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:55:05.866890 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f6c8f016-29a6-4ca5-a703-ac02f526474a tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93" status: 404 len: 111 microversion: 2.1 time: 0.093816 Oct 10 18:55:05.866890 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 822/1488] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:05 2022] GET /compute/v2.1/servers/95b378d3-5727-40a4-b211-c0dbcdbe4d93 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:55:05.900443 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-69dcd0a2-a68e-4e11-9b7b-e50b3223085c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:05.923917 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e1ac996a-728a-43bc-af19-18fa1b2adc87 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:05.936421 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e1ac996a-728a-43bc-af19-18fa1b2adc87 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 200 len: 1305 microversion: 2.1 time: 0.303997 Oct 10 18:55:05.942104 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 667/1489] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:05 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 1305 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:06.039300 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-69dcd0a2-a68e-4e11-9b7b-e50b3223085c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/772e753d-bc05-4a67-86bc-fd8f2257d40d" status: 204 len: 0 microversion: 2.1 time: 0.156803 Oct 10 18:55:06.041055 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 823/1490] 10.222.0.43 () {58 vars in 1266 bytes} [Mon Oct 10 18:55:05 2022] DELETE /compute/v2.1/os-server-groups/772e753d-bc05-4a67-86bc-fd8f2257d40d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:55:06.051014 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b4792023-d322-4242-9fb3-2c839b9d760d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:06.052424 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b4792023-d322-4242-9fb3-2c839b9d760d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:06.060046 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4792023-d322-4242-9fb3-2c839b9d760d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:06.060567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4792023-d322-4242-9fb3-2c839b9d760d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:06.064801 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4792023-d322-4242-9fb3-2c839b9d760d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:06.067831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4792023-d322-4242-9fb3-2c839b9d760d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:06.067831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4792023-d322-4242-9fb3-2c839b9d760d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:06.067831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4792023-d322-4242-9fb3-2c839b9d760d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:06.104243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-1849ce04-2448-4c2e-b6d5-1cd5b8a20ec9 req-13438264-b5bf-4d5a-973f-2eb44e890a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb00752-884b-40f1-b2e5-f6f490f5cf93", "name": "network-vif-deleted", "tag": "5c98fa39-bb29-4e98-b97a-bee8a9c41998"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:06.133036 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1849ce04-2448-4c2e-b6d5-1cd5b8a20ec9 req-13438264-b5bf-4d5a-973f-2eb44e890a4e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:06.133567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1849ce04-2448-4c2e-b6d5-1cd5b8a20ec9 req-13438264-b5bf-4d5a-973f-2eb44e890a4e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:06.134013 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1849ce04-2448-4c2e-b6d5-1cd5b8a20ec9 req-13438264-b5bf-4d5a-973f-2eb44e890a4e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:06.178922 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-1849ce04-2448-4c2e-b6d5-1cd5b8a20ec9 req-13438264-b5bf-4d5a-973f-2eb44e890a4e service nova] Creating event network-vif-deleted:5c98fa39-bb29-4e98-b97a-bee8a9c41998 for instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 on n-h1-860863-1 Oct 10 18:55:06.193176 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-1849ce04-2448-4c2e-b6d5-1cd5b8a20ec9 req-13438264-b5bf-4d5a-973f-2eb44e890a4e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095652 Oct 10 18:55:06.193989 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b4792023-d322-4242-9fb3-2c839b9d760d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:55:06.234217 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 824/1491] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:06.248850 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b5fe6fd9-f1ad-4def-95fd-8a99b37fcc76 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:06.278558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b5fe6fd9-f1ad-4def-95fd-8a99b37fcc76 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:06.308871 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5fe6fd9-f1ad-4def-95fd-8a99b37fcc76 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:06.312741 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5fe6fd9-f1ad-4def-95fd-8a99b37fcc76 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:06.318679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5fe6fd9-f1ad-4def-95fd-8a99b37fcc76 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:06.321560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5fe6fd9-f1ad-4def-95fd-8a99b37fcc76 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:06.327696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5fe6fd9-f1ad-4def-95fd-8a99b37fcc76 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:06.328325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5fe6fd9-f1ad-4def-95fd-8a99b37fcc76 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:06.641702 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:06.726974 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b4792023-d322-4242-9fb3-2c839b9d760d tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 204 len: 0 microversion: 2.1 time: 0.681350 Oct 10 18:55:06.731615 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 668/1492] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:55:06 2022] DELETE /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:55:06.738881 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cd30642e-024f-4710-8dc4-804703e2b7d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:06.741874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cd30642e-024f-4710-8dc4-804703e2b7d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:06.760739 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd30642e-024f-4710-8dc4-804703e2b7d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:06.761436 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd30642e-024f-4710-8dc4-804703e2b7d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:06.761743 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd30642e-024f-4710-8dc4-804703e2b7d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:06.764727 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd30642e-024f-4710-8dc4-804703e2b7d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:06.768311 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd30642e-024f-4710-8dc4-804703e2b7d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:06.769086 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd30642e-024f-4710-8dc4-804703e2b7d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:06.997380 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b5fe6fd9-f1ad-4def-95fd-8a99b37fcc76 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:07.008426 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b5fe6fd9-f1ad-4def-95fd-8a99b37fcc76 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 200 len: 1298 microversion: 2.1 time: 0.770758 Oct 10 18:55:07.011872 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 825/1493] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:06 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 1298 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:07.020410 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fb4f28c9-a321-4da4-9abc-6d21a4ded607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:07.023444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fb4f28c9-a321-4da4-9abc-6d21a4ded607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:07.030327 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cd30642e-024f-4710-8dc4-804703e2b7d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:07.035798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb4f28c9-a321-4da4-9abc-6d21a4ded607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:07.040813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb4f28c9-a321-4da4-9abc-6d21a4ded607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:07.040813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb4f28c9-a321-4da4-9abc-6d21a4ded607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:07.040813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb4f28c9-a321-4da4-9abc-6d21a4ded607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:07.040813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb4f28c9-a321-4da4-9abc-6d21a4ded607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:07.040813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fb4f28c9-a321-4da4-9abc-6d21a4ded607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:07.042576 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cd30642e-024f-4710-8dc4-804703e2b7d8 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1472 microversion: 2.1 time: 0.309275 Oct 10 18:55:07.043916 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 669/1494] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:06 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1472 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:07.070359 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-fb4f28c9-a321-4da4-9abc-6d21a4ded607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fb4f28c9-a321-4da4-9abc-6d21a4ded607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 HTTP/1.1 Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '51effa0d-d131-46be-ae0a-859e231dd233'} Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:07.073456 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:07.078359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:07.078359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:07.078359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:07.078359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:55:07.078359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:55:07.078359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:55:07.078359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:07.078359 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fb4f28c9-a321-4da4-9abc-6d21a4ded607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:55:07.078359 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fb4f28c9-a321-4da4-9abc-6d21a4ded607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 404 len: 111 microversion: 2.1 time: 0.057400 Oct 10 18:55:07.093792 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 826/1495] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:07 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:55:07.245319 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1304504167", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "737898c7-94e7-46dc-b9d9-724fb5cc9d52"}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:07.320713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] validate_networks() for [('737898c7-94e7-46dc-b9d9-724fb5cc9d52', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:55:07.984254 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:55:07.985613 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:55:07.986378 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:55:07.987045 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:55:07.987694 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:55:07.999557 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:08.000519 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:08.001100 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:08.001964 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:08.002560 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:08.003734 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:08.026900 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Getting quotas for project c5d5fb01be0c409d98c222551a2c0e2e. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:55:08.034528 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Getting quotas for user afedfd9cc5b241ad97e27f6e911244a1 and project c5d5fb01be0c409d98c222551a2c0e2e. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:55:08.039434 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b5f528c2-f550-4ac0-aad9-99eddaa0a69e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:08.041263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b5f528c2-f550-4ac0-aad9-99eddaa0a69e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: cfb00752-884b-40f1-b2e5-f6f490f5cf93] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:08.051426 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:55:08.054101 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:55:08.054444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5f528c2-f550-4ac0-aad9-99eddaa0a69e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:08.054932 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5f528c2-f550-4ac0-aad9-99eddaa0a69e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:08.055583 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5f528c2-f550-4ac0-aad9-99eddaa0a69e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:08.057348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5f528c2-f550-4ac0-aad9-99eddaa0a69e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:08.058187 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5f528c2-f550-4ac0-aad9-99eddaa0a69e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:08.060084 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5f528c2-f550-4ac0-aad9-99eddaa0a69e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:08.087964 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-b5f528c2-f550-4ac0-aad9-99eddaa0a69e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] HTTP exception thrown: Instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 could not be found. Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b5f528c2-f550-4ac0-aad9-99eddaa0a69e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Request method failure captured: Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 HTTP/1.1 Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGpR52Yg-X1Qz2pyQe8P_4LjMSYztDlnNdn6P86YVkbMMoy3P84OWWb5UbbvcFLEtOqVCdS6dbTlexdOf7Ut7OcvTDux7LYjX9TzxHo0hPmDLcVtc67IDVmE-pFykwoqgBpgWl0ifI6tPCWT0tz_9AOAb6y_2aFr5cdZsA7JH5eJRyM Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: af3bdebcbf8c4bfe845090db416be09d Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-482816096 Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_af3bdebcbf8c4bfe845090db416be09d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/af3bdebcbf8c4bfe845090db416be09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/af3bdebcbf8c4bfe845090db416be09d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/af3bdebcbf8c4bfe845090db416be09d"}]}] Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersAdminNegativeTestJSON-482816096 Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: af3bdebcbf8c4bfe845090db416be09d Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-482816096 Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersAdminNegativeTestJSON-482816096-project Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 98d0928b54084f00a6c1cbf52ebc0a2a Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersAdminNegativeTestJSON-482816096-project Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 could not be found. Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'cfb00752-884b-40f1-b2e5-f6f490f5cf93'} Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 could not be found. Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 could not be found. Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:08.090103 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:08.096717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:08.096717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:08.096717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:08.096717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:08.096717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:55:08.096717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:55:08.096717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 could not be found. Oct 10 18:55:08.096717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:08.096717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b5f528c2-f550-4ac0-aad9-99eddaa0a69e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Returning 404 to user: Instance cfb00752-884b-40f1-b2e5-f6f490f5cf93 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:55:08.096717 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b5f528c2-f550-4ac0-aad9-99eddaa0a69e tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93" status: 404 len: 111 microversion: 2.1 time: 0.057581 Oct 10 18:55:08.096717 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 827/1496] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:08 2022] GET /compute/v2.1/servers/cfb00752-884b-40f1-b2e5-f6f490f5cf93 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:55:08.100958 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-66c86108-2302-4657-a681-de8770eb3923 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:08.101776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-66c86108-2302-4657-a681-de8770eb3923 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:08.108498 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-66c86108-2302-4657-a681-de8770eb3923 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:08.109259 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-66c86108-2302-4657-a681-de8770eb3923 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:08.109874 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-66c86108-2302-4657-a681-de8770eb3923 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:08.110746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-66c86108-2302-4657-a681-de8770eb3923 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:08.111363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-66c86108-2302-4657-a681-de8770eb3923 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:08.111955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-66c86108-2302-4657-a681-de8770eb3923 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:08.168900 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d339f5f0-3757-458b-97ff-f519c4f8d9a2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928166 Oct 10 18:55:08.170166 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 670/1497] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:55:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 18:55:08.175192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6cd1c1bc-5be5-4412-98c5-fa2920307334 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:08.175874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6cd1c1bc-5be5-4412-98c5-fa2920307334 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:08.183577 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6cd1c1bc-5be5-4412-98c5-fa2920307334 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:08.184324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6cd1c1bc-5be5-4412-98c5-fa2920307334 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:08.184795 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6cd1c1bc-5be5-4412-98c5-fa2920307334 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:08.190927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6cd1c1bc-5be5-4412-98c5-fa2920307334 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:08.190927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6cd1c1bc-5be5-4412-98c5-fa2920307334 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:08.190927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6cd1c1bc-5be5-4412-98c5-fa2920307334 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:08.240320 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6cd1c1bc-5be5-4412-98c5-fa2920307334 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:55:08.464715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-66c86108-2302-4657-a681-de8770eb3923 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:08.472268 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-66c86108-2302-4657-a681-de8770eb3923 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1472 microversion: 2.1 time: 0.375949 Oct 10 18:55:08.472887 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 828/1498] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:08 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1472 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:08.478054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bcc3a07f-9105-47ec-907f-603d8d22f5d8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:08.478858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bcc3a07f-9105-47ec-907f-603d8d22f5d8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:08.583481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bcc3a07f-9105-47ec-907f-603d8d22f5d8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:08.600596 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6cd1c1bc-5be5-4412-98c5-fa2920307334 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 204 len: 0 microversion: 2.1 time: 0.428438 Oct 10 18:55:08.602015 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 671/1499] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:55:08 2022] DELETE /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:55:08.605378 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bcc3a07f-9105-47ec-907f-603d8d22f5d8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1215 microversion: 2.1 time: 0.125573 Oct 10 18:55:08.608913 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 829/1500] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:08 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:08.620890 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d42d331e-5c7e-4cb9-89e3-5f67f5b56eed tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:08.621950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d42d331e-5c7e-4cb9-89e3-5f67f5b56eed tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:08.629338 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d42d331e-5c7e-4cb9-89e3-5f67f5b56eed tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:08.629912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d42d331e-5c7e-4cb9-89e3-5f67f5b56eed tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:08.630572 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d42d331e-5c7e-4cb9-89e3-5f67f5b56eed tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:08.631529 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d42d331e-5c7e-4cb9-89e3-5f67f5b56eed tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:08.632058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d42d331e-5c7e-4cb9-89e3-5f67f5b56eed tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:08.632578 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d42d331e-5c7e-4cb9-89e3-5f67f5b56eed tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:08.919229 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d42d331e-5c7e-4cb9-89e3-5f67f5b56eed tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:08.937380 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d42d331e-5c7e-4cb9-89e3-5f67f5b56eed tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1477 microversion: 2.1 time: 0.322416 Oct 10 18:55:08.938268 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 672/1501] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:08 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1477 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:09.495280 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4ad01fac-dec3-4f98-b8d1-18097c6be7db tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:09.496758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4ad01fac-dec3-4f98-b8d1-18097c6be7db tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:09.510010 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ad01fac-dec3-4f98-b8d1-18097c6be7db tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:09.510591 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ad01fac-dec3-4f98-b8d1-18097c6be7db tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:09.511025 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ad01fac-dec3-4f98-b8d1-18097c6be7db tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:09.528251 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ad01fac-dec3-4f98-b8d1-18097c6be7db tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:09.530642 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ad01fac-dec3-4f98-b8d1-18097c6be7db tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:09.534069 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ad01fac-dec3-4f98-b8d1-18097c6be7db tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:09.726853 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-d0d27edc-183e-47d6-a282-439fbf30ded5 req-24c04d2b-1cd7-4c90-8578-7a2d7d87f31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bbc9663-3d8f-4bdf-a8a3-9398530d7415", "name": "network-vif-deleted", "tag": "00715349-eae5-4d0a-b9d2-6de287066e04"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:09.745340 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d0d27edc-183e-47d6-a282-439fbf30ded5 req-24c04d2b-1cd7-4c90-8578-7a2d7d87f31d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:09.748073 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d0d27edc-183e-47d6-a282-439fbf30ded5 req-24c04d2b-1cd7-4c90-8578-7a2d7d87f31d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:09.749683 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d0d27edc-183e-47d6-a282-439fbf30ded5 req-24c04d2b-1cd7-4c90-8578-7a2d7d87f31d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:09.752000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4ad01fac-dec3-4f98-b8d1-18097c6be7db tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:09.815231 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4ad01fac-dec3-4f98-b8d1-18097c6be7db tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1430 microversion: 2.1 time: 0.320010 Oct 10 18:55:09.816079 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 673/1502] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:09 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1430 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:55:09.843788 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f0a68bbb-07d9-4edd-ab47-45b4813a2c69 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:09.849080 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f0a68bbb-07d9-4edd-ab47-45b4813a2c69 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:09.853979 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-d0d27edc-183e-47d6-a282-439fbf30ded5 req-24c04d2b-1cd7-4c90-8578-7a2d7d87f31d service nova] Creating event network-vif-deleted:00715349-eae5-4d0a-b9d2-6de287066e04 for instance 1bbc9663-3d8f-4bdf-a8a3-9398530d7415 on n-h2-860863-1 Oct 10 18:55:09.864861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0a68bbb-07d9-4edd-ab47-45b4813a2c69 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:09.865357 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0a68bbb-07d9-4edd-ab47-45b4813a2c69 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:09.865789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0a68bbb-07d9-4edd-ab47-45b4813a2c69 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:09.866496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0a68bbb-07d9-4edd-ab47-45b4813a2c69 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:09.866949 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0a68bbb-07d9-4edd-ab47-45b4813a2c69 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:09.869616 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0a68bbb-07d9-4edd-ab47-45b4813a2c69 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:09.871639 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-d0d27edc-183e-47d6-a282-439fbf30ded5 req-24c04d2b-1cd7-4c90-8578-7a2d7d87f31d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.497615 Oct 10 18:55:09.872252 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 830/1503] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:09.964155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-775ddd2a-1cfd-4da4-9fbc-6873e7a22772 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:09.964955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-775ddd2a-1cfd-4da4-9fbc-6873e7a22772 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:09.977539 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-775ddd2a-1cfd-4da4-9fbc-6873e7a22772 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:09.978761 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-775ddd2a-1cfd-4da4-9fbc-6873e7a22772 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:09.985084 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-775ddd2a-1cfd-4da4-9fbc-6873e7a22772 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:09.985979 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-775ddd2a-1cfd-4da4-9fbc-6873e7a22772 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:09.989215 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-775ddd2a-1cfd-4da4-9fbc-6873e7a22772 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:09.989906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-775ddd2a-1cfd-4da4-9fbc-6873e7a22772 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:10.051552 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f0a68bbb-07d9-4edd-ab47-45b4813a2c69 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:10.064915 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f0a68bbb-07d9-4edd-ab47-45b4813a2c69 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1219 microversion: 2.1 time: 0.247856 Oct 10 18:55:10.065801 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 674/1504] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:09 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1219 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:10.154551 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-90fae0f0-ba86-41fc-9506-a7707e68476e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:10.155185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-90fae0f0-ba86-41fc-9506-a7707e68476e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:10.169286 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90fae0f0-ba86-41fc-9506-a7707e68476e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:10.170782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90fae0f0-ba86-41fc-9506-a7707e68476e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:10.171269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90fae0f0-ba86-41fc-9506-a7707e68476e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:10.172056 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90fae0f0-ba86-41fc-9506-a7707e68476e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:10.174750 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90fae0f0-ba86-41fc-9506-a7707e68476e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:10.177892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90fae0f0-ba86-41fc-9506-a7707e68476e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:10.279417 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-775ddd2a-1cfd-4da4-9fbc-6873e7a22772 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:10.289930 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-775ddd2a-1cfd-4da4-9fbc-6873e7a22772 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1477 microversion: 2.1 time: 0.330624 Oct 10 18:55:10.291256 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 831/1505] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:09 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1477 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:55:10.501076 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-90fae0f0-ba86-41fc-9506-a7707e68476e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid 96d79eab-1807-4467-b325-fe5f723ac559 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:10.536484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-32b1a943-31d7-409e-a759-3c627ca36067 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:10.543017 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-32b1a943-31d7-409e-a759-3c627ca36067 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:10.546832 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-32b1a943-31d7-409e-a759-3c627ca36067 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Searching by: {'deleted': False, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:55:10.560101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32b1a943-31d7-409e-a759-3c627ca36067 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:10.560643 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32b1a943-31d7-409e-a759-3c627ca36067 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:10.561081 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32b1a943-31d7-409e-a759-3c627ca36067 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:10.569460 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-90fae0f0-ba86-41fc-9506-a7707e68476e tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 2344 microversion: 2.25 time: 0.419181 Oct 10 18:55:10.574807 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32b1a943-31d7-409e-a759-3c627ca36067 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:10.575556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32b1a943-31d7-409e-a759-3c627ca36067 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:10.578862 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32b1a943-31d7-409e-a759-3c627ca36067 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:10.582071 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 675/1506] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:10 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 2344 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:10.601037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b34f81bf-1ee2-4197-b487-1a3025b502f1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:10.617105 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b34f81bf-1ee2-4197-b487-1a3025b502f1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:10.623301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b34f81bf-1ee2-4197-b487-1a3025b502f1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:10.628632 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-32b1a943-31d7-409e-a759-3c627ca36067 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 18:55:10.630392 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b34f81bf-1ee2-4197-b487-1a3025b502f1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:10.637487 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b34f81bf-1ee2-4197-b487-1a3025b502f1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:10.641451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b34f81bf-1ee2-4197-b487-1a3025b502f1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:10.645045 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b34f81bf-1ee2-4197-b487-1a3025b502f1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:10.706656 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-32b1a943-31d7-409e-a759-3c627ca36067 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.173872 Oct 10 18:55:10.707256 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 832/1507] 10.222.0.43 () {58 vars in 1125 bytes} [Mon Oct 10 18:55:10 2022] GET /compute/v2.1/servers => generated 333 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:55:10.715733 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b34f81bf-1ee2-4197-b487-1a3025b502f1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.120555 Oct 10 18:55:10.719213 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 676/1508] 10.222.0.43 () {60 vars in 1217 bytes} [Mon Oct 10 18:55:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:55:10.747690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:10.755057 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:10.763875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Searching by: {'deleted': False, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 18:55:10.787977 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:10.793270 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:10.793734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:10.794547 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:10.795005 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:10.795431 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:10.861269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 18:55:10.864809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d8283099-e8e2-467c-9869-c174d71d5962 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:10.864809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d8283099-e8e2-467c-9869-c174d71d5962 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:10.873023 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:10.880038 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8283099-e8e2-467c-9869-c174d71d5962 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:10.880274 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8283099-e8e2-467c-9869-c174d71d5962 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:10.885146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8283099-e8e2-467c-9869-c174d71d5962 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:10.885971 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8283099-e8e2-467c-9869-c174d71d5962 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:10.886449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8283099-e8e2-467c-9869-c174d71d5962 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:10.886875 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8283099-e8e2-467c-9869-c174d71d5962 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:10.953420 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:10.960265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:10.997546 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8283099-e8e2-467c-9869-c174d71d5962 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:11.001179 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8283099-e8e2-467c-9869-c174d71d5962 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:11.001843 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d8283099-e8e2-467c-9869-c174d71d5962 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:11.002492 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-d8283099-e8e2-467c-9869-c174d71d5962 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lazy-loading 'fault' on Instance uuid 1bbc9663-3d8f-4bdf-a8a3-9398530d7415 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:11.011723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:11.016567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:11.018292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:11.147349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d8283099-e8e2-467c-9869-c174d71d5962 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62f3c2582904aa2894aa339e7bb882d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f536cb88016b414298031238fb251097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:11.156182 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d8283099-e8e2-467c-9869-c174d71d5962 tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 200 len: 1306 microversion: 2.1 time: 0.308633 Oct 10 18:55:11.157061 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 677/1509] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:10 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 1306 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:11.178686 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-63dd2ab8-6ed1-436e-9d02-00b37fe9ec84 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:11.180124 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-63dd2ab8-6ed1-436e-9d02-00b37fe9ec84 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:11.196989 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dd2ab8-6ed1-436e-9d02-00b37fe9ec84 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:11.201330 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dd2ab8-6ed1-436e-9d02-00b37fe9ec84 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:11.202061 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dd2ab8-6ed1-436e-9d02-00b37fe9ec84 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:11.202837 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dd2ab8-6ed1-436e-9d02-00b37fe9ec84 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:11.203390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dd2ab8-6ed1-436e-9d02-00b37fe9ec84 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:11.203821 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dd2ab8-6ed1-436e-9d02-00b37fe9ec84 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:11.366168 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-63dd2ab8-6ed1-436e-9d02-00b37fe9ec84 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:11.405470 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-63dd2ab8-6ed1-436e-9d02-00b37fe9ec84 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1211 microversion: 2.1 time: 0.239921 Oct 10 18:55:11.407487 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 678/1510] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:11 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1211 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:11.467563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bba4bd04-1524-4249-a7a1-05eadafdf9d0 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:11.467728 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bba4bd04-1524-4249-a7a1-05eadafdf9d0 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:11.486187 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bba4bd04-1524-4249-a7a1-05eadafdf9d0 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:11.492190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bba4bd04-1524-4249-a7a1-05eadafdf9d0 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:11.492190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bba4bd04-1524-4249-a7a1-05eadafdf9d0 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:11.492190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bba4bd04-1524-4249-a7a1-05eadafdf9d0 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:11.496992 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bba4bd04-1524-4249-a7a1-05eadafdf9d0 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:11.498120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bba4bd04-1524-4249-a7a1-05eadafdf9d0 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:11.658086 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b0e870ba-00bc-4884-9be1-eaf0dd36652d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.921837 Oct 10 18:55:11.658086 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 833/1511] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:55:10 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:11.789056 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bba4bd04-1524-4249-a7a1-05eadafdf9d0 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:11.801948 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bba4bd04-1524-4249-a7a1-05eadafdf9d0 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1477 microversion: 2.1 time: 0.392561 Oct 10 18:55:11.803169 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 679/1512] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:11 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1477 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:11.808809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4b3d623b-4fdb-4b75-a030-fb3bf81f40aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:11.817997 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4b3d623b-4fdb-4b75-a030-fb3bf81f40aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013459 Oct 10 18:55:11.819430 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 680/1513] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:55:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:11.887049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-14588238-01d3-485a-808b-9483644b43f0 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "969c853b-6f76-437f-af70-5f687d9b2594"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:11.889613 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-14588238-01d3-485a-808b-9483644b43f0 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:11.898236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-14588238-01d3-485a-808b-9483644b43f0 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:11.899080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-14588238-01d3-485a-808b-9483644b43f0 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:11.899798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-14588238-01d3-485a-808b-9483644b43f0 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:11.901120 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-14588238-01d3-485a-808b-9483644b43f0 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:11.901789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-14588238-01d3-485a-808b-9483644b43f0 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:11.902421 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-14588238-01d3-485a-808b-9483644b43f0 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:12.143928 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c826b182-2a32-4483-8874-22f291fd5961 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:12.145000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c826b182-2a32-4483-8874-22f291fd5961 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:12.166142 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c826b182-2a32-4483-8874-22f291fd5961 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:12.167091 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c826b182-2a32-4483-8874-22f291fd5961 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:12.168807 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c826b182-2a32-4483-8874-22f291fd5961 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:12.171674 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c826b182-2a32-4483-8874-22f291fd5961 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:12.173798 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c826b182-2a32-4483-8874-22f291fd5961 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:12.176052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c826b182-2a32-4483-8874-22f291fd5961 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:12.252933 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c826b182-2a32-4483-8874-22f291fd5961 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:55:12.299790 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-14588238-01d3-485a-808b-9483644b43f0 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] HTTP exception thrown: Volume 969c853b-6f76-437f-af70-5f687d9b2594 could not be found. Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-14588238-01d3-485a-808b-9483644b43f0 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Request method failure captured: Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: request: PUT /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments/cd51244e-c9d2-48f6-9648-4cc85eefbdd8 HTTP/1.1 Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 74 Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGov0ZJ5ZX9PpJVZXDwy1L8KC6BkNAAKrUvL7YyGaRBw0LGWGNmcBZhvdBcuzfNATyS65KVnUuuWYMBblmD_rTSXtMYX5OOVWOaJLsNX2FW6-bWYAXxSm7FIA8OnHjZIfbkPr7A9HLzPmZKVBBjnFjHXF6BcBGdMnxvm4Bv3_QfqIuQ Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: d1939d4e7b974c178c3e5d191df3d6f6 Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-VolumesAdminNegativeTest-555995593 Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader,admin Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader,admin Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d1939d4e7b974c178c3e5d191df3d6f6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d1939d4e7b974c178c3e5d191df3d6f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1939d4e7b974c178c3e5d191df3d6f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1939d4e7b974c178c3e5d191df3d6f6"}]}] Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-VolumesAdminNegativeTest-555995593 Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: d1939d4e7b974c178c3e5d191df3d6f6 Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-555995593 Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-VolumesAdminNegativeTest-555995593-project-admin Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 43406c14b23a4163bad7d8faf7a4645a Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-VolumesAdminNegativeTest-555995593-project-admin Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: {"volumeAttachment": {"volumeId": "969c853b-6f76-437f-af70-5f687d9b2594"}} Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: exception: Volume 969c853b-6f76-437f-af70-5f687d9b2594 could not be found. Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'server_id': 'bc84705b-369f-4b67-a7ad-4cb62ba09d40', 'id': 'cd51244e-c9d2-48f6-9648-4cc85eefbdd8', 'body': {'volumeAttachment': {'volumeId': '969c853b-6f76-437f-af70-5f687d9b2594'}}} Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 969c853b-6f76-437f-af70-5f687d9b2594 could not be found. (HTTP 404) (Request-ID: req-42e117fe-3be0-4ae5-822f-3c1f8c2c0fdb) Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 18:55:12.302107 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 969c853b-6f76-437f-af70-5f687d9b2594 could not be found. Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 969c853b-6f76-437f-af70-5f687d9b2594 could not be found. Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 969c853b-6f76-437f-af70-5f687d9b2594 could not be found. Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-14588238-01d3-485a-808b-9483644b43f0 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Returning 400 to user: Volume 969c853b-6f76-437f-af70-5f687d9b2594 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:55:12.307835 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-14588238-01d3-485a-808b-9483644b43f0 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] 10.222.0.43 "PUT /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments/cd51244e-c9d2-48f6-9648-4cc85eefbdd8" status: 400 len: 107 microversion: 2.1 time: 0.657329 Oct 10 18:55:12.312510 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 834/1514] 10.222.0.43 () {60 vars in 1433 bytes} [Mon Oct 10 18:55:11 2022] PUT /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments/cd51244e-c9d2-48f6-9648-4cc85eefbdd8 => generated 107 bytes in 663 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:55:12.320831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ce5d0cba-6b07-4291-a6cb-30d44293935c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:12.328802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ce5d0cba-6b07-4291-a6cb-30d44293935c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] [instance: 1bbc9663-3d8f-4bdf-a8a3-9398530d7415] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:12.381879 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ce5d0cba-6b07-4291-a6cb-30d44293935c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:12.384552 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ce5d0cba-6b07-4291-a6cb-30d44293935c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:12.387745 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ce5d0cba-6b07-4291-a6cb-30d44293935c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:12.392222 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ce5d0cba-6b07-4291-a6cb-30d44293935c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:12.392762 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ce5d0cba-6b07-4291-a6cb-30d44293935c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:12.393208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ce5d0cba-6b07-4291-a6cb-30d44293935c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:12.481818 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-ce5d0cba-6b07-4291-a6cb-30d44293935c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] HTTP exception thrown: Instance 1bbc9663-3d8f-4bdf-a8a3-9398530d7415 could not be found. Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ce5d0cba-6b07-4291-a6cb-30d44293935c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Request method failure captured: Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 HTTP/1.1 Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGm4gi-GigrCCGP4gZ0L6T7bfFulRKFfLM2g8v9pYuIlN-6kcPDxo1dVOtF12HlrUDwYL2ilR3T2CEZskDG5X4WyXTvGaYXSGu6yuVLVcexzys5KE6QRZju-8W5aaKEyioTybqHJ7jCOt5qQoZ1_926e1tP4yBBHEbyJngUytXsHWSU Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: f536cb88016b414298031238fb251097 Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f536cb88016b414298031238fb251097", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f536cb88016b414298031238fb251097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f536cb88016b414298031238fb251097"}]}] Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: f536cb88016b414298031238fb251097 Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1492458308 Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c62f3c2582904aa2894aa339e7bb882d Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersOnMultiNodesTest-1492458308-project Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 1bbc9663-3d8f-4bdf-a8a3-9398530d7415 could not be found. Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '1bbc9663-3d8f-4bdf-a8a3-9398530d7415'} Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bbc9663-3d8f-4bdf-a8a3-9398530d7415 could not be found. Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bbc9663-3d8f-4bdf-a8a3-9398530d7415 could not be found. Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:12.493714 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:12.503723 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:12.503723 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:12.503723 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:12.503723 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:55:12.503723 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:55:12.503723 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bbc9663-3d8f-4bdf-a8a3-9398530d7415 could not be found. Oct 10 18:55:12.503723 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:55:12.503723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ce5d0cba-6b07-4291-a6cb-30d44293935c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] Returning 404 to user: Instance 1bbc9663-3d8f-4bdf-a8a3-9398530d7415 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:55:12.503723 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ce5d0cba-6b07-4291-a6cb-30d44293935c tempest-ServersOnMultiNodesTest-1492458308 tempest-ServersOnMultiNodesTest-1492458308-project] 10.222.0.43 "GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415" status: 404 len: 111 microversion: 2.1 time: 0.179378 Oct 10 18:55:12.503723 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 835/1515] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:12 2022] GET /compute/v2.1/servers/1bbc9663-3d8f-4bdf-a8a3-9398530d7415 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:55:12.509495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-64153fdb-931b-4021-9764-8c4648251ada req-505c977a-2aba-4a12-bfdd-92308a0b3ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5365436c-bee1-4eba-8561-14ce05700e6e", "name": "network-vif-deleted", "tag": "86796ad0-424f-455d-9477-87ec669e0c56"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:12.535078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-64153fdb-931b-4021-9764-8c4648251ada req-505c977a-2aba-4a12-bfdd-92308a0b3ed8 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:12.541598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-64153fdb-931b-4021-9764-8c4648251ada req-505c977a-2aba-4a12-bfdd-92308a0b3ed8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:12.542467 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-64153fdb-931b-4021-9764-8c4648251ada req-505c977a-2aba-4a12-bfdd-92308a0b3ed8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:12.567596 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-64153fdb-931b-4021-9764-8c4648251ada req-505c977a-2aba-4a12-bfdd-92308a0b3ed8 service nova] Creating event network-vif-deleted:86796ad0-424f-455d-9477-87ec669e0c56 for instance 5365436c-bee1-4eba-8561-14ce05700e6e on n-h2-860863-1 Oct 10 18:55:12.593144 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-64153fdb-931b-4021-9764-8c4648251ada req-505c977a-2aba-4a12-bfdd-92308a0b3ed8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100893 Oct 10 18:55:12.595580 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 836/1516] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:12.614398 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d9e5145f-e6b4-4345-8844-6d752ad3749c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:12.630134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d9e5145f-e6b4-4345-8844-6d752ad3749c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:12.643126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d9e5145f-e6b4-4345-8844-6d752ad3749c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:12.651653 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d9e5145f-e6b4-4345-8844-6d752ad3749c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:12.655707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d9e5145f-e6b4-4345-8844-6d752ad3749c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:12.655707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d9e5145f-e6b4-4345-8844-6d752ad3749c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:12.655707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d9e5145f-e6b4-4345-8844-6d752ad3749c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:12.655707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d9e5145f-e6b4-4345-8844-6d752ad3749c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:12.818208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d9e5145f-e6b4-4345-8844-6d752ad3749c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:12.827670 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d9e5145f-e6b4-4345-8844-6d752ad3749c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1267 microversion: 2.1 time: 0.217974 Oct 10 18:55:12.829983 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 837/1517] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:12 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:12.851829 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c826b182-2a32-4483-8874-22f291fd5961 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 204 len: 0 microversion: 2.1 time: 0.713476 Oct 10 18:55:12.852868 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 681/1518] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:55:12 2022] DELETE /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:55:12.859687 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0da98df1-e352-488d-9bbf-7ebd1d7d7194 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:12.860654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-43063dd1-b8a9-4d8c-b5ac-e921a0ee9522 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:12.861160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-43063dd1-b8a9-4d8c-b5ac-e921a0ee9522 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:12.861821 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0da98df1-e352-488d-9bbf-7ebd1d7d7194 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:12.872394 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:12.874335 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43063dd1-b8a9-4d8c-b5ac-e921a0ee9522 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:12.875014 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43063dd1-b8a9-4d8c-b5ac-e921a0ee9522 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:12.875634 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43063dd1-b8a9-4d8c-b5ac-e921a0ee9522 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:12.876619 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43063dd1-b8a9-4d8c-b5ac-e921a0ee9522 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:12.877252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43063dd1-b8a9-4d8c-b5ac-e921a0ee9522 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:12.877874 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43063dd1-b8a9-4d8c-b5ac-e921a0ee9522 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:12.882842 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0da98df1-e352-488d-9bbf-7ebd1d7d7194 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:12.886697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0da98df1-e352-488d-9bbf-7ebd1d7d7194 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:12.887263 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0da98df1-e352-488d-9bbf-7ebd1d7d7194 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:12.890027 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0da98df1-e352-488d-9bbf-7ebd1d7d7194 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:12.890611 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0da98df1-e352-488d-9bbf-7ebd1d7d7194 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:12.893050 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0da98df1-e352-488d-9bbf-7ebd1d7d7194 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:13.038166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0da98df1-e352-488d-9bbf-7ebd1d7d7194 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:13.041609 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0da98df1-e352-488d-9bbf-7ebd1d7d7194 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:13.044163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0da98df1-e352-488d-9bbf-7ebd1d7d7194 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:13.044894 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-0da98df1-e352-488d-9bbf-7ebd1d7d7194 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lazy-loading 'fault' on Instance uuid 5365436c-bee1-4eba-8561-14ce05700e6e {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:13.120323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-43063dd1-b8a9-4d8c-b5ac-e921a0ee9522 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lazy-loading 'services' on Instance uuid bc84705b-369f-4b67-a7ad-4cb62ba09d40 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:13.142570 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0da98df1-e352-488d-9bbf-7ebd1d7d7194 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:13.155383 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0da98df1-e352-488d-9bbf-7ebd1d7d7194 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1311 microversion: 2.1 time: 0.299633 Oct 10 18:55:13.155553 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 682/1519] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:12 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1311 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:13.163759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bb75d7c4-988a-4078-ad56-e15ded378140 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:13.171509 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bb75d7c4-988a-4078-ad56-e15ded378140 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:13.182586 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb75d7c4-988a-4078-ad56-e15ded378140 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:13.184098 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb75d7c4-988a-4078-ad56-e15ded378140 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:13.185036 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb75d7c4-988a-4078-ad56-e15ded378140 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:13.192062 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb75d7c4-988a-4078-ad56-e15ded378140 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:13.192062 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb75d7c4-988a-4078-ad56-e15ded378140 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:13.192062 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb75d7c4-988a-4078-ad56-e15ded378140 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:13.802622 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-43063dd1-b8a9-4d8c-b5ac-e921a0ee9522 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments/cd51244e-c9d2-48f6-9648-4cc85eefbdd8" status: 202 len: 0 microversion: 2.1 time: 0.950516 Oct 10 18:55:13.803273 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 838/1520] 10.222.0.43 () {58 vars in 1416 bytes} [Mon Oct 10 18:55:12 2022] DELETE /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments/cd51244e-c9d2-48f6-9648-4cc85eefbdd8 => generated 0 bytes in 974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:55:13.827163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bb75d7c4-988a-4078-ad56-e15ded378140 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:13.827965 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a520ba47-6484-4cea-9201-c5ac64c3545d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:13.830623 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a520ba47-6484-4cea-9201-c5ac64c3545d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:13.845895 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bb75d7c4-988a-4078-ad56-e15ded378140 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1700 microversion: 2.1 time: 0.689022 Oct 10 18:55:13.846486 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 683/1521] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:13 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1700 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:13.847113 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a520ba47-6484-4cea-9201-c5ac64c3545d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:13.847966 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a520ba47-6484-4cea-9201-c5ac64c3545d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:13.849117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a520ba47-6484-4cea-9201-c5ac64c3545d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:13.850904 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a520ba47-6484-4cea-9201-c5ac64c3545d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:13.851811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a520ba47-6484-4cea-9201-c5ac64c3545d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:13.853418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a520ba47-6484-4cea-9201-c5ac64c3545d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:13.860887 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-23dafde0-37a8-4e6c-93da-5943de3c50ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:13.864427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-23dafde0-37a8-4e6c-93da-5943de3c50ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:13.880984 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23dafde0-37a8-4e6c-93da-5943de3c50ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:13.886373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23dafde0-37a8-4e6c-93da-5943de3c50ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:13.886373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23dafde0-37a8-4e6c-93da-5943de3c50ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:13.886373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23dafde0-37a8-4e6c-93da-5943de3c50ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:13.886373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23dafde0-37a8-4e6c-93da-5943de3c50ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:13.886373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-23dafde0-37a8-4e6c-93da-5943de3c50ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:14.059106 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a520ba47-6484-4cea-9201-c5ac64c3545d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.237511 Oct 10 18:55:14.067842 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 839/1522] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:55:13 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments => generated 197 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:14.213955 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-23dafde0-37a8-4e6c-93da-5943de3c50ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:14.224555 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-23dafde0-37a8-4e6c-93da-5943de3c50ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1285 microversion: 2.1 time: 0.369562 Oct 10 18:55:14.232651 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 684/1523] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:13 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1285 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:14.248173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-407de85d-de90-4afe-97b7-72c25990c93c tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:14.248173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-407de85d-de90-4afe-97b7-72c25990c93c tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:14.272765 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-407de85d-de90-4afe-97b7-72c25990c93c tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:14.273282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-407de85d-de90-4afe-97b7-72c25990c93c tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:14.273728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-407de85d-de90-4afe-97b7-72c25990c93c tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:14.274461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-407de85d-de90-4afe-97b7-72c25990c93c tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:14.281395 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-407de85d-de90-4afe-97b7-72c25990c93c tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:14.289114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-407de85d-de90-4afe-97b7-72c25990c93c tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:14.451637 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-407de85d-de90-4afe-97b7-72c25990c93c tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:14.452148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-407de85d-de90-4afe-97b7-72c25990c93c tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:14.452613 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-407de85d-de90-4afe-97b7-72c25990c93c tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:14.453079 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-407de85d-de90-4afe-97b7-72c25990c93c tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lazy-loading 'fault' on Instance uuid 5365436c-bee1-4eba-8561-14ce05700e6e {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:14.876372 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8b6d86f3-711d-47d0-ab8d-af0b409f342c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:14.877358 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8b6d86f3-711d-47d0-ab8d-af0b409f342c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:14.903250 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b6d86f3-711d-47d0-ab8d-af0b409f342c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:14.903752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b6d86f3-711d-47d0-ab8d-af0b409f342c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:14.918629 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b6d86f3-711d-47d0-ab8d-af0b409f342c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:14.921568 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b6d86f3-711d-47d0-ab8d-af0b409f342c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:14.923239 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b6d86f3-711d-47d0-ab8d-af0b409f342c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:14.927099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b6d86f3-711d-47d0-ab8d-af0b409f342c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:15.052808 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-407de85d-de90-4afe-97b7-72c25990c93c tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98d0928b54084f00a6c1cbf52ebc0a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3bdebcbf8c4bfe845090db416be09d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:15.061417 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-407de85d-de90-4afe-97b7-72c25990c93c tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 200 len: 1311 microversion: 2.1 time: 0.881999 Oct 10 18:55:15.065737 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 840/1524] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:14 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 1311 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:15.079281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-17f4f604-af7f-47c4-ab98-2f004c996665 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:15.091130 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-17f4f604-af7f-47c4-ab98-2f004c996665 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:15.125018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17f4f604-af7f-47c4-ab98-2f004c996665 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:15.140569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17f4f604-af7f-47c4-ab98-2f004c996665 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:15.142257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17f4f604-af7f-47c4-ab98-2f004c996665 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:15.143236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17f4f604-af7f-47c4-ab98-2f004c996665 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:15.145430 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17f4f604-af7f-47c4-ab98-2f004c996665 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:15.146131 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17f4f604-af7f-47c4-ab98-2f004c996665 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:15.278660 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-17f4f604-af7f-47c4-ab98-2f004c996665 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201900 Oct 10 18:55:15.283912 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 841/1525] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:55:15 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:15.293449 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ebd87c48-bd84-46a8-95af-6bfb3c0ef77f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:15.300479 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ebd87c48-bd84-46a8-95af-6bfb3c0ef77f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:15.319230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ebd87c48-bd84-46a8-95af-6bfb3c0ef77f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:15.319741 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ebd87c48-bd84-46a8-95af-6bfb3c0ef77f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:15.320190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ebd87c48-bd84-46a8-95af-6bfb3c0ef77f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:15.320952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ebd87c48-bd84-46a8-95af-6bfb3c0ef77f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:15.321548 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ebd87c48-bd84-46a8-95af-6bfb3c0ef77f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:15.322007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ebd87c48-bd84-46a8-95af-6bfb3c0ef77f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:15.366673 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8b6d86f3-711d-47d0-ab8d-af0b409f342c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:15.387348 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8b6d86f3-711d-47d0-ab8d-af0b409f342c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1700 microversion: 2.1 time: 0.517315 Oct 10 18:55:15.409393 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 685/1526] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:14 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1700 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:16.024588 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ebd87c48-bd84-46a8-95af-6bfb3c0ef77f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:16.034561 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ebd87c48-bd84-46a8-95af-6bfb3c0ef77f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1273 microversion: 2.1 time: 0.748283 Oct 10 18:55:16.051256 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 842/1527] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:15 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1273 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:16.093368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f2719331-2091-4dec-84e7-84e2e950e498 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:16.094204 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f2719331-2091-4dec-84e7-84e2e950e498 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] [instance: 5365436c-bee1-4eba-8561-14ce05700e6e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:16.118310 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f2719331-2091-4dec-84e7-84e2e950e498 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:16.121053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f2719331-2091-4dec-84e7-84e2e950e498 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:16.122111 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f2719331-2091-4dec-84e7-84e2e950e498 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:16.123631 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f2719331-2091-4dec-84e7-84e2e950e498 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:16.126477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f2719331-2091-4dec-84e7-84e2e950e498 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:16.129781 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f2719331-2091-4dec-84e7-84e2e950e498 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-f2719331-2091-4dec-84e7-84e2e950e498 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] HTTP exception thrown: Instance 5365436c-bee1-4eba-8561-14ce05700e6e could not be found. Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f2719331-2091-4dec-84e7-84e2e950e498 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Request method failure captured: Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e HTTP/1.1 Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGpR52Yg-X1Qz2pyQe8P_4LjMSYztDlnNdn6P86YVkbMMoy3P84OWWb5UbbvcFLEtOqVCdS6dbTlexdOf7Ut7OcvTDux7LYjX9TzxHo0hPmDLcVtc67IDVmE-pFykwoqgBpgWl0ifI6tPCWT0tz_9AOAb6y_2aFr5cdZsA7JH5eJRyM Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: af3bdebcbf8c4bfe845090db416be09d Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-482816096 Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_af3bdebcbf8c4bfe845090db416be09d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/af3bdebcbf8c4bfe845090db416be09d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/af3bdebcbf8c4bfe845090db416be09d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/af3bdebcbf8c4bfe845090db416be09d"}]}] Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersAdminNegativeTestJSON-482816096 Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: af3bdebcbf8c4bfe845090db416be09d Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-482816096 Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersAdminNegativeTestJSON-482816096-project Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 98d0928b54084f00a6c1cbf52ebc0a2a Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersAdminNegativeTestJSON-482816096-project Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 5365436c-bee1-4eba-8561-14ce05700e6e could not be found. Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '5365436c-bee1-4eba-8561-14ce05700e6e'} Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5365436c-bee1-4eba-8561-14ce05700e6e could not be found. Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:55:16.187523 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5365436c-bee1-4eba-8561-14ce05700e6e could not be found. Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5365436c-bee1-4eba-8561-14ce05700e6e could not be found. Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f2719331-2091-4dec-84e7-84e2e950e498 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] Returning 404 to user: Instance 5365436c-bee1-4eba-8561-14ce05700e6e could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f2719331-2091-4dec-84e7-84e2e950e498 tempest-ServersAdminNegativeTestJSON-482816096 tempest-ServersAdminNegativeTestJSON-482816096-project] 10.222.0.43 "GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e" status: 404 len: 111 microversion: 2.1 time: 0.097678 Oct 10 18:55:16.193988 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 686/1528] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:16 2022] GET /compute/v2.1/servers/5365436c-bee1-4eba-8561-14ce05700e6e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:55:16.293559 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b2e05683-9609-417e-9bc5-eb4db5737337 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:16.297205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b2e05683-9609-417e-9bc5-eb4db5737337 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:16.316697 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2e05683-9609-417e-9bc5-eb4db5737337 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:16.327593 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2e05683-9609-417e-9bc5-eb4db5737337 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:16.328336 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2e05683-9609-417e-9bc5-eb4db5737337 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:16.329442 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2e05683-9609-417e-9bc5-eb4db5737337 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:16.332338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2e05683-9609-417e-9bc5-eb4db5737337 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:16.333055 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2e05683-9609-417e-9bc5-eb4db5737337 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:16.421177 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b2e05683-9609-417e-9bc5-eb4db5737337 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132980 Oct 10 18:55:16.422047 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 843/1529] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:55:16 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:16.422530 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5e6e88a9-9c79-4184-8703-af86e461d3c2 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:16.424493 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5e6e88a9-9c79-4184-8703-af86e461d3c2 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:16.435472 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e6e88a9-9c79-4184-8703-af86e461d3c2 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:16.437990 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e6e88a9-9c79-4184-8703-af86e461d3c2 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:16.441844 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e6e88a9-9c79-4184-8703-af86e461d3c2 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:16.444619 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e6e88a9-9c79-4184-8703-af86e461d3c2 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:16.446103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e6e88a9-9c79-4184-8703-af86e461d3c2 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:16.447895 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e6e88a9-9c79-4184-8703-af86e461d3c2 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:16.898804 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-80400fd9-d0cf-4a97-8aaa-139b5b44fd16 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a6222e2-6a92-4a91-b79a-528964c1590c", "device": "/dev/xvdb"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:16.902441 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-80400fd9-d0cf-4a97-8aaa-139b5b44fd16 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:16.943883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80400fd9-d0cf-4a97-8aaa-139b5b44fd16 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:16.944293 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80400fd9-d0cf-4a97-8aaa-139b5b44fd16 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:16.944764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80400fd9-d0cf-4a97-8aaa-139b5b44fd16 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:16.952049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80400fd9-d0cf-4a97-8aaa-139b5b44fd16 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:16.953607 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80400fd9-d0cf-4a97-8aaa-139b5b44fd16 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:16.956171 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80400fd9-d0cf-4a97-8aaa-139b5b44fd16 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:17.001664 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5e6e88a9-9c79-4184-8703-af86e461d3c2 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:17.056252 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5e6e88a9-9c79-4184-8703-af86e461d3c2 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1700 microversion: 2.1 time: 0.634389 Oct 10 18:55:17.085059 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 687/1530] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:16 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1700 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:55:17.111861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0a78258d-9f38-423f-b012-7ef79fd0209e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:17.116435 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0a78258d-9f38-423f-b012-7ef79fd0209e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:17.154768 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0a78258d-9f38-423f-b012-7ef79fd0209e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:17.155284 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0a78258d-9f38-423f-b012-7ef79fd0209e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:17.155721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0a78258d-9f38-423f-b012-7ef79fd0209e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:17.156444 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0a78258d-9f38-423f-b012-7ef79fd0209e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:17.166513 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0a78258d-9f38-423f-b012-7ef79fd0209e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:17.169101 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0a78258d-9f38-423f-b012-7ef79fd0209e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:17.690823 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0a78258d-9f38-423f-b012-7ef79fd0209e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:17.713858 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0a78258d-9f38-423f-b012-7ef79fd0209e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1315 microversion: 2.1 time: 0.626652 Oct 10 18:55:17.714484 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 688/1531] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:17 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:17.721474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2f3a7575-ff1c-4882-af9a-a8bdf4ddd45b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:17.723059 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2f3a7575-ff1c-4882-af9a-a8bdf4ddd45b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:17.746782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2f3a7575-ff1c-4882-af9a-a8bdf4ddd45b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:17.747581 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2f3a7575-ff1c-4882-af9a-a8bdf4ddd45b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:17.748198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2f3a7575-ff1c-4882-af9a-a8bdf4ddd45b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:17.749131 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2f3a7575-ff1c-4882-af9a-a8bdf4ddd45b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:17.749751 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2f3a7575-ff1c-4882-af9a-a8bdf4ddd45b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:17.750354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2f3a7575-ff1c-4882-af9a-a8bdf4ddd45b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:17.833341 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2f3a7575-ff1c-4882-af9a-a8bdf4ddd45b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117727 Oct 10 18:55:17.844618 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 689/1532] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:55:17 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:18.101057 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ceee2ddd-e8b7-4125-996e-a46e274b6c4d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:18.102130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ceee2ddd-e8b7-4125-996e-a46e274b6c4d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:18.114204 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=6 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:18.125054 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ceee2ddd-e8b7-4125-996e-a46e274b6c4d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:18.125561 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ceee2ddd-e8b7-4125-996e-a46e274b6c4d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:18.126005 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ceee2ddd-e8b7-4125-996e-a46e274b6c4d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:18.126729 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ceee2ddd-e8b7-4125-996e-a46e274b6c4d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:18.127192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ceee2ddd-e8b7-4125-996e-a46e274b6c4d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:18.127619 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ceee2ddd-e8b7-4125-996e-a46e274b6c4d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:18.278638 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-80400fd9-d0cf-4a97-8aaa-139b5b44fd16 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "POST /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.384332 Oct 10 18:55:18.280514 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 844/1533] 10.222.0.43 () {62 vars in 1364 bytes} [Mon Oct 10 18:55:16 2022] POST /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments => generated 194 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:55:18.751128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-11d3faf6-dab5-4e65-b35c-b00abf897231 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:18.752323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-11d3faf6-dab5-4e65-b35c-b00abf897231 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:18.769057 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-11d3faf6-dab5-4e65-b35c-b00abf897231 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:18.773245 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ceee2ddd-e8b7-4125-996e-a46e274b6c4d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:18.779809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-11d3faf6-dab5-4e65-b35c-b00abf897231 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:18.786318 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ceee2ddd-e8b7-4125-996e-a46e274b6c4d tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1700 microversion: 2.1 time: 0.689268 Oct 10 18:55:18.787147 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-11d3faf6-dab5-4e65-b35c-b00abf897231 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:18.789055 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-11d3faf6-dab5-4e65-b35c-b00abf897231 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:18.794535 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-11d3faf6-dab5-4e65-b35c-b00abf897231 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:18.796820 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-11d3faf6-dab5-4e65-b35c-b00abf897231 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:18.797247 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 690/1534] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:18 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1700 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:18.856503 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a02f0010-1a20-4070-b4b8-ef412a79be05 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:18.859165 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a02f0010-1a20-4070-b4b8-ef412a79be05 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:18.881529 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a02f0010-1a20-4070-b4b8-ef412a79be05 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:18.900741 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a02f0010-1a20-4070-b4b8-ef412a79be05 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:18.902858 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a02f0010-1a20-4070-b4b8-ef412a79be05 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:18.904082 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a02f0010-1a20-4070-b4b8-ef412a79be05 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:18.905850 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a02f0010-1a20-4070-b4b8-ef412a79be05 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:18.907869 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a02f0010-1a20-4070-b4b8-ef412a79be05 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:19.036905 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a02f0010-1a20-4070-b4b8-ef412a79be05 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183788 Oct 10 18:55:19.042130 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 691/1535] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:55:18 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:19.828666 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-68da78ea-01bf-470e-a8d6-377189dda8ec tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:19.831538 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-68da78ea-01bf-470e-a8d6-377189dda8ec tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:19.841903 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-68da78ea-01bf-470e-a8d6-377189dda8ec tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:19.847384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-68da78ea-01bf-470e-a8d6-377189dda8ec tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:19.849998 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-68da78ea-01bf-470e-a8d6-377189dda8ec tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:19.852133 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-68da78ea-01bf-470e-a8d6-377189dda8ec tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:19.853683 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-68da78ea-01bf-470e-a8d6-377189dda8ec tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:19.856347 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-68da78ea-01bf-470e-a8d6-377189dda8ec tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:20.063590 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-68da78ea-01bf-470e-a8d6-377189dda8ec tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:20.083994 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-68da78ea-01bf-470e-a8d6-377189dda8ec tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1633 microversion: 2.1 time: 0.249702 Oct 10 18:55:20.087178 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 692/1536] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:19 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1633 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:55:20.095015 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-36552d8a-f2de-46dc-a8b8-7ce3d4894cba tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:20.106580 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-36552d8a-f2de-46dc-a8b8-7ce3d4894cba tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:20.141045 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36552d8a-f2de-46dc-a8b8-7ce3d4894cba tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:20.143808 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36552d8a-f2de-46dc-a8b8-7ce3d4894cba tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:20.150639 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36552d8a-f2de-46dc-a8b8-7ce3d4894cba tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:20.153712 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36552d8a-f2de-46dc-a8b8-7ce3d4894cba tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:20.154452 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36552d8a-f2de-46dc-a8b8-7ce3d4894cba tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:20.155534 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36552d8a-f2de-46dc-a8b8-7ce3d4894cba tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:20.221286 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:20.254015 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-11d3faf6-dab5-4e65-b35c-b00abf897231 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:20.281274 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-11d3faf6-dab5-4e65-b35c-b00abf897231 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1315 microversion: 2.1 time: 1.534136 Oct 10 18:55:20.289922 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 845/1537] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:18 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1315 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:20.310137 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-36552d8a-f2de-46dc-a8b8-7ce3d4894cba tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220773 Oct 10 18:55:20.327505 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 693/1538] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:55:20 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments => generated 197 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:21.128139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4d14bb42-3857-4f5c-af0a-f27d8d7b2d66 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:21.129290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4d14bb42-3857-4f5c-af0a-f27d8d7b2d66 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:21.140686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:21.149645 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:21.151591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d14bb42-3857-4f5c-af0a-f27d8d7b2d66 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:21.154870 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d14bb42-3857-4f5c-af0a-f27d8d7b2d66 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:21.158562 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d14bb42-3857-4f5c-af0a-f27d8d7b2d66 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:21.166083 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d14bb42-3857-4f5c-af0a-f27d8d7b2d66 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:21.167192 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d14bb42-3857-4f5c-af0a-f27d8d7b2d66 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:21.169681 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d14bb42-3857-4f5c-af0a-f27d8d7b2d66 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:21.322716 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3b73912c-6eff-47c2-951c-21c7277c086b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:21.324343 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3b73912c-6eff-47c2-951c-21c7277c086b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:21.343619 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=4 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:21.347216 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b73912c-6eff-47c2-951c-21c7277c086b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:21.347695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b73912c-6eff-47c2-951c-21c7277c086b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:21.348131 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b73912c-6eff-47c2-951c-21c7277c086b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:21.360264 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b73912c-6eff-47c2-951c-21c7277c086b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:21.360830 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b73912c-6eff-47c2-951c-21c7277c086b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:21.372846 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b73912c-6eff-47c2-951c-21c7277c086b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:21.596932 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4d14bb42-3857-4f5c-af0a-f27d8d7b2d66 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:21.606727 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4d14bb42-3857-4f5c-af0a-f27d8d7b2d66 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1633 microversion: 2.1 time: 0.484042 Oct 10 18:55:21.638924 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 846/1539] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:21 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1633 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:21.659479 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-39449149-d7a8-49b5-8880-65e29e749340 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:21.684103 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-39449149-d7a8-49b5-8880-65e29e749340 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:21.713673 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39449149-d7a8-49b5-8880-65e29e749340 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:21.724600 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39449149-d7a8-49b5-8880-65e29e749340 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:21.725984 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39449149-d7a8-49b5-8880-65e29e749340 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:21.731349 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39449149-d7a8-49b5-8880-65e29e749340 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:21.736220 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39449149-d7a8-49b5-8880-65e29e749340 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:21.739230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39449149-d7a8-49b5-8880-65e29e749340 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:21.898677 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-39449149-d7a8-49b5-8880-65e29e749340 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.262100 Oct 10 18:55:21.904855 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 847/1540] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:55:21 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments => generated 197 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:21.913904 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3b73912c-6eff-47c2-951c-21c7277c086b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:21.926569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-0c8a532a-ed3d-4994-8043-706c08b340b5 req-f94d49bc-a3b9-4f47-b44d-475785086a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1cd2e32-34ce-4a91-b679-2093d7808de2", "name": "network-vif-deleted", "tag": "4f36482d-b661-45f8-b7dc-97cf9ebb5ad6"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:21.943888 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3b73912c-6eff-47c2-951c-21c7277c086b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1315 microversion: 2.1 time: 0.621013 Oct 10 18:55:21.949932 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 694/1541] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:21 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:21.977764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0c8a532a-ed3d-4994-8043-706c08b340b5 req-f94d49bc-a3b9-4f47-b44d-475785086a2e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:21.978860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0c8a532a-ed3d-4994-8043-706c08b340b5 req-f94d49bc-a3b9-4f47-b44d-475785086a2e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:21.979898 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0c8a532a-ed3d-4994-8043-706c08b340b5 req-f94d49bc-a3b9-4f47-b44d-475785086a2e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:22.015937 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-0c8a532a-ed3d-4994-8043-706c08b340b5 req-f94d49bc-a3b9-4f47-b44d-475785086a2e service nova] Creating event network-vif-deleted:4f36482d-b661-45f8-b7dc-97cf9ebb5ad6 for instance e1cd2e32-34ce-4a91-b679-2093d7808de2 on n-h1-860863-1 Oct 10 18:55:22.025838 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-0c8a532a-ed3d-4994-8043-706c08b340b5 req-f94d49bc-a3b9-4f47-b44d-475785086a2e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118026 Oct 10 18:55:22.030209 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 848/1542] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:22.666044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-28d33602-8ec2-459a-bf01-d9b7fc0e4882 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:22.667790 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-28d33602-8ec2-459a-bf01-d9b7fc0e4882 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:22.690019 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28d33602-8ec2-459a-bf01-d9b7fc0e4882 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:22.691280 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28d33602-8ec2-459a-bf01-d9b7fc0e4882 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:22.692076 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28d33602-8ec2-459a-bf01-d9b7fc0e4882 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:22.693296 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28d33602-8ec2-459a-bf01-d9b7fc0e4882 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:22.694459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28d33602-8ec2-459a-bf01-d9b7fc0e4882 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:22.695863 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28d33602-8ec2-459a-bf01-d9b7fc0e4882 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:22.804486 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28d33602-8ec2-459a-bf01-d9b7fc0e4882 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:22.808244 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28d33602-8ec2-459a-bf01-d9b7fc0e4882 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:22.808902 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-28d33602-8ec2-459a-bf01-d9b7fc0e4882 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:22.809576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-28d33602-8ec2-459a-bf01-d9b7fc0e4882 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lazy-loading 'fault' on Instance uuid e1cd2e32-34ce-4a91-b679-2093d7808de2 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:22.904814 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-28d33602-8ec2-459a-bf01-d9b7fc0e4882 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:22.917847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-474596a3-62f4-4ed4-bd3a-33c91e5b64c8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:22.927736 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-474596a3-62f4-4ed4-bd3a-33c91e5b64c8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:22.935596 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-28d33602-8ec2-459a-bf01-d9b7fc0e4882 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1358 microversion: 2.1 time: 0.273819 Oct 10 18:55:22.949426 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 695/1543] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:22 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:22.969231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-474596a3-62f4-4ed4-bd3a-33c91e5b64c8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:22.971069 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-474596a3-62f4-4ed4-bd3a-33c91e5b64c8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:22.979284 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3814044c-c163-4889-a24e-3abe035eea60 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:22.980185 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-474596a3-62f4-4ed4-bd3a-33c91e5b64c8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:22.982937 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3814044c-c163-4889-a24e-3abe035eea60 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:22.983622 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-474596a3-62f4-4ed4-bd3a-33c91e5b64c8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:22.989447 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-474596a3-62f4-4ed4-bd3a-33c91e5b64c8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:22.991109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-474596a3-62f4-4ed4-bd3a-33c91e5b64c8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:23.006854 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3814044c-c163-4889-a24e-3abe035eea60 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:23.009468 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3814044c-c163-4889-a24e-3abe035eea60 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:23.010246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3814044c-c163-4889-a24e-3abe035eea60 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:23.016841 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3814044c-c163-4889-a24e-3abe035eea60 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:23.018694 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3814044c-c163-4889-a24e-3abe035eea60 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:23.022716 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3814044c-c163-4889-a24e-3abe035eea60 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:23.101335 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:23.121372 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-474596a3-62f4-4ed4-bd3a-33c91e5b64c8 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209504 Oct 10 18:55:23.129900 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 849/1544] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:55:22 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:23.371180 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3814044c-c163-4889-a24e-3abe035eea60 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:23.380525 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3814044c-c163-4889-a24e-3abe035eea60 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1315 microversion: 2.1 time: 0.406160 Oct 10 18:55:23.381395 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 696/1545] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:22 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:55:23.985418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-da4e8932-0745-4f83-91df-ba94e7e635aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:23.987104 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-da4e8932-0745-4f83-91df-ba94e7e635aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:24.027821 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da4e8932-0745-4f83-91df-ba94e7e635aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:24.029188 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da4e8932-0745-4f83-91df-ba94e7e635aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:24.034653 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da4e8932-0745-4f83-91df-ba94e7e635aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:24.036121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da4e8932-0745-4f83-91df-ba94e7e635aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:24.038993 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da4e8932-0745-4f83-91df-ba94e7e635aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:24.039671 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da4e8932-0745-4f83-91df-ba94e7e635aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:24.142191 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-74e260d5-ac69-42b2-b579-559f7ad66e3f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:24.146078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-74e260d5-ac69-42b2-b579-559f7ad66e3f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:24.157410 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-74e260d5-ac69-42b2-b579-559f7ad66e3f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:24.158303 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-74e260d5-ac69-42b2-b579-559f7ad66e3f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:24.158996 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-74e260d5-ac69-42b2-b579-559f7ad66e3f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:24.159967 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-74e260d5-ac69-42b2-b579-559f7ad66e3f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:24.160720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-74e260d5-ac69-42b2-b579-559f7ad66e3f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:24.161384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-74e260d5-ac69-42b2-b579-559f7ad66e3f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:24.178802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da4e8932-0745-4f83-91df-ba94e7e635aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:24.178802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da4e8932-0745-4f83-91df-ba94e7e635aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:24.178802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da4e8932-0745-4f83-91df-ba94e7e635aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:24.192877 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-da4e8932-0745-4f83-91df-ba94e7e635aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lazy-loading 'fault' on Instance uuid e1cd2e32-34ce-4a91-b679-2093d7808de2 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:24.229440 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-74e260d5-ac69-42b2-b579-559f7ad66e3f tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091712 Oct 10 18:55:24.234524 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 697/1546] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:55:24 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:24.239940 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-4e8d6a77-770d-4c6a-bff2-10726ddd5dc1 req-68f47056-a332-44a9-94d5-e056596de8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ab18d87-5b5b-4d03-a0c0-a07a998f411b", "tag": "64f367b9-222a-4fe3-919b-80f6bdc5452d"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:24.251821 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4e8d6a77-770d-4c6a-bff2-10726ddd5dc1 req-68f47056-a332-44a9-94d5-e056596de8d1 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:24.252453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4e8d6a77-770d-4c6a-bff2-10726ddd5dc1 req-68f47056-a332-44a9-94d5-e056596de8d1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:24.253202 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4e8d6a77-770d-4c6a-bff2-10726ddd5dc1 req-68f47056-a332-44a9-94d5-e056596de8d1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:24.282215 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-4e8d6a77-770d-4c6a-bff2-10726ddd5dc1 req-68f47056-a332-44a9-94d5-e056596de8d1 service nova] Creating event network-changed:64f367b9-222a-4fe3-919b-80f6bdc5452d for instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b on n-h2-860863-1 Oct 10 18:55:24.290133 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-4e8d6a77-770d-4c6a-bff2-10726ddd5dc1 req-68f47056-a332-44a9-94d5-e056596de8d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052807 Oct 10 18:55:24.291739 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 698/1547] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:24.342032 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-da4e8932-0745-4f83-91df-ba94e7e635aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2092dd5ed84e414ba0000c3816b7b6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d3b0a2007b41e59c5006778d1b5d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:24.342277 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-da4e8932-0745-4f83-91df-ba94e7e635aa tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 200 len: 1358 microversion: 2.1 time: 0.365086 Oct 10 18:55:24.350108 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 850/1548] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:23 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 1358 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:24.420282 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b5c46c56-d7fb-4516-94d4-d1da35eed59e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:24.421524 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b5c46c56-d7fb-4516-94d4-d1da35eed59e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:24.472269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b5c46c56-d7fb-4516-94d4-d1da35eed59e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:24.474783 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b5c46c56-d7fb-4516-94d4-d1da35eed59e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:24.479182 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b5c46c56-d7fb-4516-94d4-d1da35eed59e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:24.480181 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b5c46c56-d7fb-4516-94d4-d1da35eed59e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:24.482738 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b5c46c56-d7fb-4516-94d4-d1da35eed59e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:24.485769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b5c46c56-d7fb-4516-94d4-d1da35eed59e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:24.956633 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b5c46c56-d7fb-4516-94d4-d1da35eed59e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:24.967534 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b5c46c56-d7fb-4516-94d4-d1da35eed59e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1315 microversion: 2.1 time: 0.561204 Oct 10 18:55:24.981364 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 699/1549] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:24 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:25.201678 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3b8f524b-ae85-4711-b1cf-11dc07180769 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.217671 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3b8f524b-ae85-4711-b1cf-11dc07180769 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.324147 Oct 10 18:55:25.218119 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 851/1550] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:55:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:25.233286 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fea2fd33-3f2d-4bec-a10e-3538c44b4e23 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.244211 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3f8c3d6c-4dbe-4b38-8b07-ce2f68be9327 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.247162 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3f8c3d6c-4dbe-4b38-8b07-ce2f68be9327 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:25.253238 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:25.255367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f8c3d6c-4dbe-4b38-8b07-ce2f68be9327 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:25.256274 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f8c3d6c-4dbe-4b38-8b07-ce2f68be9327 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:25.256915 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f8c3d6c-4dbe-4b38-8b07-ce2f68be9327 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:25.260650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f8c3d6c-4dbe-4b38-8b07-ce2f68be9327 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:25.260650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f8c3d6c-4dbe-4b38-8b07-ce2f68be9327 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:25.260650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f8c3d6c-4dbe-4b38-8b07-ce2f68be9327 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:25.262009 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fea2fd33-3f2d-4bec-a10e-3538c44b4e23 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.032091 Oct 10 18:55:25.265872 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 700/1551] 10.222.0.43 () {58 vars in 1125 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:25.283444 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e2be4916-717d-44e8-aecd-3b0ab753094e tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.295197 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e2be4916-717d-44e8-aecd-3b0ab753094e tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016273 Oct 10 18:55:25.296657 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 701/1552] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:25.300115 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3f8c3d6c-4dbe-4b38-8b07-ce2f68be9327 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060777 Oct 10 18:55:25.300690 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 852/1553] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:25.310206 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-87f34849-4a91-4347-b0f7-9bd766f823d2 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.322166 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-87f34849-4a91-4347-b0f7-9bd766f823d2 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015628 Oct 10 18:55:25.332834 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 702/1554] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:25.336799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-46e54a35-3ed7-474e-8c6b-30c52a22a19d tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.387510 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-45cb9189-5a00-4fd8-9681-b11a042dbc3c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.388970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-45cb9189-5a00-4fd8-9681-b11a042dbc3c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] [instance: e1cd2e32-34ce-4a91-b679-2093d7808de2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:25.398824 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-46e54a35-3ed7-474e-8c6b-30c52a22a19d tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.067486 Oct 10 18:55:25.401232 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45cb9189-5a00-4fd8-9681-b11a042dbc3c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:25.405642 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 853/1555] 10.222.0.43 () {58 vars in 1165 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:55:25.413285 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45cb9189-5a00-4fd8-9681-b11a042dbc3c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:25.416044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45cb9189-5a00-4fd8-9681-b11a042dbc3c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:25.416044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45cb9189-5a00-4fd8-9681-b11a042dbc3c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:25.421349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45cb9189-5a00-4fd8-9681-b11a042dbc3c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:25.422891 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45cb9189-5a00-4fd8-9681-b11a042dbc3c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:25.424958 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d88df26a-9a49-413e-a5ba-87ffee2ea433 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.444194 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d88df26a-9a49-413e-a5ba-87ffee2ea433 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023991 Oct 10 18:55:25.446205 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 854/1556] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:25.468649 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f4dd9f45-4f4b-4f9f-ad3e-59224ec083b9 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.479195 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-45cb9189-5a00-4fd8-9681-b11a042dbc3c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] HTTP exception thrown: Instance e1cd2e32-34ce-4a91-b679-2093d7808de2 could not be found. Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-45cb9189-5a00-4fd8-9681-b11a042dbc3c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Request method failure captured: Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 HTTP/1.1 Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGpHpd_krFH_y0V7A2Cz1lCD0EekD_aMPRNwgr--aMbRSFlBYEsnl_W04n_Tcc8xsSgyM9Ipc-LMbj737h6_yj3YdmCxxbjKue5E6ot8Zoy2bNKrejJg0BNxXato3OdhquEwUy49Y6Fc3bympyrkIzv-9nNRHikb5W4It97blNMKVE8 Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 66d3b0a2007b41e59c5006778d1b5d76 Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersTestJSON-1711302845 Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_66d3b0a2007b41e59c5006778d1b5d76", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/66d3b0a2007b41e59c5006778d1b5d76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/66d3b0a2007b41e59c5006778d1b5d76"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/66d3b0a2007b41e59c5006778d1b5d76"}]}] Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersTestJSON-1711302845 Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 66d3b0a2007b41e59c5006778d1b5d76 Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersTestJSON-1711302845 Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersTestJSON-1711302845-project Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 2092dd5ed84e414ba0000c3816b7b6f6 Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersTestJSON-1711302845-project Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance e1cd2e32-34ce-4a91-b679-2093d7808de2 could not be found. Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'e1cd2e32-34ce-4a91-b679-2093d7808de2'} Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1cd2e32-34ce-4a91-b679-2093d7808de2 could not be found. Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1cd2e32-34ce-4a91-b679-2093d7808de2 could not be found. Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:25.483418 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:25.490250 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:25.490250 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:25.490250 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:25.490250 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:55:25.490250 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:55:25.490250 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1cd2e32-34ce-4a91-b679-2093d7808de2 could not be found. Oct 10 18:55:25.490250 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:25.490250 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-45cb9189-5a00-4fd8-9681-b11a042dbc3c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Returning 404 to user: Instance e1cd2e32-34ce-4a91-b679-2093d7808de2 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:55:25.490250 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-45cb9189-5a00-4fd8-9681-b11a042dbc3c tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2" status: 404 len: 111 microversion: 2.1 time: 0.102345 Oct 10 18:55:25.491862 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 703/1557] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/servers/e1cd2e32-34ce-4a91-b679-2093d7808de2 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:55:25.503693 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-490b9cf2-79db-4a9f-b5ac-43178bc08629 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] Calling method '.version_select at 0x7f318dc07310>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.528831 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f4dd9f45-4f4b-4f9f-ad3e-59224ec083b9 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.063946 Oct 10 18:55:25.530089 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 855/1558] 10.222.0.43 () {58 vars in 1169 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:25.550145 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-13bf1c67-fc1f-4880-abb6-9fbe5a4783cf tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.567927 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-13bf1c67-fc1f-4880-abb6-9fbe5a4783cf tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.024320 Oct 10 18:55:25.569483 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 856/1559] 10.222.0.43 () {58 vars in 1161 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:25.587197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-332960fb-da67-477e-8f6b-bcc06f9c6ca2 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.607151 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-332960fb-da67-477e-8f6b-bcc06f9c6ca2 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026192 Oct 10 18:55:25.608440 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 857/1560] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:25.625819 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e1477e0a-e591-4ba8-b803-3c0dead0ce88 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.626955 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-490b9cf2-79db-4a9f-b5ac-43178bc08629 tempest-ServersTestJSON-1711302845 tempest-ServersTestJSON-1711302845-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-519925193" status: 202 len: 0 microversion: 2.1 time: 0.134653 Oct 10 18:55:25.627950 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 704/1561] 10.222.0.43 () {58 vars in 1218 bytes} [Mon Oct 10 18:55:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-519925193 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:55:25.737645 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e1477e0a-e591-4ba8-b803-3c0dead0ce88 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.118802 Oct 10 18:55:25.738785 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 858/1562] 10.222.0.43 () {58 vars in 1167 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:25.755645 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4abb441c-0157-4fd3-8ae6-6c472d57bcd6 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.770509 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4abb441c-0157-4fd3-8ae6-6c472d57bcd6 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018896 Oct 10 18:55:25.773771 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 705/1563] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:25.787603 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7464e1b2-b376-480f-aebb-e5cdeaea9758 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.838092 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7464e1b2-b376-480f-aebb-e5cdeaea9758 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.052880 Oct 10 18:55:25.850673 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 859/1564] 10.222.0.43 () {58 vars in 1144 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:25.857657 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6fafa38a-3843-4140-9ab9-689c546973fe tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.870678 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6fafa38a-3843-4140-9ab9-689c546973fe tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017939 Oct 10 18:55:25.885792 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 706/1565] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:25.893884 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6e99553e-44c4-4cd2-ac1b-099ea95c8876 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.933982 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6e99553e-44c4-4cd2-ac1b-099ea95c8876 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.045562 Oct 10 18:55:25.945725 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 860/1566] 10.222.0.43 () {58 vars in 1148 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:25.960223 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-83fa6ede-13d6-4fe9-9e2e-30292ee929e6 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:25.973572 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-83fa6ede-13d6-4fe9-9e2e-30292ee929e6 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.024729 Oct 10 18:55:25.986354 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 707/1567] 10.222.0.43 () {58 vars in 1140 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:25.994168 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-193467f3-ebbb-481b-ae6d-0fd2043911e5 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:26.006307 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-193467f3-ebbb-481b-ae6d-0fd2043911e5 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018746 Oct 10 18:55:26.017067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-12295ab4-380b-4fec-92a9-680a1007f443 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:26.017067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-12295ab4-380b-4fec-92a9-680a1007f443 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:26.017812 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 861/1568] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:26.026045 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9ef9b48f-566c-4947-8261-62694995d2bf tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:26.036166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-12295ab4-380b-4fec-92a9-680a1007f443 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:26.036932 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-12295ab4-380b-4fec-92a9-680a1007f443 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:26.043949 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-12295ab4-380b-4fec-92a9-680a1007f443 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:26.043949 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-12295ab4-380b-4fec-92a9-680a1007f443 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:26.043949 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-12295ab4-380b-4fec-92a9-680a1007f443 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:26.043949 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-12295ab4-380b-4fec-92a9-680a1007f443 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:26.098587 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9ef9b48f-566c-4947-8261-62694995d2bf tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.077507 Oct 10 18:55:26.105236 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 862/1569] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:55:26 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:26.120287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d0080c57-afb8-43f6-ab43-cdf98fc575f2 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:26.183569 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d0080c57-afb8-43f6-ab43-cdf98fc575f2 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067981 Oct 10 18:55:26.186370 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 863/1570] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 18:55:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:26.500169 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1016517700", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": "none"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:26.541824 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-12295ab4-380b-4fec-92a9-680a1007f443 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:26.553857 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-12295ab4-380b-4fec-92a9-680a1007f443 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1315 microversion: 2.1 time: 0.557180 Oct 10 18:55:26.567864 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 708/1571] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:25 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:26.575570 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6a4e7b82-961a-419f-b38b-f66ccc4ad954 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:26.592466 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6a4e7b82-961a-419f-b38b-f66ccc4ad954 tempest-FlavorsV2TestJSON-398584541 tempest-FlavorsV2TestJSON-398584541-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023074 Oct 10 18:55:26.599139 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 709/1572] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:55:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:26.610646 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d7256f93-c1db-4413-a6fa-e17c66fb6787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:26.613147 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d7256f93-c1db-4413-a6fa-e17c66fb6787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:26.626580 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d7256f93-c1db-4413-a6fa-e17c66fb6787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:26.631302 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d7256f93-c1db-4413-a6fa-e17c66fb6787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:26.632101 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d7256f93-c1db-4413-a6fa-e17c66fb6787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:26.633108 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d7256f93-c1db-4413-a6fa-e17c66fb6787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:26.633790 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d7256f93-c1db-4413-a6fa-e17c66fb6787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:26.637428 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d7256f93-c1db-4413-a6fa-e17c66fb6787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:26.705971 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d7256f93-c1db-4413-a6fa-e17c66fb6787 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111574 Oct 10 18:55:26.709685 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 710/1573] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:55:26 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:27.579701 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7bc2a6f4-ccc0-450d-8f12-aaa26ed48ee7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:27.581082 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7bc2a6f4-ccc0-450d-8f12-aaa26ed48ee7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:27.600518 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7bc2a6f4-ccc0-450d-8f12-aaa26ed48ee7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:27.601052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7bc2a6f4-ccc0-450d-8f12-aaa26ed48ee7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:27.601501 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7bc2a6f4-ccc0-450d-8f12-aaa26ed48ee7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:27.604658 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7bc2a6f4-ccc0-450d-8f12-aaa26ed48ee7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:27.606076 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7bc2a6f4-ccc0-450d-8f12-aaa26ed48ee7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:27.606199 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7bc2a6f4-ccc0-450d-8f12-aaa26ed48ee7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:28.040104 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7bc2a6f4-ccc0-450d-8f12-aaa26ed48ee7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:28.058134 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7bc2a6f4-ccc0-450d-8f12-aaa26ed48ee7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1315 microversion: 2.1 time: 0.482345 Oct 10 18:55:28.059767 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 711/1574] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:27 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:55:28.066469 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f5766bc4-9466-406e-9eb8-63216e0e85a3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:28.078224 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f5766bc4-9466-406e-9eb8-63216e0e85a3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:28.095261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5766bc4-9466-406e-9eb8-63216e0e85a3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:28.096177 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5766bc4-9466-406e-9eb8-63216e0e85a3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:28.097113 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5766bc4-9466-406e-9eb8-63216e0e85a3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:28.098085 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5766bc4-9466-406e-9eb8-63216e0e85a3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:28.098820 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5766bc4-9466-406e-9eb8-63216e0e85a3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:28.099506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5766bc4-9466-406e-9eb8-63216e0e85a3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:28.135171 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f5766bc4-9466-406e-9eb8-63216e0e85a3 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073507 Oct 10 18:55:28.142623 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 712/1575] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:55:28 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:55:28.514145 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1934250214", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "ba4a18b8-9531-4729-9069-fa4abbd83a44"}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:35.294289 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=15 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:36.315413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:55:36.316082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:55:36.317789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:55:36.317789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:55:36.317789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:55:36.348272 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:36.349532 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:36.353800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:36.353978 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] validate_networks() for [('ba4a18b8-9531-4729-9069-fa4abbd83a44', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:55:36.355843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:36.356471 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:36.357304 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:36.404085 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Getting quotas for project 7b78d4d107c74390be387b72a5e339ea. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:55:36.417577 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Getting quotas for user 9a452534769544fdaa6f735379ccb538 and project 7b78d4d107c74390be387b72a5e339ea. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:55:36.450876 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:55:36.455782 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:55:36.941375 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-50f1bfd7-7821-4345-bcd8-1ac5f00f48f0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 10.753635 Oct 10 18:55:36.943548 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 864/1576] 10.222.0.43 () {62 vars in 1188 bytes} [Mon Oct 10 18:55:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 10756 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 18:55:36.966489 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-55f08fd7-e13d-4f3a-af39-f1829df2dc85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:36.971949 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-55f08fd7-e13d-4f3a-af39-f1829df2dc85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:36.983547 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55f08fd7-e13d-4f3a-af39-f1829df2dc85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:36.984391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55f08fd7-e13d-4f3a-af39-f1829df2dc85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:36.985547 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55f08fd7-e13d-4f3a-af39-f1829df2dc85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:36.986827 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55f08fd7-e13d-4f3a-af39-f1829df2dc85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:36.988349 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55f08fd7-e13d-4f3a-af39-f1829df2dc85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:36.989124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55f08fd7-e13d-4f3a-af39-f1829df2dc85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:37.312231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:55:37.312934 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:55:37.313844 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:55:37.314556 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:55:37.315157 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:55:37.335699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:37.340935 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:37.341650 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:37.344461 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:37.345429 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:37.346150 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:37.372095 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55f08fd7-e13d-4f3a-af39-f1829df2dc85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:37.383715 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-55f08fd7-e13d-4f3a-af39-f1829df2dc85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1315 microversion: 2.1 time: 0.437964 Oct 10 18:55:37.389932 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 865/1577] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:36 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:37.390294 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Getting quotas for project 92d05639af8046dd87fe6973ff26f161. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:55:37.404748 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Getting quotas for user abed6abc941a421682af5e3f5df98040 and project 92d05639af8046dd87fe6973ff26f161. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:55:37.437996 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:55:37.441782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:55:37.684457 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b3598e55-b6f5-4496-ae79-a966f07e51f2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.174949 Oct 10 18:55:37.691524 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 713/1578] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:55:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 9177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:55:37.697318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bccc4c07-df0c-4b38-a646-4310cdfdf7e1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:37.699122 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bccc4c07-df0c-4b38-a646-4310cdfdf7e1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:37.740702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-97f318c1-56ae-457e-8b90-0a6f0e19aed8 req-6ce0aca9-2ac9-4995-95db-ebcdde494233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab18d87-5b5b-4d03-a0c0-a07a998f411b", "name": "network-vif-plugged", "status": "completed", "tag": "64f367b9-222a-4fe3-919b-80f6bdc5452d"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:37.770215 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-97f318c1-56ae-457e-8b90-0a6f0e19aed8 req-6ce0aca9-2ac9-4995-95db-ebcdde494233 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:37.770728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-97f318c1-56ae-457e-8b90-0a6f0e19aed8 req-6ce0aca9-2ac9-4995-95db-ebcdde494233 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:37.771460 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-97f318c1-56ae-457e-8b90-0a6f0e19aed8 req-6ce0aca9-2ac9-4995-95db-ebcdde494233 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:37.801320 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-97f318c1-56ae-457e-8b90-0a6f0e19aed8 req-6ce0aca9-2ac9-4995-95db-ebcdde494233 service nova] Creating event network-vif-plugged:64f367b9-222a-4fe3-919b-80f6bdc5452d for instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b on n-h2-860863-1 Oct 10 18:55:37.813234 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-97f318c1-56ae-457e-8b90-0a6f0e19aed8 req-6ce0aca9-2ac9-4995-95db-ebcdde494233 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.419134 Oct 10 18:55:37.816843 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 866/1579] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:37.826220 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3e70c958-0b3a-41a3-9345-cc5a3d8dfaa4 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:37.845762 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3e70c958-0b3a-41a3-9345-cc5a3d8dfaa4 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:37.999429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3e70c958-0b3a-41a3-9345-cc5a3d8dfaa4 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:38.014219 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3e70c958-0b3a-41a3-9345-cc5a3d8dfaa4 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1218 microversion: 2.1 time: 0.195454 Oct 10 18:55:38.017554 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 867/1580] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:37 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1218 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:38.098674 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bccc4c07-df0c-4b38-a646-4310cdfdf7e1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:38.107714 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bccc4c07-df0c-4b38-a646-4310cdfdf7e1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:38.111557 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bccc4c07-df0c-4b38-a646-4310cdfdf7e1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:38.127174 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bccc4c07-df0c-4b38-a646-4310cdfdf7e1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1454 microversion: 2.91 time: 0.436054 Oct 10 18:55:38.128746 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 714/1581] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:37 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1454 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:38.414720 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d27757a0-bf46-4bd7-b3d9-e704d16c16b6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:38.416677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d27757a0-bf46-4bd7-b3d9-e704d16c16b6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:38.438949 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d27757a0-bf46-4bd7-b3d9-e704d16c16b6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:38.438949 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d27757a0-bf46-4bd7-b3d9-e704d16c16b6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:38.439920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d27757a0-bf46-4bd7-b3d9-e704d16c16b6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:38.441338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d27757a0-bf46-4bd7-b3d9-e704d16c16b6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:38.445385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d27757a0-bf46-4bd7-b3d9-e704d16c16b6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:38.446140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d27757a0-bf46-4bd7-b3d9-e704d16c16b6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:38.810395 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d27757a0-bf46-4bd7-b3d9-e704d16c16b6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:38.835341 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d27757a0-bf46-4bd7-b3d9-e704d16c16b6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1315 microversion: 2.1 time: 0.425859 Oct 10 18:55:38.843650 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 868/1582] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:38 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:39.044245 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-94c4bc98-3807-4099-a520-f59c3552c410 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:39.048163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-94c4bc98-3807-4099-a520-f59c3552c410 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:39.162810 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8a9c21f1-624a-42e0-9e7e-402642995900 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:39.162810 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8a9c21f1-624a-42e0-9e7e-402642995900 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:39.171473 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8a9c21f1-624a-42e0-9e7e-402642995900 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:39.171982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8a9c21f1-624a-42e0-9e7e-402642995900 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:39.172403 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8a9c21f1-624a-42e0-9e7e-402642995900 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:39.173164 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8a9c21f1-624a-42e0-9e7e-402642995900 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:39.173621 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8a9c21f1-624a-42e0-9e7e-402642995900 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:39.174049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8a9c21f1-624a-42e0-9e7e-402642995900 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:39.238026 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-94c4bc98-3807-4099-a520-f59c3552c410 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:39.247919 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-94c4bc98-3807-4099-a520-f59c3552c410 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1218 microversion: 2.1 time: 0.208293 Oct 10 18:55:39.263862 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 715/1583] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:39 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1218 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:39.451402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8a9c21f1-624a-42e0-9e7e-402642995900 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:39.464308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8a9c21f1-624a-42e0-9e7e-402642995900 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:39.466280 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8a9c21f1-624a-42e0-9e7e-402642995900 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:39.477864 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8a9c21f1-624a-42e0-9e7e-402642995900 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1458 microversion: 2.91 time: 0.322066 Oct 10 18:55:39.480250 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 869/1584] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:39 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1458 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:39.866754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f55b7527-3750-4d67-a471-798ea8b3226e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:39.867387 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f55b7527-3750-4d67-a471-798ea8b3226e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:39.889551 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f55b7527-3750-4d67-a471-798ea8b3226e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:39.893301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f55b7527-3750-4d67-a471-798ea8b3226e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:39.893960 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f55b7527-3750-4d67-a471-798ea8b3226e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:39.897733 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f55b7527-3750-4d67-a471-798ea8b3226e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:39.901322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f55b7527-3750-4d67-a471-798ea8b3226e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:39.907065 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f55b7527-3750-4d67-a471-798ea8b3226e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:40.278721 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-425abbc7-307b-4c1c-8f69-9dc929f6413b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:40.279345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-425abbc7-307b-4c1c-8f69-9dc929f6413b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:40.300617 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-425abbc7-307b-4c1c-8f69-9dc929f6413b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:40.301802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-425abbc7-307b-4c1c-8f69-9dc929f6413b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:40.302265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-425abbc7-307b-4c1c-8f69-9dc929f6413b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:40.306358 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-425abbc7-307b-4c1c-8f69-9dc929f6413b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:40.310493 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-425abbc7-307b-4c1c-8f69-9dc929f6413b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:40.313412 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-425abbc7-307b-4c1c-8f69-9dc929f6413b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:40.862846 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f55b7527-3750-4d67-a471-798ea8b3226e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:40.872834 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f55b7527-3750-4d67-a471-798ea8b3226e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1315 microversion: 2.1 time: 1.010082 Oct 10 18:55:40.879802 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 716/1585] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:39 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1315 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:40.904414 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b6cdacbe-03b4-4bf2-af0e-3c4ebd0be93a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:40.905670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b6cdacbe-03b4-4bf2-af0e-3c4ebd0be93a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:40.936973 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b6cdacbe-03b4-4bf2-af0e-3c4ebd0be93a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:40.950039 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b6cdacbe-03b4-4bf2-af0e-3c4ebd0be93a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:40.951880 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b6cdacbe-03b4-4bf2-af0e-3c4ebd0be93a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:40.955237 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b6cdacbe-03b4-4bf2-af0e-3c4ebd0be93a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:40.957924 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b6cdacbe-03b4-4bf2-af0e-3c4ebd0be93a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:40.961168 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b6cdacbe-03b4-4bf2-af0e-3c4ebd0be93a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:40.973728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-425abbc7-307b-4c1c-8f69-9dc929f6413b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:40.995968 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-425abbc7-307b-4c1c-8f69-9dc929f6413b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1214 microversion: 2.1 time: 0.710538 Oct 10 18:55:40.998017 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 870/1586] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:40 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1214 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:41.230745 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b6cdacbe-03b4-4bf2-af0e-3c4ebd0be93a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:41.248391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b6cdacbe-03b4-4bf2-af0e-3c4ebd0be93a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:41.249971 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b6cdacbe-03b4-4bf2-af0e-3c4ebd0be93a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:41.277442 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b6cdacbe-03b4-4bf2-af0e-3c4ebd0be93a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1514 microversion: 2.91 time: 0.396369 Oct 10 18:55:41.281100 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 717/1587] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:40 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1514 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:41.896901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3d2f0e8b-25a9-482e-afda-45b86da6e00a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:41.901436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3d2f0e8b-25a9-482e-afda-45b86da6e00a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:41.916176 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d2f0e8b-25a9-482e-afda-45b86da6e00a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:41.918239 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d2f0e8b-25a9-482e-afda-45b86da6e00a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:41.920213 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d2f0e8b-25a9-482e-afda-45b86da6e00a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:41.921007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d2f0e8b-25a9-482e-afda-45b86da6e00a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:41.921473 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d2f0e8b-25a9-482e-afda-45b86da6e00a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:41.921949 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d2f0e8b-25a9-482e-afda-45b86da6e00a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:42.027184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f909d8a7-c38c-4b22-8427-9036ffced2b2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:42.028340 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f909d8a7-c38c-4b22-8427-9036ffced2b2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:42.037498 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f909d8a7-c38c-4b22-8427-9036ffced2b2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:42.040707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f909d8a7-c38c-4b22-8427-9036ffced2b2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:42.040707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f909d8a7-c38c-4b22-8427-9036ffced2b2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:42.040707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f909d8a7-c38c-4b22-8427-9036ffced2b2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:42.049070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f909d8a7-c38c-4b22-8427-9036ffced2b2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:42.049778 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f909d8a7-c38c-4b22-8427-9036ffced2b2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:42.271049 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f909d8a7-c38c-4b22-8427-9036ffced2b2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:42.310078 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f909d8a7-c38c-4b22-8427-9036ffced2b2 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1270 microversion: 2.1 time: 0.282183 Oct 10 18:55:42.311446 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 718/1588] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:42 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1270 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:42.330040 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fe39acf0-8364-4d47-8908-8e15907ee238 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:42.335305 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fe39acf0-8364-4d47-8908-8e15907ee238 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:42.365495 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe39acf0-8364-4d47-8908-8e15907ee238 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:42.366000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe39acf0-8364-4d47-8908-8e15907ee238 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:42.366440 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe39acf0-8364-4d47-8908-8e15907ee238 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:42.367161 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe39acf0-8364-4d47-8908-8e15907ee238 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:42.367617 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe39acf0-8364-4d47-8908-8e15907ee238 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:42.368043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe39acf0-8364-4d47-8908-8e15907ee238 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:42.579679 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fe39acf0-8364-4d47-8908-8e15907ee238 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:42.596391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fe39acf0-8364-4d47-8908-8e15907ee238 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:42.597896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fe39acf0-8364-4d47-8908-8e15907ee238 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:42.613658 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fe39acf0-8364-4d47-8908-8e15907ee238 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1524 microversion: 2.91 time: 0.299680 Oct 10 18:55:42.624558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3d2f0e8b-25a9-482e-afda-45b86da6e00a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:42.633234 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3d2f0e8b-25a9-482e-afda-45b86da6e00a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1503 microversion: 2.1 time: 0.741831 Oct 10 18:55:42.638215 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 719/1589] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:42 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1524 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:42.641503 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 871/1590] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:41 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1503 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:42.657646 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dd618843-417b-4f6b-bf9a-5cbc051ec2f6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:42.665123 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-dd618843-417b-4f6b-bf9a-5cbc051ec2f6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:42.678448 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dd618843-417b-4f6b-bf9a-5cbc051ec2f6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:42.680162 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dd618843-417b-4f6b-bf9a-5cbc051ec2f6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:42.682013 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dd618843-417b-4f6b-bf9a-5cbc051ec2f6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:42.683910 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dd618843-417b-4f6b-bf9a-5cbc051ec2f6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:42.684729 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dd618843-417b-4f6b-bf9a-5cbc051ec2f6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:42.685373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dd618843-417b-4f6b-bf9a-5cbc051ec2f6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:42.781258 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-dd618843-417b-4f6b-bf9a-5cbc051ec2f6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lazy-loading 'flavor' on Instance uuid 2ab18d87-5b5b-4d03-a0c0-a07a998f411b {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:43.082148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ac2f2643-33cf-4512-8524-144474a70c29 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:43.082836 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ac2f2643-33cf-4512-8524-144474a70c29 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:43.125164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:43.128024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac2f2643-33cf-4512-8524-144474a70c29 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:43.136338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac2f2643-33cf-4512-8524-144474a70c29 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:43.140879 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac2f2643-33cf-4512-8524-144474a70c29 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:43.147565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac2f2643-33cf-4512-8524-144474a70c29 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:43.148117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac2f2643-33cf-4512-8524-144474a70c29 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:43.153107 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac2f2643-33cf-4512-8524-144474a70c29 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:43.715619 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dd618843-417b-4f6b-bf9a-5cbc051ec2f6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "POST /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b/action" status: 202 len: 0 microversion: 2.1 time: 1.061483 Oct 10 18:55:43.716813 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 720/1591] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:55:42 2022] POST /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b/action => generated 0 bytes in 1064 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:55:43.734080 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0831ebdb-87be-4d26-a31c-51bd9583ef5e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:43.736321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0831ebdb-87be-4d26-a31c-51bd9583ef5e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:43.755858 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0831ebdb-87be-4d26-a31c-51bd9583ef5e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:43.759654 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0831ebdb-87be-4d26-a31c-51bd9583ef5e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:43.760313 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0831ebdb-87be-4d26-a31c-51bd9583ef5e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:43.761241 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0831ebdb-87be-4d26-a31c-51bd9583ef5e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:43.763299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0831ebdb-87be-4d26-a31c-51bd9583ef5e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:43.763942 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0831ebdb-87be-4d26-a31c-51bd9583ef5e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:43.950705 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0831ebdb-87be-4d26-a31c-51bd9583ef5e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:43.968195 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0831ebdb-87be-4d26-a31c-51bd9583ef5e tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1278 microversion: 2.1 time: 0.249559 Oct 10 18:55:43.968372 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 721/1592] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:43 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1278 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:44.280862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ea6ecd96-04de-498f-b2da-032f47040988 tempest-FloatingIPDetailsNegativeTestJSON-839632334 tempest-FloatingIPDetailsNegativeTestJSON-839632334-project] Calling method '.version_select at 0x7f318dbd4430>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:44.350028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-ac2f2643-33cf-4512-8524-144474a70c29 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid 96d79eab-1807-4467-b325-fe5f723ac559 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:44.369201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG neutronclient.v2_0.client [None req-ea6ecd96-04de-498f-b2da-032f47040988 tempest-FloatingIPDetailsNegativeTestJSON-839632334 tempest-FloatingIPDetailsNegativeTestJSON-839632334-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 761507b7-eb26-4ccd-9553-9f152b53e700 could not be found", "detail": ""}} {{(pid=127289) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:55:44.369780 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-ea6ecd96-04de-498f-b2da-032f47040988 tempest-FloatingIPDetailsNegativeTestJSON-839632334 tempest-FloatingIPDetailsNegativeTestJSON-839632334-project] HTTP exception thrown: Floating IP not found for ID 761507b7-eb26-4ccd-9553-9f152b53e700 Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ea6ecd96-04de-498f-b2da-032f47040988 tempest-FloatingIPDetailsNegativeTestJSON-839632334 tempest-FloatingIPDetailsNegativeTestJSON-839632334-project] Request method failure captured: Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/os-floating-ips/761507b7-eb26-4ccd-9553-9f152b53e700 HTTP/1.1 Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGqvTN6tKlp83lR0ziFrGWgiW26gkUsKFitWmwKc-dvd37XC4qm2GGbVzNVLsSToG8-MUWUzGxMDF0A4kII6UoYItbbLAT2zb66PEz5d-nU_m9eip_xU-EONFqWTPMpkOjgBOc0VcRQjrgdQ4cV6B7J3d4m_V5erPhSDVIJnUDJWRkc Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 268459632e8b425b9814f1402be8c746 Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-839632334 Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_268459632e8b425b9814f1402be8c746", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/268459632e8b425b9814f1402be8c746"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/268459632e8b425b9814f1402be8c746"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/268459632e8b425b9814f1402be8c746"}]}] Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-839632334 Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 268459632e8b425b9814f1402be8c746 Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-839632334 Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-839632334-project Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: fb73215634d740e5a368d6464d165b17 Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-839632334-project Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: exception: Floating IP not found for ID 761507b7-eb26-4ccd-9553-9f152b53e700 Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '761507b7-eb26-4ccd-9553-9f152b53e700'} Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 761507b7-eb26-4ccd-9553-9f152b53e700 could not be found Oct 10 18:55:44.371815 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a9363a3-4c68-4771-a41e-db4b0a532530'] Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 761507b7-eb26-4ccd-9553-9f152b53e700. Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 761507b7-eb26-4ccd-9553-9f152b53e700 Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 761507b7-eb26-4ccd-9553-9f152b53e700 Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:55:44.377777 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ea6ecd96-04de-498f-b2da-032f47040988 tempest-FloatingIPDetailsNegativeTestJSON-839632334 tempest-FloatingIPDetailsNegativeTestJSON-839632334-project] Returning 404 to user: Floating IP not found for ID 761507b7-eb26-4ccd-9553-9f152b53e700 {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:55:44.381178 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ea6ecd96-04de-498f-b2da-032f47040988 tempest-FloatingIPDetailsNegativeTestJSON-839632334 tempest-FloatingIPDetailsNegativeTestJSON-839632334-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/761507b7-eb26-4ccd-9553-9f152b53e700" status: 404 len: 111 microversion: 2.1 time: 0.410241 Oct 10 18:55:44.382009 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 722/1593] 10.222.0.43 () {58 vars in 1260 bytes} [Mon Oct 10 18:55:43 2022] GET /compute/v2.1/os-floating-ips/761507b7-eb26-4ccd-9553-9f152b53e700 => generated 111 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:55:44.397097 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-27d86d5a-6135-43d3-9a61-5162b2eecaad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:44.404170 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-27d86d5a-6135-43d3-9a61-5162b2eecaad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:44.420281 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ac2f2643-33cf-4512-8524-144474a70c29 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 2422 microversion: 2.25 time: 1.326009 Oct 10 18:55:44.425805 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 872/1594] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:43 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 2422 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:55:44.427966 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-27d86d5a-6135-43d3-9a61-5162b2eecaad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:44.428641 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-27d86d5a-6135-43d3-9a61-5162b2eecaad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:44.429180 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-27d86d5a-6135-43d3-9a61-5162b2eecaad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:44.429990 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-27d86d5a-6135-43d3-9a61-5162b2eecaad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:44.430561 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-27d86d5a-6135-43d3-9a61-5162b2eecaad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:44.435130 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bb943d73-0a4d-4705-bc06-2926b93dd5c4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:44.435527 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-27d86d5a-6135-43d3-9a61-5162b2eecaad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:44.436190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bb943d73-0a4d-4705-bc06-2926b93dd5c4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:44.451961 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:44.454455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bb943d73-0a4d-4705-bc06-2926b93dd5c4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:44.460377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bb943d73-0a4d-4705-bc06-2926b93dd5c4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:44.460377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bb943d73-0a4d-4705-bc06-2926b93dd5c4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:44.460377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bb943d73-0a4d-4705-bc06-2926b93dd5c4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:44.460377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bb943d73-0a4d-4705-bc06-2926b93dd5c4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:44.460377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bb943d73-0a4d-4705-bc06-2926b93dd5c4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:44.613516 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-27d86d5a-6135-43d3-9a61-5162b2eecaad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:44.623758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-27d86d5a-6135-43d3-9a61-5162b2eecaad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:44.625416 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-27d86d5a-6135-43d3-9a61-5162b2eecaad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:44.631015 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-27d86d5a-6135-43d3-9a61-5162b2eecaad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1512 microversion: 2.91 time: 0.248124 Oct 10 18:55:44.632304 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 723/1595] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:44 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:44.639252 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6e966ec4-c12a-435d-984c-cc9261d1c8db tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860863-1", "block_migration": "auto"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:44.643817 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6e966ec4-c12a-435d-984c-cc9261d1c8db tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:44.649078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6e966ec4-c12a-435d-984c-cc9261d1c8db tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:44.650302 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6e966ec4-c12a-435d-984c-cc9261d1c8db tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:44.650914 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6e966ec4-c12a-435d-984c-cc9261d1c8db tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:44.651817 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6e966ec4-c12a-435d-984c-cc9261d1c8db tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:44.652440 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6e966ec4-c12a-435d-984c-cc9261d1c8db tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:44.653056 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6e966ec4-c12a-435d-984c-cc9261d1c8db tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:44.688109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-6e966ec4-c12a-435d-984c-cc9261d1c8db tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'flavor' on Instance uuid 96d79eab-1807-4467-b325-fe5f723ac559 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:44.703457 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6e966ec4-c12a-435d-984c-cc9261d1c8db tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Going to try to live migrate instance to n-h2-860863-1 {{(pid=127289) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 18:55:45.350587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bb943d73-0a4d-4705-bc06-2926b93dd5c4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:45.359222 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bb943d73-0a4d-4705-bc06-2926b93dd5c4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.935798 Oct 10 18:55:45.373327 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 873/1596] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:44 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:45.388753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e606461a-337b-43e7-811b-37e569f1c755 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:45.390852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e606461a-337b-43e7-811b-37e569f1c755 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:45.405137 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e606461a-337b-43e7-811b-37e569f1c755 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:45.410676 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e606461a-337b-43e7-811b-37e569f1c755 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:45.410676 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e606461a-337b-43e7-811b-37e569f1c755 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:45.410676 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e606461a-337b-43e7-811b-37e569f1c755 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:45.412723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e606461a-337b-43e7-811b-37e569f1c755 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:45.414832 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e606461a-337b-43e7-811b-37e569f1c755 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:45.749271 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e606461a-337b-43e7-811b-37e569f1c755 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:45.757409 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e606461a-337b-43e7-811b-37e569f1c755 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1276 microversion: 2.1 time: 0.381343 Oct 10 18:55:45.760878 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 874/1597] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:45 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1276 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:45.778047 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4208d8ba-0423-4cb3-8b6a-15d1f160f91f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:45.780818 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4208d8ba-0423-4cb3-8b6a-15d1f160f91f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:45.814183 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4208d8ba-0423-4cb3-8b6a-15d1f160f91f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:45.815621 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4208d8ba-0423-4cb3-8b6a-15d1f160f91f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:45.816308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4208d8ba-0423-4cb3-8b6a-15d1f160f91f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:45.817314 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4208d8ba-0423-4cb3-8b6a-15d1f160f91f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:45.818017 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4208d8ba-0423-4cb3-8b6a-15d1f160f91f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:45.823598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4208d8ba-0423-4cb3-8b6a-15d1f160f91f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:46.095098 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4208d8ba-0423-4cb3-8b6a-15d1f160f91f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:46.124321 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4208d8ba-0423-4cb3-8b6a-15d1f160f91f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:46.126538 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4208d8ba-0423-4cb3-8b6a-15d1f160f91f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:46.155022 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4208d8ba-0423-4cb3-8b6a-15d1f160f91f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1533 microversion: 2.91 time: 0.388675 Oct 10 18:55:46.157848 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 875/1598] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:45 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1533 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:46.377432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:46.399348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2cec6afa-89eb-48dc-8a87-f592faaaa415 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:46.401124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2cec6afa-89eb-48dc-8a87-f592faaaa415 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:46.414083 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2cec6afa-89eb-48dc-8a87-f592faaaa415 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:46.417803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2cec6afa-89eb-48dc-8a87-f592faaaa415 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:46.418426 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2cec6afa-89eb-48dc-8a87-f592faaaa415 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:46.419292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2cec6afa-89eb-48dc-8a87-f592faaaa415 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:46.419861 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2cec6afa-89eb-48dc-8a87-f592faaaa415 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:46.421196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2cec6afa-89eb-48dc-8a87-f592faaaa415 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:46.577929 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-2cec6afa-89eb-48dc-8a87-f592faaaa415 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lazy-loading 'services' on Instance uuid 09b8e807-521f-4b1d-9082-71ffd73f2d63 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:46.627783 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2cec6afa-89eb-48dc-8a87-f592faaaa415 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1938 microversion: 2.91 time: 0.446736 Oct 10 18:55:46.630488 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 876/1599] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:46 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1938 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:46.637988 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fec0a757-abaf-493b-acba-8e9e4ca99d77 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:46.639065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fec0a757-abaf-493b-acba-8e9e4ca99d77 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:46.657984 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fec0a757-abaf-493b-acba-8e9e4ca99d77 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:46.658771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fec0a757-abaf-493b-acba-8e9e4ca99d77 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:46.660278 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fec0a757-abaf-493b-acba-8e9e4ca99d77 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:46.661328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fec0a757-abaf-493b-acba-8e9e4ca99d77 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:46.662624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fec0a757-abaf-493b-acba-8e9e4ca99d77 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:46.663450 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fec0a757-abaf-493b-acba-8e9e4ca99d77 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:47.220919 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fec0a757-abaf-493b-acba-8e9e4ca99d77 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:47.232238 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fec0a757-abaf-493b-acba-8e9e4ca99d77 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.600475 Oct 10 18:55:47.237331 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 877/1600] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:46 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:47.251536 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-56ca27df-61d3-43ea-8009-2e243968e5f7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:47.252630 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-56ca27df-61d3-43ea-8009-2e243968e5f7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:47.263823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-56ca27df-61d3-43ea-8009-2e243968e5f7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:47.264646 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-56ca27df-61d3-43ea-8009-2e243968e5f7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:47.265263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-56ca27df-61d3-43ea-8009-2e243968e5f7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:47.266232 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-56ca27df-61d3-43ea-8009-2e243968e5f7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:47.269036 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-56ca27df-61d3-43ea-8009-2e243968e5f7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:47.269671 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-56ca27df-61d3-43ea-8009-2e243968e5f7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:47.362183 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:47.469114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-56ca27df-61d3-43ea-8009-2e243968e5f7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lazy-loading 'services' on Instance uuid 09b8e807-521f-4b1d-9082-71ffd73f2d63 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:47.522836 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-56ca27df-61d3-43ea-8009-2e243968e5f7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1938 microversion: 2.91 time: 0.284376 Oct 10 18:55:47.528458 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 878/1601] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:47 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1938 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:47.546621 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1d3bc6a9-1b52-417b-baf0-864593cbd37c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:47.546621 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1d3bc6a9-1b52-417b-baf0-864593cbd37c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:47.556279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d3bc6a9-1b52-417b-baf0-864593cbd37c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:47.561279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d3bc6a9-1b52-417b-baf0-864593cbd37c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:47.562567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d3bc6a9-1b52-417b-baf0-864593cbd37c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:47.565888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d3bc6a9-1b52-417b-baf0-864593cbd37c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:47.569276 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d3bc6a9-1b52-417b-baf0-864593cbd37c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:47.572080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d3bc6a9-1b52-417b-baf0-864593cbd37c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:48.005302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=8 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:48.145057 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1d3bc6a9-1b52-417b-baf0-864593cbd37c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:48.160451 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1d3bc6a9-1b52-417b-baf0-864593cbd37c tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1318 microversion: 2.1 time: 0.626258 Oct 10 18:55:48.162699 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 879/1602] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:47 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:48.184470 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ac18657f-34c2-4fd1-ba33-305ce6655c93 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:48.205661 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac18657f-34c2-4fd1-ba33-305ce6655c93 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:48.216273 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac18657f-34c2-4fd1-ba33-305ce6655c93 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:48.220038 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac18657f-34c2-4fd1-ba33-305ce6655c93 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:48.221278 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac18657f-34c2-4fd1-ba33-305ce6655c93 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:48.221942 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac18657f-34c2-4fd1-ba33-305ce6655c93 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:48.225053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac18657f-34c2-4fd1-ba33-305ce6655c93 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:48.291202 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ac18657f-34c2-4fd1-ba33-305ce6655c93 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.110249 Oct 10 18:55:48.296459 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 880/1603] 10.222.0.43 () {60 vars in 1217 bytes} [Mon Oct 10 18:55:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:55:48.304382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0e56ac8a-40ec-4bd9-84ac-0bde0f6e468c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:48.305284 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0e56ac8a-40ec-4bd9-84ac-0bde0f6e468c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:48.319256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e56ac8a-40ec-4bd9-84ac-0bde0f6e468c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:48.322126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e56ac8a-40ec-4bd9-84ac-0bde0f6e468c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:48.322784 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e56ac8a-40ec-4bd9-84ac-0bde0f6e468c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:48.324786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e56ac8a-40ec-4bd9-84ac-0bde0f6e468c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:48.326481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e56ac8a-40ec-4bd9-84ac-0bde0f6e468c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:48.327912 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0e56ac8a-40ec-4bd9-84ac-0bde0f6e468c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:49.070489 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0e56ac8a-40ec-4bd9-84ac-0bde0f6e468c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:49.082083 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0e56ac8a-40ec-4bd9-84ac-0bde0f6e468c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.787184 Oct 10 18:55:49.086183 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 881/1604] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:48 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:49.094193 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-903cec8e-cb46-4a24-b565-f6fe14737a2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:49.095075 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-903cec8e-cb46-4a24-b565-f6fe14737a2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:49.103553 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-903cec8e-cb46-4a24-b565-f6fe14737a2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:49.105147 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-903cec8e-cb46-4a24-b565-f6fe14737a2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:49.105885 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-903cec8e-cb46-4a24-b565-f6fe14737a2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:49.107640 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-903cec8e-cb46-4a24-b565-f6fe14737a2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:49.108867 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-903cec8e-cb46-4a24-b565-f6fe14737a2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:49.109539 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-903cec8e-cb46-4a24-b565-f6fe14737a2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:49.144605 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6e966ec4-c12a-435d-984c-cc9261d1c8db tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/action" status: 202 len: 0 microversion: 2.25 time: 4.506513 Oct 10 18:55:49.144605 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 724/1605] 10.222.0.43 () {62 vars in 1319 bytes} [Mon Oct 10 18:55:44 2022] POST /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/action => generated 0 bytes in 4508 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:55:49.151411 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-65f9e812-fadf-4b28-afcd-18750849b0f1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:49.152031 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-65f9e812-fadf-4b28-afcd-18750849b0f1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:49.160128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:49.166831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-65f9e812-fadf-4b28-afcd-18750849b0f1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:49.169163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-65f9e812-fadf-4b28-afcd-18750849b0f1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:49.169626 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-65f9e812-fadf-4b28-afcd-18750849b0f1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:49.170348 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-65f9e812-fadf-4b28-afcd-18750849b0f1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:49.170819 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-65f9e812-fadf-4b28-afcd-18750849b0f1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:49.173547 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-903cec8e-cb46-4a24-b565-f6fe14737a2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lazy-loading 'flavor' on Instance uuid 09b8e807-521f-4b1d-9082-71ffd73f2d63 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:55:49.182012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-65f9e812-fadf-4b28-afcd-18750849b0f1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:49.253350 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=10 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:49.471797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-65f9e812-fadf-4b28-afcd-18750849b0f1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:49.486385 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-65f9e812-fadf-4b28-afcd-18750849b0f1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:49.491434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-65f9e812-fadf-4b28-afcd-18750849b0f1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:49.501489 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-65f9e812-fadf-4b28-afcd-18750849b0f1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.354545 Oct 10 18:55:49.502839 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 725/1606] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:49 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:55:49.530408 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b136b341-7697-4dfd-a64c-4f58ff527280 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:49.531027 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b136b341-7697-4dfd-a64c-4f58ff527280 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:49.544196 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b136b341-7697-4dfd-a64c-4f58ff527280 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:49.545091 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b136b341-7697-4dfd-a64c-4f58ff527280 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:49.547279 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b136b341-7697-4dfd-a64c-4f58ff527280 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:49.547279 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b136b341-7697-4dfd-a64c-4f58ff527280 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:49.547279 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b136b341-7697-4dfd-a64c-4f58ff527280 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:49.550798 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b136b341-7697-4dfd-a64c-4f58ff527280 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:49.818515 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b136b341-7697-4dfd-a64c-4f58ff527280 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:49.826640 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b136b341-7697-4dfd-a64c-4f58ff527280 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1318 microversion: 2.1 time: 0.322418 Oct 10 18:55:49.862347 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 726/1607] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:49 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:50.117301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d5c13747-da40-42e6-88c6-f7dd2eb6bbf6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:50.118052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d5c13747-da40-42e6-88c6-f7dd2eb6bbf6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:50.145622 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5c13747-da40-42e6-88c6-f7dd2eb6bbf6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:50.146225 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5c13747-da40-42e6-88c6-f7dd2eb6bbf6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:50.146498 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5c13747-da40-42e6-88c6-f7dd2eb6bbf6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:50.156701 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5c13747-da40-42e6-88c6-f7dd2eb6bbf6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:50.162768 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5c13747-da40-42e6-88c6-f7dd2eb6bbf6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:50.162768 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5c13747-da40-42e6-88c6-f7dd2eb6bbf6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:50.191647 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-903cec8e-cb46-4a24-b565-f6fe14737a2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "POST /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63/action" status: 202 len: 0 microversion: 2.91 time: 1.103822 Oct 10 18:55:50.192266 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 882/1608] 10.222.0.43 () {62 vars in 1319 bytes} [Mon Oct 10 18:55:49 2022] POST /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63/action => generated 0 bytes in 1105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:55:50.222080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8f12599f-487b-4c71-8b76-f1a3c44c2430 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:50.223120 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8f12599f-487b-4c71-8b76-f1a3c44c2430 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:50.240741 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f12599f-487b-4c71-8b76-f1a3c44c2430 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:50.241930 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f12599f-487b-4c71-8b76-f1a3c44c2430 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:50.244044 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f12599f-487b-4c71-8b76-f1a3c44c2430 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:50.246822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f12599f-487b-4c71-8b76-f1a3c44c2430 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:50.247891 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f12599f-487b-4c71-8b76-f1a3c44c2430 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:50.254265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f12599f-487b-4c71-8b76-f1a3c44c2430 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:50.581419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8f12599f-487b-4c71-8b76-f1a3c44c2430 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:50.590914 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8f12599f-487b-4c71-8b76-f1a3c44c2430 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:50.592654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8f12599f-487b-4c71-8b76-f1a3c44c2430 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:50.603673 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8f12599f-487b-4c71-8b76-f1a3c44c2430 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.400312 Oct 10 18:55:50.603673 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 883/1609] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:50 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:50.623031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-22f9ca62-a407-41e3-93b1-451856ea0a88 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:50.623791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-22f9ca62-a407-41e3-93b1-451856ea0a88 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:50.649420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22f9ca62-a407-41e3-93b1-451856ea0a88 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:50.651083 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22f9ca62-a407-41e3-93b1-451856ea0a88 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:50.651597 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22f9ca62-a407-41e3-93b1-451856ea0a88 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:50.652569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22f9ca62-a407-41e3-93b1-451856ea0a88 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:50.653111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22f9ca62-a407-41e3-93b1-451856ea0a88 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:50.657648 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22f9ca62-a407-41e3-93b1-451856ea0a88 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:50.706160 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d5c13747-da40-42e6-88c6-f7dd2eb6bbf6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:50.724191 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d5c13747-da40-42e6-88c6-f7dd2eb6bbf6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.614243 Oct 10 18:55:50.727343 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 727/1610] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:50 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:50.858319 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7533e078-3102-4521-930c-65de3d3ff232 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:50.859387 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7533e078-3102-4521-930c-65de3d3ff232 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:50.869523 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7533e078-3102-4521-930c-65de3d3ff232 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:50.870835 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7533e078-3102-4521-930c-65de3d3ff232 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:50.872167 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7533e078-3102-4521-930c-65de3d3ff232 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:50.873572 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7533e078-3102-4521-930c-65de3d3ff232 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:50.874314 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7533e078-3102-4521-930c-65de3d3ff232 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:50.874981 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7533e078-3102-4521-930c-65de3d3ff232 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:51.143512 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-22f9ca62-a407-41e3-93b1-451856ea0a88 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:51.154155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-22f9ca62-a407-41e3-93b1-451856ea0a88 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:51.155470 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-22f9ca62-a407-41e3-93b1-451856ea0a88 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:51.156696 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-22f9ca62-a407-41e3-93b1-451856ea0a88 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.553933 Oct 10 18:55:51.157266 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 884/1611] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:50 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:51.201289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7533e078-3102-4521-930c-65de3d3ff232 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:51.209673 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7533e078-3102-4521-930c-65de3d3ff232 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1318 microversion: 2.1 time: 0.356768 Oct 10 18:55:51.211212 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 728/1612] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:50 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:55:51.635294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-905910a8-36d5-4ef2-915b-973cecf5ccd4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:51.640767 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-905910a8-36d5-4ef2-915b-973cecf5ccd4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:51.647909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-905910a8-36d5-4ef2-915b-973cecf5ccd4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:51.654389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-905910a8-36d5-4ef2-915b-973cecf5ccd4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:51.656963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-905910a8-36d5-4ef2-915b-973cecf5ccd4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:51.658231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-905910a8-36d5-4ef2-915b-973cecf5ccd4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:51.660686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-905910a8-36d5-4ef2-915b-973cecf5ccd4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:51.666078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-905910a8-36d5-4ef2-915b-973cecf5ccd4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:51.669613 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-7b13ed80-97b8-4f9c-9353-8733993e8d8e req-c274ed4f-3051-4980-91aa-4dcc962e65bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9100c55-d968-439f-be48-7ae2dc34f088", "tag": "bd1086b3-68d0-4b83-b228-5e51be022d0c"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:51.699011 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7b13ed80-97b8-4f9c-9353-8733993e8d8e req-c274ed4f-3051-4980-91aa-4dcc962e65bd service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:51.703797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7b13ed80-97b8-4f9c-9353-8733993e8d8e req-c274ed4f-3051-4980-91aa-4dcc962e65bd service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:51.704551 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7b13ed80-97b8-4f9c-9353-8733993e8d8e req-c274ed4f-3051-4980-91aa-4dcc962e65bd service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:51.741052 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-7b13ed80-97b8-4f9c-9353-8733993e8d8e req-c274ed4f-3051-4980-91aa-4dcc962e65bd service nova] Creating event network-changed:bd1086b3-68d0-4b83-b228-5e51be022d0c for instance b9100c55-d968-439f-be48-7ae2dc34f088 on n-h1-860863-1 Oct 10 18:55:51.757876 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-7b13ed80-97b8-4f9c-9353-8733993e8d8e req-c274ed4f-3051-4980-91aa-4dcc962e65bd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089833 Oct 10 18:55:51.757876 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 729/1613] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:51.779130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0ed8ce88-9fd1-4bda-b31f-2222e3116cf3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:51.779995 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0ed8ce88-9fd1-4bda-b31f-2222e3116cf3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:51.804331 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ed8ce88-9fd1-4bda-b31f-2222e3116cf3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:51.805184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ed8ce88-9fd1-4bda-b31f-2222e3116cf3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:51.805829 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ed8ce88-9fd1-4bda-b31f-2222e3116cf3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:51.806757 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ed8ce88-9fd1-4bda-b31f-2222e3116cf3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:51.807400 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ed8ce88-9fd1-4bda-b31f-2222e3116cf3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:51.807999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ed8ce88-9fd1-4bda-b31f-2222e3116cf3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:52.081923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-905910a8-36d5-4ef2-915b-973cecf5ccd4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:52.097091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-905910a8-36d5-4ef2-915b-973cecf5ccd4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:52.101505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-905910a8-36d5-4ef2-915b-973cecf5ccd4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:52.113563 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-905910a8-36d5-4ef2-915b-973cecf5ccd4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.482735 Oct 10 18:55:52.121588 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 885/1614] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:51 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:52.193587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-183d0b07-5f20-40c8-aa9e-46156d6b79e9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:52.195089 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-183d0b07-5f20-40c8-aa9e-46156d6b79e9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:52.222677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-183d0b07-5f20-40c8-aa9e-46156d6b79e9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:52.227132 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-183d0b07-5f20-40c8-aa9e-46156d6b79e9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:52.230515 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-183d0b07-5f20-40c8-aa9e-46156d6b79e9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:52.233768 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-183d0b07-5f20-40c8-aa9e-46156d6b79e9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:52.238646 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-183d0b07-5f20-40c8-aa9e-46156d6b79e9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:52.239122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-183d0b07-5f20-40c8-aa9e-46156d6b79e9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:52.675001 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0ed8ce88-9fd1-4bda-b31f-2222e3116cf3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:52.697969 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0ed8ce88-9fd1-4bda-b31f-2222e3116cf3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.941022 Oct 10 18:55:52.698940 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 730/1615] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:51 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:52.705843 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-62b15158-73fe-4e99-9815-fa1742f455be tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:52.706948 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-62b15158-73fe-4e99-9815-fa1742f455be tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:52.714455 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-62b15158-73fe-4e99-9815-fa1742f455be tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:52.715326 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-62b15158-73fe-4e99-9815-fa1742f455be tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:52.716096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-62b15158-73fe-4e99-9815-fa1742f455be tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:52.717597 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-62b15158-73fe-4e99-9815-fa1742f455be tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:52.718451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-62b15158-73fe-4e99-9815-fa1742f455be tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:52.719110 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-62b15158-73fe-4e99-9815-fa1742f455be tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:52.780434 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-183d0b07-5f20-40c8-aa9e-46156d6b79e9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:52.795102 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-183d0b07-5f20-40c8-aa9e-46156d6b79e9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:52.800655 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-183d0b07-5f20-40c8-aa9e-46156d6b79e9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:52.810584 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-183d0b07-5f20-40c8-aa9e-46156d6b79e9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.631114 Oct 10 18:55:52.812051 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 886/1616] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:52 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:55:53.150418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7681c7f4-0bc3-4d27-940e-61fdced2dee1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:53.151203 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7681c7f4-0bc3-4d27-940e-61fdced2dee1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:53.164850 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7681c7f4-0bc3-4d27-940e-61fdced2dee1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:53.165977 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7681c7f4-0bc3-4d27-940e-61fdced2dee1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:53.166413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7681c7f4-0bc3-4d27-940e-61fdced2dee1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:53.167149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7681c7f4-0bc3-4d27-940e-61fdced2dee1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:53.167586 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7681c7f4-0bc3-4d27-940e-61fdced2dee1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:53.168003 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7681c7f4-0bc3-4d27-940e-61fdced2dee1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:53.371148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7681c7f4-0bc3-4d27-940e-61fdced2dee1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:53.385914 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7681c7f4-0bc3-4d27-940e-61fdced2dee1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:53.390458 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7681c7f4-0bc3-4d27-940e-61fdced2dee1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:53.401322 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7681c7f4-0bc3-4d27-940e-61fdced2dee1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.254986 Oct 10 18:55:53.403145 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 887/1617] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:53 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:53.507052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-62b15158-73fe-4e99-9815-fa1742f455be tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:53.525428 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-62b15158-73fe-4e99-9815-fa1742f455be tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1318 microversion: 2.1 time: 0.823281 Oct 10 18:55:53.525917 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 731/1618] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:52 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1318 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:53.723567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-77c8d351-d258-421a-ae00-fed9997629e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:53.724377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-77c8d351-d258-421a-ae00-fed9997629e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:53.738208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-77c8d351-d258-421a-ae00-fed9997629e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:53.738992 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-77c8d351-d258-421a-ae00-fed9997629e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:53.739601 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-77c8d351-d258-421a-ae00-fed9997629e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:53.740617 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-77c8d351-d258-421a-ae00-fed9997629e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:53.741235 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-77c8d351-d258-421a-ae00-fed9997629e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:53.741818 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-77c8d351-d258-421a-ae00-fed9997629e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:53.853755 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9d6af3ec-7f2a-49be-abf8-44e1898a20f5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:53.854996 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9d6af3ec-7f2a-49be-abf8-44e1898a20f5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:53.883034 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9d6af3ec-7f2a-49be-abf8-44e1898a20f5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:53.883034 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9d6af3ec-7f2a-49be-abf8-44e1898a20f5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:53.883034 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9d6af3ec-7f2a-49be-abf8-44e1898a20f5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:53.883034 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9d6af3ec-7f2a-49be-abf8-44e1898a20f5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:53.892732 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9d6af3ec-7f2a-49be-abf8-44e1898a20f5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:53.899770 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9d6af3ec-7f2a-49be-abf8-44e1898a20f5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:54.485050 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9d6af3ec-7f2a-49be-abf8-44e1898a20f5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:54.485458 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-77c8d351-d258-421a-ae00-fed9997629e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:54.497453 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-77c8d351-d258-421a-ae00-fed9997629e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.777910 Oct 10 18:55:54.508188 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9d6af3ec-7f2a-49be-abf8-44e1898a20f5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:54.510941 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9d6af3ec-7f2a-49be-abf8-44e1898a20f5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:54.513499 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9d6af3ec-7f2a-49be-abf8-44e1898a20f5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.676783 Oct 10 18:55:54.530304 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 732/1620] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:53 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:55:54.530558 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 888/1620] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:53 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:54.553367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f588ee9d-a5a7-4d5b-8d98-48e9c2253e1f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:54.571892 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f588ee9d-a5a7-4d5b-8d98-48e9c2253e1f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:54.602231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f588ee9d-a5a7-4d5b-8d98-48e9c2253e1f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:54.603856 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f588ee9d-a5a7-4d5b-8d98-48e9c2253e1f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:54.605053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f588ee9d-a5a7-4d5b-8d98-48e9c2253e1f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:54.608053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f588ee9d-a5a7-4d5b-8d98-48e9c2253e1f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:54.609828 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f588ee9d-a5a7-4d5b-8d98-48e9c2253e1f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:54.612937 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f588ee9d-a5a7-4d5b-8d98-48e9c2253e1f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:54.798162 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f588ee9d-a5a7-4d5b-8d98-48e9c2253e1f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:54.819498 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f588ee9d-a5a7-4d5b-8d98-48e9c2253e1f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:54.824799 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0c21a15d-2ee5-455e-aebe-55d4e87aa56d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Action: 'create', calling method: .version_select at 0x7f318dc07ca0>, body: {"keypair": {"name": "tempest-keypair-1300263267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWwEWIw0kHx66mtSxFniXR6v3Zp9wXSmZFj846k+06YEeZ6q4BBw+JH0FnXgYqttP9Lu5KQVX4fW/SXkROiJ4ueIeKgx59NamWNzE7uJxiPjWE2WWsFkCf7i4VVZc8/4g=="}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:54.825011 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f588ee9d-a5a7-4d5b-8d98-48e9c2253e1f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:54.836480 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f588ee9d-a5a7-4d5b-8d98-48e9c2253e1f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.302581 Oct 10 18:55:54.847792 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 889/1621] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:54 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:54.853127 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1b63a648-465e-42f8-9377-f6cb32efb867 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:54.853748 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1b63a648-465e-42f8-9377-f6cb32efb867 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:54.865304 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b63a648-465e-42f8-9377-f6cb32efb867 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:54.867719 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b63a648-465e-42f8-9377-f6cb32efb867 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:54.868427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b63a648-465e-42f8-9377-f6cb32efb867 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:54.869906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b63a648-465e-42f8-9377-f6cb32efb867 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:54.871601 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b63a648-465e-42f8-9377-f6cb32efb867 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:54.875785 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b63a648-465e-42f8-9377-f6cb32efb867 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:54.876849 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-0c21a15d-2ee5-455e-aebe-55d4e87aa56d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Getting quotas for project 1d0646e6fd1a4e188bd1bf139a8ef575. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:55:54.902715 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-0c21a15d-2ee5-455e-aebe-55d4e87aa56d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Getting quotas for user 29c40dde2f644d6fbb0b4d8c77dfb4f3 and project 1d0646e6fd1a4e188bd1bf139a8ef575. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:55:54.910486 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:55.064519 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0c21a15d-2ee5-455e-aebe-55d4e87aa56d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.531601 Oct 10 18:55:55.071185 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 733/1622] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 18:55:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:55:55.210395 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1b63a648-465e-42f8-9377-f6cb32efb867 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:55.229345 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1b63a648-465e-42f8-9377-f6cb32efb867 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1318 microversion: 2.1 time: 0.377443 Oct 10 18:55:55.229996 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 890/1623] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:54 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:55.527406 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bb09b131-a34f-4d5d-aae4-98bf073a82cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:55.528482 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bb09b131-a34f-4d5d-aae4-98bf073a82cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:55.550702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e822523a-45f6-46e9-9306-e3d501527912 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:55.550702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e822523a-45f6-46e9-9306-e3d501527912 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:55.559345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e822523a-45f6-46e9-9306-e3d501527912 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:55.560169 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e822523a-45f6-46e9-9306-e3d501527912 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:55.560732 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb09b131-a34f-4d5d-aae4-98bf073a82cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:55.561332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e822523a-45f6-46e9-9306-e3d501527912 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:55.562012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb09b131-a34f-4d5d-aae4-98bf073a82cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:55.565664 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e822523a-45f6-46e9-9306-e3d501527912 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:55.566357 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb09b131-a34f-4d5d-aae4-98bf073a82cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:55.568496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb09b131-a34f-4d5d-aae4-98bf073a82cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:55.569683 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e822523a-45f6-46e9-9306-e3d501527912 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:55.573078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb09b131-a34f-4d5d-aae4-98bf073a82cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:55.573680 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e822523a-45f6-46e9-9306-e3d501527912 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:55.576631 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb09b131-a34f-4d5d-aae4-98bf073a82cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:55.838559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bb09b131-a34f-4d5d-aae4-98bf073a82cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:55.849113 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bb09b131-a34f-4d5d-aae4-98bf073a82cd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.327982 Oct 10 18:55:55.849995 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 734/1624] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:55 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:55.880059 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-967e71e1-cf4e-427b-9ef6-291935b4ac72 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:55.881335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-967e71e1-cf4e-427b-9ef6-291935b4ac72 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:55.894537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-967e71e1-cf4e-427b-9ef6-291935b4ac72 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:55.894537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-967e71e1-cf4e-427b-9ef6-291935b4ac72 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:55.894537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-967e71e1-cf4e-427b-9ef6-291935b4ac72 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:55.894537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-967e71e1-cf4e-427b-9ef6-291935b4ac72 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:55.894537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-967e71e1-cf4e-427b-9ef6-291935b4ac72 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:55.894537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-967e71e1-cf4e-427b-9ef6-291935b4ac72 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:56.036511 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-967e71e1-cf4e-427b-9ef6-291935b4ac72 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:56.053029 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-967e71e1-cf4e-427b-9ef6-291935b4ac72 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:56.056566 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-967e71e1-cf4e-427b-9ef6-291935b4ac72 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:56.064576 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e822523a-45f6-46e9-9306-e3d501527912 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:56.067199 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-967e71e1-cf4e-427b-9ef6-291935b4ac72 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.192454 Oct 10 18:55:56.081314 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 735/1625] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:55 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:55:56.088115 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e822523a-45f6-46e9-9306-e3d501527912 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:56.098949 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e822523a-45f6-46e9-9306-e3d501527912 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:56.098949 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e822523a-45f6-46e9-9306-e3d501527912 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.553699 Oct 10 18:55:56.098949 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 891/1626] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:55 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:56.254112 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f5bb7969-dbf3-44a4-9067-f37f7a7871a1 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:56.255285 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f5bb7969-dbf3-44a4-9067-f37f7a7871a1 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:56.269259 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5bb7969-dbf3-44a4-9067-f37f7a7871a1 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:56.269831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5bb7969-dbf3-44a4-9067-f37f7a7871a1 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:56.270826 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5bb7969-dbf3-44a4-9067-f37f7a7871a1 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:56.274740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5bb7969-dbf3-44a4-9067-f37f7a7871a1 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:56.275494 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5bb7969-dbf3-44a4-9067-f37f7a7871a1 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:56.277183 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f5bb7969-dbf3-44a4-9067-f37f7a7871a1 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:56.464838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-2060605006", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "e0c40499-bf5c-4e98-8a97-c71f2bc86049"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:56.563443 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] validate_networks() for [('e0c40499-bf5c-4e98-8a97-c71f2bc86049', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:55:56.663739 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f5bb7969-dbf3-44a4-9067-f37f7a7871a1 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:56.672072 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f5bb7969-dbf3-44a4-9067-f37f7a7871a1 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1318 microversion: 2.1 time: 0.422351 Oct 10 18:55:56.677696 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 736/1627] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:56 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:56.872829 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-46211300-50c4-440d-a5da-08265bd60607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:56.873458 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-46211300-50c4-440d-a5da-08265bd60607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:56.895022 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46211300-50c4-440d-a5da-08265bd60607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:56.895619 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46211300-50c4-440d-a5da-08265bd60607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:56.895947 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46211300-50c4-440d-a5da-08265bd60607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:56.896842 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46211300-50c4-440d-a5da-08265bd60607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:56.897527 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46211300-50c4-440d-a5da-08265bd60607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:56.898127 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46211300-50c4-440d-a5da-08265bd60607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:56.933302 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:55:57.127378 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-46211300-50c4-440d-a5da-08265bd60607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:57.136372 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-46211300-50c4-440d-a5da-08265bd60607 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.267430 Oct 10 18:55:57.138060 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 737/1628] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:56 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:55:57.167050 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8a842fd3-ffce-405e-a193-d045c9ffca67 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:57.167616 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8a842fd3-ffce-405e-a193-d045c9ffca67 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:57.174136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a842fd3-ffce-405e-a193-d045c9ffca67 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:57.174633 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a842fd3-ffce-405e-a193-d045c9ffca67 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:57.175070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a842fd3-ffce-405e-a193-d045c9ffca67 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:57.175769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a842fd3-ffce-405e-a193-d045c9ffca67 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:57.176221 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a842fd3-ffce-405e-a193-d045c9ffca67 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:57.176696 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a842fd3-ffce-405e-a193-d045c9ffca67 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:57.212105 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:55:57.213705 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:55:57.214360 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:55:57.215447 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:55:57.217662 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:55:57.249866 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:57.252665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:57.253334 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:57.254517 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:57.255194 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:57.255829 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:57.273465 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8a842fd3-ffce-405e-a193-d045c9ffca67 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:57.282423 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8a842fd3-ffce-405e-a193-d045c9ffca67 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:57.284282 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8a842fd3-ffce-405e-a193-d045c9ffca67 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:57.285457 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Getting quotas for project 8245cb89d7664082ad3ba7169cc152cc. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:55:57.291886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Getting quotas for user 8e1818c8c5154ce4934f5a85272e52f1 and project 8245cb89d7664082ad3ba7169cc152cc. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:55:57.292247 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8a842fd3-ffce-405e-a193-d045c9ffca67 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.129831 Oct 10 18:55:57.293066 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 738/1629] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:57 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:57.298198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1e582802-b846-4fad-81f2-587207d80b78 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:57.299018 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1e582802-b846-4fad-81f2-587207d80b78 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:57.305060 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1e582802-b846-4fad-81f2-587207d80b78 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:57.306513 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1e582802-b846-4fad-81f2-587207d80b78 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:57.307160 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1e582802-b846-4fad-81f2-587207d80b78 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:57.308092 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1e582802-b846-4fad-81f2-587207d80b78 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:57.308599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:55:57.308932 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1e582802-b846-4fad-81f2-587207d80b78 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:57.309684 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1e582802-b846-4fad-81f2-587207d80b78 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:57.311449 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:55:57.458660 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1e582802-b846-4fad-81f2-587207d80b78 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:57.469636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1e582802-b846-4fad-81f2-587207d80b78 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:57.474212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1e582802-b846-4fad-81f2-587207d80b78 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:57.477239 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1e582802-b846-4fad-81f2-587207d80b78 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.182975 Oct 10 18:55:57.478631 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 739/1630] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:57 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:57.502373 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e666e6fc-4042-4fe6-87bb-665b6763fe93 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.116587 Oct 10 18:55:57.503650 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 892/1631] 10.222.0.43 () {62 vars in 1188 bytes} [Mon Oct 10 18:55:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 18:55:57.515216 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d1a43c48-1c0c-4e0a-ad5b-c048f98f7558 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:57.516136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d1a43c48-1c0c-4e0a-ad5b-c048f98f7558 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:57.597437 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d1a43c48-1c0c-4e0a-ad5b-c048f98f7558 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:57.606815 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d1a43c48-1c0c-4e0a-ad5b-c048f98f7558 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:57.609150 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d1a43c48-1c0c-4e0a-ad5b-c048f98f7558 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:57.610606 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d1a43c48-1c0c-4e0a-ad5b-c048f98f7558 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1259 microversion: 2.21 time: 0.099749 Oct 10 18:55:57.612040 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 740/1632] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:57 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1259 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:57.700091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-37b7c1ee-badb-408d-863b-acb81af917d0 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:57.701519 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-37b7c1ee-badb-408d-863b-acb81af917d0 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:57.713966 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-37b7c1ee-badb-408d-863b-acb81af917d0 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:57.720146 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-37b7c1ee-badb-408d-863b-acb81af917d0 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:57.720455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-37b7c1ee-badb-408d-863b-acb81af917d0 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:57.721255 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-37b7c1ee-badb-408d-863b-acb81af917d0 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:57.721679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-37b7c1ee-badb-408d-863b-acb81af917d0 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:57.722105 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-37b7c1ee-badb-408d-863b-acb81af917d0 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:58.030402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-37b7c1ee-badb-408d-863b-acb81af917d0 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:58.043976 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-37b7c1ee-badb-408d-863b-acb81af917d0 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1318 microversion: 2.1 time: 0.348331 Oct 10 18:55:58.061079 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 893/1633] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:57 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:58.173033 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-46067ab1-f27b-49de-aaaf-3ad33933b0e7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:58.175811 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-46067ab1-f27b-49de-aaaf-3ad33933b0e7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:58.191459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46067ab1-f27b-49de-aaaf-3ad33933b0e7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:58.192030 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46067ab1-f27b-49de-aaaf-3ad33933b0e7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:58.204979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46067ab1-f27b-49de-aaaf-3ad33933b0e7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:58.206059 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46067ab1-f27b-49de-aaaf-3ad33933b0e7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:58.213149 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46067ab1-f27b-49de-aaaf-3ad33933b0e7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:58.215324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46067ab1-f27b-49de-aaaf-3ad33933b0e7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:58.325759 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-756e529b-5bda-4bb9-97d5-9467cb8ba9fa tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:58.326533 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-756e529b-5bda-4bb9-97d5-9467cb8ba9fa tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:58.353885 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-756e529b-5bda-4bb9-97d5-9467cb8ba9fa tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:58.360811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-756e529b-5bda-4bb9-97d5-9467cb8ba9fa tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:58.360811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-756e529b-5bda-4bb9-97d5-9467cb8ba9fa tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:58.360811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-756e529b-5bda-4bb9-97d5-9467cb8ba9fa tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:58.364258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-756e529b-5bda-4bb9-97d5-9467cb8ba9fa tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:58.384938 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-756e529b-5bda-4bb9-97d5-9467cb8ba9fa tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:58.572814 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-46067ab1-f27b-49de-aaaf-3ad33933b0e7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:58.595324 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-46067ab1-f27b-49de-aaaf-3ad33933b0e7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.433671 Oct 10 18:55:58.597032 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 741/1634] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:58 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:58.603724 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b9f193f2-8504-4fe6-a4f7-28f156d8dc46 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:58.604772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b9f193f2-8504-4fe6-a4f7-28f156d8dc46 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:58.613781 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9f193f2-8504-4fe6-a4f7-28f156d8dc46 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:58.614770 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9f193f2-8504-4fe6-a4f7-28f156d8dc46 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:58.615434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9f193f2-8504-4fe6-a4f7-28f156d8dc46 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:58.616897 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9f193f2-8504-4fe6-a4f7-28f156d8dc46 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:58.617576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9f193f2-8504-4fe6-a4f7-28f156d8dc46 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:58.618257 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b9f193f2-8504-4fe6-a4f7-28f156d8dc46 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:58.676909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-756e529b-5bda-4bb9-97d5-9467cb8ba9fa tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:58.686522 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-756e529b-5bda-4bb9-97d5-9467cb8ba9fa tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:58.688601 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-756e529b-5bda-4bb9-97d5-9467cb8ba9fa tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:58.694647 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-756e529b-5bda-4bb9-97d5-9467cb8ba9fa tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.373103 Oct 10 18:55:58.695237 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 894/1635] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:58 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:58.700903 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ae8b0124-7c5f-433d-9d0f-c01ace1ae9f1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:58.702194 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ae8b0124-7c5f-433d-9d0f-c01ace1ae9f1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:58.899127 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ae8b0124-7c5f-433d-9d0f-c01ace1ae9f1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:58.913883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ae8b0124-7c5f-433d-9d0f-c01ace1ae9f1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:58.919218 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ae8b0124-7c5f-433d-9d0f-c01ace1ae9f1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:58.930078 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ae8b0124-7c5f-433d-9d0f-c01ace1ae9f1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1259 microversion: 2.21 time: 0.231554 Oct 10 18:55:58.932319 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 895/1636] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:58 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:58.952576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b9f193f2-8504-4fe6-a4f7-28f156d8dc46 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:58.954635 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b9f193f2-8504-4fe6-a4f7-28f156d8dc46 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:58.960599 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b9f193f2-8504-4fe6-a4f7-28f156d8dc46 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:58.960599 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b9f193f2-8504-4fe6-a4f7-28f156d8dc46 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.358920 Oct 10 18:55:58.960599 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 742/1637] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:58 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:59.079126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-01fe8019-b33f-4345-9277-c843a122544d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:59.104516 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-01fe8019-b33f-4345-9277-c843a122544d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:59.104516 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01fe8019-b33f-4345-9277-c843a122544d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:59.104516 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01fe8019-b33f-4345-9277-c843a122544d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:59.104516 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01fe8019-b33f-4345-9277-c843a122544d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:59.104516 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01fe8019-b33f-4345-9277-c843a122544d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:59.104516 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01fe8019-b33f-4345-9277-c843a122544d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:59.104516 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01fe8019-b33f-4345-9277-c843a122544d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:59.421494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-01fe8019-b33f-4345-9277-c843a122544d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:59.438770 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-01fe8019-b33f-4345-9277-c843a122544d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1318 microversion: 2.1 time: 0.371120 Oct 10 18:55:59.441938 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 896/1638] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:59 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:59.622657 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f675ec52-490b-4e67-b5af-624f6f7e9c95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:59.623880 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f675ec52-490b-4e67-b5af-624f6f7e9c95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:59.630466 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f675ec52-490b-4e67-b5af-624f6f7e9c95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:59.630953 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f675ec52-490b-4e67-b5af-624f6f7e9c95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:59.631390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f675ec52-490b-4e67-b5af-624f6f7e9c95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:59.632095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f675ec52-490b-4e67-b5af-624f6f7e9c95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:59.632692 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f675ec52-490b-4e67-b5af-624f6f7e9c95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:59.633006 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f675ec52-490b-4e67-b5af-624f6f7e9c95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:59.727297 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-05930306-8766-4a97-93a2-86196439581e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:59.729363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-05930306-8766-4a97-93a2-86196439581e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:59.735636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-05930306-8766-4a97-93a2-86196439581e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:59.736404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-05930306-8766-4a97-93a2-86196439581e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:59.737057 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-05930306-8766-4a97-93a2-86196439581e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:59.737775 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-05930306-8766-4a97-93a2-86196439581e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:59.738417 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-05930306-8766-4a97-93a2-86196439581e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:59.738840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-05930306-8766-4a97-93a2-86196439581e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:59.815384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f675ec52-490b-4e67-b5af-624f6f7e9c95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:59.826133 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f675ec52-490b-4e67-b5af-624f6f7e9c95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.208542 Oct 10 18:55:59.853005 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 743/1639] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:55:59 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:55:59.885539 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-05930306-8766-4a97-93a2-86196439581e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:59.894781 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-05930306-8766-4a97-93a2-86196439581e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:59.896661 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-05930306-8766-4a97-93a2-86196439581e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:55:59.903115 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-05930306-8766-4a97-93a2-86196439581e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.179260 Oct 10 18:55:59.905517 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 897/1640] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:59 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:55:59.957229 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-544982084", "imageRef": "140e2dd4-c532-45f6-bdaf-59bd0a37c7ec", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b6b77769-8021-41ef-9edb-8326aae8558d"}], "security_groups": [{"name": "tempest-securitygroup--1939552740"}], "key_name": "tempest-keypair-1300263267", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:55:59.962552 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2fd303ac-781f-43cc-89c1-8c676b1d9b9c tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:55:59.963280 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2fd303ac-781f-43cc-89c1-8c676b1d9b9c tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:55:59.980894 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd303ac-781f-43cc-89c1-8c676b1d9b9c tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:59.981390 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd303ac-781f-43cc-89c1-8c676b1d9b9c tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:59.984936 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd303ac-781f-43cc-89c1-8c676b1d9b9c tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:55:59.985994 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd303ac-781f-43cc-89c1-8c676b1d9b9c tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:55:59.986497 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd303ac-781f-43cc-89c1-8c676b1d9b9c tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:55:59.986928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd303ac-781f-43cc-89c1-8c676b1d9b9c tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:00.122422 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2fd303ac-781f-43cc-89c1-8c676b1d9b9c tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:00.126263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:00.140107 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2fd303ac-781f-43cc-89c1-8c676b1d9b9c tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:00.141973 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2fd303ac-781f-43cc-89c1-8c676b1d9b9c tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:00.145416 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2fd303ac-781f-43cc-89c1-8c676b1d9b9c tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1263 microversion: 2.21 time: 0.186727 Oct 10 18:56:00.146455 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 898/1641] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:55:59 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1263 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:00.164492 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7570ec40-2846-453b-bdd1-22b55a8a208f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:00.169596 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] validate_networks() for [('b6b77769-8021-41ef-9edb-8326aae8558d', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:56:00.177682 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7570ec40-2846-453b-bdd1-22b55a8a208f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:00.188271 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7570ec40-2846-453b-bdd1-22b55a8a208f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:00.188794 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7570ec40-2846-453b-bdd1-22b55a8a208f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:00.216744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7570ec40-2846-453b-bdd1-22b55a8a208f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:00.217644 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7570ec40-2846-453b-bdd1-22b55a8a208f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:00.218132 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7570ec40-2846-453b-bdd1-22b55a8a208f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:00.218569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7570ec40-2846-453b-bdd1-22b55a8a208f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:00.521993 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7570ec40-2846-453b-bdd1-22b55a8a208f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:00.531501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7570ec40-2846-453b-bdd1-22b55a8a208f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:00.533762 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7570ec40-2846-453b-bdd1-22b55a8a208f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:00.538567 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7570ec40-2846-453b-bdd1-22b55a8a208f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.387795 Oct 10 18:56:00.538567 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 899/1642] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:00 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:00.560192 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d356921e-1976-46fd-b5ab-50587306eb4d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:00.561136 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d356921e-1976-46fd-b5ab-50587306eb4d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:00.568657 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d356921e-1976-46fd-b5ab-50587306eb4d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:00.569422 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d356921e-1976-46fd-b5ab-50587306eb4d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:00.570868 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d356921e-1976-46fd-b5ab-50587306eb4d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:00.572404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d356921e-1976-46fd-b5ab-50587306eb4d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:00.573744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d356921e-1976-46fd-b5ab-50587306eb4d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:00.574399 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d356921e-1976-46fd-b5ab-50587306eb4d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:00.749007 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:56:00.749763 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:56:00.750349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:56:00.750860 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:56:00.751381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:56:00.763941 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:00.764695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:00.765301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:00.766391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:00.766945 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:00.767469 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:00.787727 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Getting quotas for project 1d0646e6fd1a4e188bd1bf139a8ef575. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:56:00.795389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Getting quotas for user 29c40dde2f644d6fbb0b4d8c77dfb4f3 and project 1d0646e6fd1a4e188bd1bf139a8ef575. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:56:00.810725 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:56:00.815422 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='140e2dd4-c532-45f6-bdaf-59bd0a37c7ec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:56:00.884887 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d356921e-1976-46fd-b5ab-50587306eb4d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:00.895409 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d356921e-1976-46fd-b5ab-50587306eb4d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1318 microversion: 2.1 time: 0.341003 Oct 10 18:56:00.896353 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 900/1643] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:00 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:00.903438 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-5b6ffc32-d54a-46da-8ba6-f8644f3e1c91 req-b310d858-1947-4565-87c6-aadc38c9c804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9100c55-d968-439f-be48-7ae2dc34f088", "name": "network-vif-plugged", "status": "completed", "tag": "bd1086b3-68d0-4b83-b228-5e51be022d0c"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:00.940808 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5b6ffc32-d54a-46da-8ba6-f8644f3e1c91 req-b310d858-1947-4565-87c6-aadc38c9c804 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:00.943645 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5b6ffc32-d54a-46da-8ba6-f8644f3e1c91 req-b310d858-1947-4565-87c6-aadc38c9c804 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:00.943645 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-5b6ffc32-d54a-46da-8ba6-f8644f3e1c91 req-b310d858-1947-4565-87c6-aadc38c9c804 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:00.960659 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-5b6ffc32-d54a-46da-8ba6-f8644f3e1c91 req-b310d858-1947-4565-87c6-aadc38c9c804 service nova] Creating event network-vif-plugged:bd1086b3-68d0-4b83-b228-5e51be022d0c for instance b9100c55-d968-439f-be48-7ae2dc34f088 on n-h1-860863-1 Oct 10 18:56:00.973087 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-5b6ffc32-d54a-46da-8ba6-f8644f3e1c91 req-b310d858-1947-4565-87c6-aadc38c9c804 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068862 Oct 10 18:56:00.973087 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 901/1644] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:00.979663 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f2d60c63-15a7-4fa3-adb3-6fb117c70d9e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:00.980435 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f2d60c63-15a7-4fa3-adb3-6fb117c70d9e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:00.989114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2d60c63-15a7-4fa3-adb3-6fb117c70d9e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:00.989669 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2d60c63-15a7-4fa3-adb3-6fb117c70d9e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:00.991318 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2d60c63-15a7-4fa3-adb3-6fb117c70d9e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:00.992182 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2d60c63-15a7-4fa3-adb3-6fb117c70d9e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:00.993723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2d60c63-15a7-4fa3-adb3-6fb117c70d9e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:01.001211 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f8821b51-e036-49c9-8d3d-47225a2f50db tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.044047 Oct 10 18:56:01.001211 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 744/1645] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:55:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:56:01.001810 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2d60c63-15a7-4fa3-adb3-6fb117c70d9e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:01.033697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2ac54056-3d44-4030-b760-389cea3b1081 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:01.036376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2ac54056-3d44-4030-b760-389cea3b1081 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:01.052481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ac54056-3d44-4030-b760-389cea3b1081 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:01.055560 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ac54056-3d44-4030-b760-389cea3b1081 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:01.057690 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ac54056-3d44-4030-b760-389cea3b1081 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:01.059423 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ac54056-3d44-4030-b760-389cea3b1081 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:01.060292 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ac54056-3d44-4030-b760-389cea3b1081 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:01.060757 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2ac54056-3d44-4030-b760-389cea3b1081 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:01.131717 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2ac54056-3d44-4030-b760-389cea3b1081 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:01.143046 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2ac54056-3d44-4030-b760-389cea3b1081 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:01.143340 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2ac54056-3d44-4030-b760-389cea3b1081 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:01.150110 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2ac54056-3d44-4030-b760-389cea3b1081 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.145814 Oct 10 18:56:01.150825 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 745/1646] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:01 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:01.156739 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e3ba1aa1-91c3-4c08-a26b-ae1682978f8e tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:01.157964 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e3ba1aa1-91c3-4c08-a26b-ae1682978f8e tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:01.220076 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e3ba1aa1-91c3-4c08-a26b-ae1682978f8e tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:01.239606 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e3ba1aa1-91c3-4c08-a26b-ae1682978f8e tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1245 microversion: 2.1 time: 0.087138 Oct 10 18:56:01.240350 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 746/1647] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:01 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:01.245373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c05b99ba-db73-411b-b543-54a72ea2bbd3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:01.246225 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c05b99ba-db73-411b-b543-54a72ea2bbd3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:01.268260 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c05b99ba-db73-411b-b543-54a72ea2bbd3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:01.268827 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c05b99ba-db73-411b-b543-54a72ea2bbd3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:01.269299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c05b99ba-db73-411b-b543-54a72ea2bbd3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:01.270134 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c05b99ba-db73-411b-b543-54a72ea2bbd3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:01.270596 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c05b99ba-db73-411b-b543-54a72ea2bbd3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:01.271920 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c05b99ba-db73-411b-b543-54a72ea2bbd3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:01.366127 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c05b99ba-db73-411b-b543-54a72ea2bbd3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:01.374641 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c05b99ba-db73-411b-b543-54a72ea2bbd3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:01.376363 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c05b99ba-db73-411b-b543-54a72ea2bbd3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:01.377716 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c05b99ba-db73-411b-b543-54a72ea2bbd3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1311 microversion: 2.21 time: 0.136138 Oct 10 18:56:01.378762 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 747/1648] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:01 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1311 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:01.387937 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f2d60c63-15a7-4fa3-adb3-6fb117c70d9e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:01.397876 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f2d60c63-15a7-4fa3-adb3-6fb117c70d9e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.423855 Oct 10 18:56:01.398459 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 902/1649] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:00 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:01.561654 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f182339d-498d-4500-91c8-d5dd4fc7b64b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:01.562590 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f182339d-498d-4500-91c8-d5dd4fc7b64b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:01.571151 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f182339d-498d-4500-91c8-d5dd4fc7b64b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:01.572237 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f182339d-498d-4500-91c8-d5dd4fc7b64b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:01.573268 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f182339d-498d-4500-91c8-d5dd4fc7b64b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:01.573975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f182339d-498d-4500-91c8-d5dd4fc7b64b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:01.574691 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f182339d-498d-4500-91c8-d5dd4fc7b64b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:01.575127 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f182339d-498d-4500-91c8-d5dd4fc7b64b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:01.805087 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f182339d-498d-4500-91c8-d5dd4fc7b64b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:01.831777 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f182339d-498d-4500-91c8-d5dd4fc7b64b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:01.835722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f182339d-498d-4500-91c8-d5dd4fc7b64b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:01.840836 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f182339d-498d-4500-91c8-d5dd4fc7b64b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.282288 Oct 10 18:56:01.868191 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 748/1650] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:01 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:01.921484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-255d1602-2f71-4332-8a84-e08198ccca35 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:01.926769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-255d1602-2f71-4332-8a84-e08198ccca35 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:01.928798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-255d1602-2f71-4332-8a84-e08198ccca35 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:01.929337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-255d1602-2f71-4332-8a84-e08198ccca35 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:01.929766 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-255d1602-2f71-4332-8a84-e08198ccca35 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:01.930457 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-255d1602-2f71-4332-8a84-e08198ccca35 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:01.931446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-255d1602-2f71-4332-8a84-e08198ccca35 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:01.931866 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-255d1602-2f71-4332-8a84-e08198ccca35 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:02.113650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-255d1602-2f71-4332-8a84-e08198ccca35 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:02.127790 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-255d1602-2f71-4332-8a84-e08198ccca35 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1318 microversion: 2.1 time: 0.210888 Oct 10 18:56:02.128296 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 903/1651] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:01 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:02.184430 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ab6c056d-011b-4f7e-92bf-b278d689adf7 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:02.185491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ab6c056d-011b-4f7e-92bf-b278d689adf7 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:02.193465 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab6c056d-011b-4f7e-92bf-b278d689adf7 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:02.194297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab6c056d-011b-4f7e-92bf-b278d689adf7 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:02.195110 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab6c056d-011b-4f7e-92bf-b278d689adf7 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:02.197058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab6c056d-011b-4f7e-92bf-b278d689adf7 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:02.197961 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab6c056d-011b-4f7e-92bf-b278d689adf7 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:02.198606 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab6c056d-011b-4f7e-92bf-b278d689adf7 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:02.267757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bdb8c4f9-53ca-462f-b791-dd5c06ab9b29 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:02.268779 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bdb8c4f9-53ca-462f-b791-dd5c06ab9b29 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:02.284315 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:02.364564 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ab6c056d-011b-4f7e-92bf-b278d689adf7 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:02.375619 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ab6c056d-011b-4f7e-92bf-b278d689adf7 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:02.376694 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bdb8c4f9-53ca-462f-b791-dd5c06ab9b29 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:02.377152 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ab6c056d-011b-4f7e-92bf-b278d689adf7 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:02.382844 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ab6c056d-011b-4f7e-92bf-b278d689adf7 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.205719 Oct 10 18:56:02.383778 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 749/1652] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:02 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:02.386824 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bdb8c4f9-53ca-462f-b791-dd5c06ab9b29 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1245 microversion: 2.1 time: 0.125265 Oct 10 18:56:02.387393 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 904/1653] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:02 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1245 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:02.403742 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1c8b67b0-86ca-495b-a9d8-4de192fde1dc tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:02.404358 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1c8b67b0-86ca-495b-a9d8-4de192fde1dc tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:02.412368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c8b67b0-86ca-495b-a9d8-4de192fde1dc tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:02.413253 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c8b67b0-86ca-495b-a9d8-4de192fde1dc tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:02.414405 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c8b67b0-86ca-495b-a9d8-4de192fde1dc tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:02.416231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c8b67b0-86ca-495b-a9d8-4de192fde1dc tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:02.416976 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c8b67b0-86ca-495b-a9d8-4de192fde1dc tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:02.418138 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c8b67b0-86ca-495b-a9d8-4de192fde1dc tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:02.426475 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3f86b930-80b3-4a77-85c0-3c811412f08f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:02.427115 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3f86b930-80b3-4a77-85c0-3c811412f08f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:02.437746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f86b930-80b3-4a77-85c0-3c811412f08f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:02.439797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f86b930-80b3-4a77-85c0-3c811412f08f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:02.439797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f86b930-80b3-4a77-85c0-3c811412f08f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:02.439797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f86b930-80b3-4a77-85c0-3c811412f08f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:02.439797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f86b930-80b3-4a77-85c0-3c811412f08f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:02.440285 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f86b930-80b3-4a77-85c0-3c811412f08f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:02.529297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1c8b67b0-86ca-495b-a9d8-4de192fde1dc tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:02.538306 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1c8b67b0-86ca-495b-a9d8-4de192fde1dc tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:02.544438 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1c8b67b0-86ca-495b-a9d8-4de192fde1dc tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:02.545398 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1c8b67b0-86ca-495b-a9d8-4de192fde1dc tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1317 microversion: 2.21 time: 0.146286 Oct 10 18:56:02.546662 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 750/1654] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:02 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:56:02.749407 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3f86b930-80b3-4a77-85c0-3c811412f08f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:02.760843 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3f86b930-80b3-4a77-85c0-3c811412f08f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.339325 Oct 10 18:56:02.779355 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 905/1655] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:02 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:02.869836 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-47f120f2-5a42-4742-b20f-0f22257b2cfb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:02.870452 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-47f120f2-5a42-4742-b20f-0f22257b2cfb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:02.883327 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47f120f2-5a42-4742-b20f-0f22257b2cfb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:02.887988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47f120f2-5a42-4742-b20f-0f22257b2cfb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:02.887988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47f120f2-5a42-4742-b20f-0f22257b2cfb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:02.887988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47f120f2-5a42-4742-b20f-0f22257b2cfb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:02.887988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47f120f2-5a42-4742-b20f-0f22257b2cfb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:02.887988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47f120f2-5a42-4742-b20f-0f22257b2cfb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:03.153935 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a7172ad1-0fb0-48db-afa2-9770503b5a76 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:03.155309 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a7172ad1-0fb0-48db-afa2-9770503b5a76 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:03.174329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-47f120f2-5a42-4742-b20f-0f22257b2cfb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:03.179304 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7172ad1-0fb0-48db-afa2-9770503b5a76 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:03.181495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7172ad1-0fb0-48db-afa2-9770503b5a76 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:03.182372 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7172ad1-0fb0-48db-afa2-9770503b5a76 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:03.184953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7172ad1-0fb0-48db-afa2-9770503b5a76 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:03.185565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7172ad1-0fb0-48db-afa2-9770503b5a76 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:03.187707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7172ad1-0fb0-48db-afa2-9770503b5a76 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:03.195695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-47f120f2-5a42-4742-b20f-0f22257b2cfb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:03.201587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-47f120f2-5a42-4742-b20f-0f22257b2cfb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:03.217927 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-47f120f2-5a42-4742-b20f-0f22257b2cfb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.351866 Oct 10 18:56:03.221691 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 751/1656] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:02 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:03.415276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2eed2ef6-f8bb-4ba2-b785-d8c24bdf2996 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:03.416769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2eed2ef6-f8bb-4ba2-b785-d8c24bdf2996 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:03.426167 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2eed2ef6-f8bb-4ba2-b785-d8c24bdf2996 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:03.426926 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2eed2ef6-f8bb-4ba2-b785-d8c24bdf2996 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:03.427695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2eed2ef6-f8bb-4ba2-b785-d8c24bdf2996 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:03.429474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2eed2ef6-f8bb-4ba2-b785-d8c24bdf2996 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:03.430137 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2eed2ef6-f8bb-4ba2-b785-d8c24bdf2996 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:03.431636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2eed2ef6-f8bb-4ba2-b785-d8c24bdf2996 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:03.660500 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2eed2ef6-f8bb-4ba2-b785-d8c24bdf2996 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:03.670156 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2eed2ef6-f8bb-4ba2-b785-d8c24bdf2996 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:03.675085 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2eed2ef6-f8bb-4ba2-b785-d8c24bdf2996 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:03.684300 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2eed2ef6-f8bb-4ba2-b785-d8c24bdf2996 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.276084 Oct 10 18:56:03.686479 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 752/1657] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:03 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:03.687955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a7172ad1-0fb0-48db-afa2-9770503b5a76 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:03.697356 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fbf00e9d-c185-43e7-9221-4c90be6b5e35 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:03.697558 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a7172ad1-0fb0-48db-afa2-9770503b5a76 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1506 microversion: 2.1 time: 0.546723 Oct 10 18:56:03.697558 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 906/1658] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:03 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1506 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:03.698490 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fbf00e9d-c185-43e7-9221-4c90be6b5e35 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:03.706651 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fbf00e9d-c185-43e7-9221-4c90be6b5e35 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:03.706898 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1180e567-7bea-4b28-a6ba-b5dea84fba95 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:03.707487 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fbf00e9d-c185-43e7-9221-4c90be6b5e35 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:03.708004 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fbf00e9d-c185-43e7-9221-4c90be6b5e35 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:03.708198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1180e567-7bea-4b28-a6ba-b5dea84fba95 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:03.709252 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fbf00e9d-c185-43e7-9221-4c90be6b5e35 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:03.710041 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fbf00e9d-c185-43e7-9221-4c90be6b5e35 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:03.711130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fbf00e9d-c185-43e7-9221-4c90be6b5e35 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:03.727958 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1180e567-7bea-4b28-a6ba-b5dea84fba95 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:03.731727 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1180e567-7bea-4b28-a6ba-b5dea84fba95 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:03.732526 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1180e567-7bea-4b28-a6ba-b5dea84fba95 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:03.736693 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1180e567-7bea-4b28-a6ba-b5dea84fba95 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:03.740167 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1180e567-7bea-4b28-a6ba-b5dea84fba95 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:03.740654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1180e567-7bea-4b28-a6ba-b5dea84fba95 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:03.911913 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fbf00e9d-c185-43e7-9221-4c90be6b5e35 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:03.951707 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fbf00e9d-c185-43e7-9221-4c90be6b5e35 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1297 microversion: 2.1 time: 0.262925 Oct 10 18:56:03.953461 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 753/1659] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:03 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1297 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:03.969314 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fc57c986-64d7-456f-b01d-fee577bd8c6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:03.974341 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fc57c986-64d7-456f-b01d-fee577bd8c6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:03.999649 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc57c986-64d7-456f-b01d-fee577bd8c6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:04.003192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc57c986-64d7-456f-b01d-fee577bd8c6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:04.003192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc57c986-64d7-456f-b01d-fee577bd8c6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:04.003192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc57c986-64d7-456f-b01d-fee577bd8c6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:04.003192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc57c986-64d7-456f-b01d-fee577bd8c6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:04.003192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fc57c986-64d7-456f-b01d-fee577bd8c6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:04.189595 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1180e567-7bea-4b28-a6ba-b5dea84fba95 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:04.228324 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1180e567-7bea-4b28-a6ba-b5dea84fba95 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:04.228324 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1180e567-7bea-4b28-a6ba-b5dea84fba95 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:04.231132 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1180e567-7bea-4b28-a6ba-b5dea84fba95 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1359 microversion: 2.21 time: 0.527066 Oct 10 18:56:04.232345 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 907/1660] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:03 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1359 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:04.254226 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0eb4cc1b-3aa6-4782-87ef-66bba7ab8355 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:04.255119 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0eb4cc1b-3aa6-4782-87ef-66bba7ab8355 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:04.265132 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0eb4cc1b-3aa6-4782-87ef-66bba7ab8355 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:04.267292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0eb4cc1b-3aa6-4782-87ef-66bba7ab8355 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:04.267938 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0eb4cc1b-3aa6-4782-87ef-66bba7ab8355 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:04.268799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0eb4cc1b-3aa6-4782-87ef-66bba7ab8355 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:04.269263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0eb4cc1b-3aa6-4782-87ef-66bba7ab8355 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:04.269689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0eb4cc1b-3aa6-4782-87ef-66bba7ab8355 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:04.285149 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fc57c986-64d7-456f-b01d-fee577bd8c6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:04.296592 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fc57c986-64d7-456f-b01d-fee577bd8c6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.342225 Oct 10 18:56:04.301624 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 754/1661] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:03 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:04.684262 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0eb4cc1b-3aa6-4782-87ef-66bba7ab8355 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:04.693626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0eb4cc1b-3aa6-4782-87ef-66bba7ab8355 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:04.695129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0eb4cc1b-3aa6-4782-87ef-66bba7ab8355 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:04.696913 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0eb4cc1b-3aa6-4782-87ef-66bba7ab8355 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.447523 Oct 10 18:56:04.704252 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 908/1662] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:04 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:04.722157 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0fb80caa-9e95-4977-a7a3-1b2242b03160 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:04.722157 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0fb80caa-9e95-4977-a7a3-1b2242b03160 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:04.729875 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fb80caa-9e95-4977-a7a3-1b2242b03160 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:04.732362 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fb80caa-9e95-4977-a7a3-1b2242b03160 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:04.735299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fb80caa-9e95-4977-a7a3-1b2242b03160 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:04.736063 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fb80caa-9e95-4977-a7a3-1b2242b03160 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:04.736576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fb80caa-9e95-4977-a7a3-1b2242b03160 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:04.737183 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fb80caa-9e95-4977-a7a3-1b2242b03160 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:04.755173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-dd6d8515-6dad-4749-8d07-7b3ecb99dc75 req-7ed14e7b-dd20-49a3-a729-6adcd711bd10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a19e7ee-040c-4614-87d7-622da642b798", "tag": "bdf44f97-51c7-41a6-858c-40107852753a"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:04.796297 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-dd6d8515-6dad-4749-8d07-7b3ecb99dc75 req-7ed14e7b-dd20-49a3-a729-6adcd711bd10 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:04.800414 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-dd6d8515-6dad-4749-8d07-7b3ecb99dc75 req-7ed14e7b-dd20-49a3-a729-6adcd711bd10 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:04.801147 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-dd6d8515-6dad-4749-8d07-7b3ecb99dc75 req-7ed14e7b-dd20-49a3-a729-6adcd711bd10 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:04.842399 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-dd6d8515-6dad-4749-8d07-7b3ecb99dc75 req-7ed14e7b-dd20-49a3-a729-6adcd711bd10 service nova] Creating event network-changed:bdf44f97-51c7-41a6-858c-40107852753a for instance 4a19e7ee-040c-4614-87d7-622da642b798 on n-h2-860863-1 Oct 10 18:56:04.870927 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-dd6d8515-6dad-4749-8d07-7b3ecb99dc75 req-7ed14e7b-dd20-49a3-a729-6adcd711bd10 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125367 Oct 10 18:56:04.881637 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 909/1663] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:04.997068 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7927d7ca-8f50-42af-9dc5-39b032f42771 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:04.999910 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7927d7ca-8f50-42af-9dc5-39b032f42771 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:05.009648 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0fb80caa-9e95-4977-a7a3-1b2242b03160 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:05.024038 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0fb80caa-9e95-4977-a7a3-1b2242b03160 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:05.028153 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0fb80caa-9e95-4977-a7a3-1b2242b03160 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:05.030376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7927d7ca-8f50-42af-9dc5-39b032f42771 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:05.031473 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7927d7ca-8f50-42af-9dc5-39b032f42771 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:05.032116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7927d7ca-8f50-42af-9dc5-39b032f42771 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:05.033291 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7927d7ca-8f50-42af-9dc5-39b032f42771 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:05.035174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7927d7ca-8f50-42af-9dc5-39b032f42771 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:05.040355 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7927d7ca-8f50-42af-9dc5-39b032f42771 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:05.061833 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0fb80caa-9e95-4977-a7a3-1b2242b03160 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.346174 Oct 10 18:56:05.064176 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 755/1664] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:04 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:05.185739 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7927d7ca-8f50-42af-9dc5-39b032f42771 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:05.201790 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7927d7ca-8f50-42af-9dc5-39b032f42771 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1303 microversion: 2.1 time: 0.222350 Oct 10 18:56:05.207490 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 910/1665] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:04 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1303 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:05.263323 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bb3f3c7a-5278-4d05-9b26-c2c3f1d0a19f tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:05.263644 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bb3f3c7a-5278-4d05-9b26-c2c3f1d0a19f tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:05.278718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb3f3c7a-5278-4d05-9b26-c2c3f1d0a19f tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:05.278718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb3f3c7a-5278-4d05-9b26-c2c3f1d0a19f tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:05.278718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb3f3c7a-5278-4d05-9b26-c2c3f1d0a19f tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:05.278718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb3f3c7a-5278-4d05-9b26-c2c3f1d0a19f tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:05.278718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb3f3c7a-5278-4d05-9b26-c2c3f1d0a19f tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:05.278718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb3f3c7a-5278-4d05-9b26-c2c3f1d0a19f tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:05.308874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:05.326208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-75c69467-01c1-4087-827f-2b988f729674 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:05.327643 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-75c69467-01c1-4087-827f-2b988f729674 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:05.338204 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75c69467-01c1-4087-827f-2b988f729674 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:05.343451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75c69467-01c1-4087-827f-2b988f729674 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:05.343989 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75c69467-01c1-4087-827f-2b988f729674 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:05.345850 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75c69467-01c1-4087-827f-2b988f729674 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:05.348134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75c69467-01c1-4087-827f-2b988f729674 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:05.349310 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75c69467-01c1-4087-827f-2b988f729674 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:05.619504 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bb3f3c7a-5278-4d05-9b26-c2c3f1d0a19f tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:05.635959 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bb3f3c7a-5278-4d05-9b26-c2c3f1d0a19f tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:05.642432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bb3f3c7a-5278-4d05-9b26-c2c3f1d0a19f tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:05.649046 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bb3f3c7a-5278-4d05-9b26-c2c3f1d0a19f tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1359 microversion: 2.21 time: 0.390945 Oct 10 18:56:05.653239 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 756/1666] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:05 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1359 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:05.728620 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-128deff3-2b15-48af-9a73-5a5a79636fcb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:05.729613 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-128deff3-2b15-48af-9a73-5a5a79636fcb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:05.755454 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-128deff3-2b15-48af-9a73-5a5a79636fcb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:05.758420 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-128deff3-2b15-48af-9a73-5a5a79636fcb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:05.759094 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-128deff3-2b15-48af-9a73-5a5a79636fcb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:05.760026 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-128deff3-2b15-48af-9a73-5a5a79636fcb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:05.764246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-128deff3-2b15-48af-9a73-5a5a79636fcb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:05.767166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-128deff3-2b15-48af-9a73-5a5a79636fcb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:05.931360 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-75c69467-01c1-4087-827f-2b988f729674 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:05.943481 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-75c69467-01c1-4087-827f-2b988f729674 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.622141 Oct 10 18:56:05.946772 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 911/1667] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:05 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:06.094956 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ca2f05bc-81ff-4064-928d-109e278109cc tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:06.095651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ca2f05bc-81ff-4064-928d-109e278109cc tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:06.102318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-128deff3-2b15-48af-9a73-5a5a79636fcb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:06.109252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca2f05bc-81ff-4064-928d-109e278109cc tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:06.110163 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca2f05bc-81ff-4064-928d-109e278109cc tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:06.113540 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca2f05bc-81ff-4064-928d-109e278109cc tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:06.116051 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca2f05bc-81ff-4064-928d-109e278109cc tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:06.117719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-128deff3-2b15-48af-9a73-5a5a79636fcb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:06.118722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca2f05bc-81ff-4064-928d-109e278109cc tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:06.119889 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca2f05bc-81ff-4064-928d-109e278109cc tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:06.120591 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-128deff3-2b15-48af-9a73-5a5a79636fcb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:06.122459 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-128deff3-2b15-48af-9a73-5a5a79636fcb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.399823 Oct 10 18:56:06.142804 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 757/1668] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:05 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:56:06.230312 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ce0d69fe-0b96-4f3d-af12-0e90b9e9ff70 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:06.231124 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ce0d69fe-0b96-4f3d-af12-0e90b9e9ff70 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:06.247428 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce0d69fe-0b96-4f3d-af12-0e90b9e9ff70 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:06.250376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce0d69fe-0b96-4f3d-af12-0e90b9e9ff70 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:06.250376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce0d69fe-0b96-4f3d-af12-0e90b9e9ff70 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:06.250376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce0d69fe-0b96-4f3d-af12-0e90b9e9ff70 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:06.250376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce0d69fe-0b96-4f3d-af12-0e90b9e9ff70 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:06.253345 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce0d69fe-0b96-4f3d-af12-0e90b9e9ff70 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:06.347453 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ca2f05bc-81ff-4064-928d-109e278109cc tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:06.363079 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ca2f05bc-81ff-4064-928d-109e278109cc tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:06.370964 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ca2f05bc-81ff-4064-928d-109e278109cc tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:06.386512 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ca2f05bc-81ff-4064-928d-109e278109cc tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1560 microversion: 2.91 time: 0.295612 Oct 10 18:56:06.389950 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 912/1669] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:06 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1560 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:56:06.689025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-55a1c4e0-93c5-49e3-bf1a-59510effc596 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:06.689975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-55a1c4e0-93c5-49e3-bf1a-59510effc596 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:06.709491 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55a1c4e0-93c5-49e3-bf1a-59510effc596 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:06.710413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55a1c4e0-93c5-49e3-bf1a-59510effc596 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:06.721581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55a1c4e0-93c5-49e3-bf1a-59510effc596 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:06.722844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55a1c4e0-93c5-49e3-bf1a-59510effc596 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:06.728711 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55a1c4e0-93c5-49e3-bf1a-59510effc596 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:06.729527 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55a1c4e0-93c5-49e3-bf1a-59510effc596 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:06.853350 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ce0d69fe-0b96-4f3d-af12-0e90b9e9ff70 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:06.868897 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ce0d69fe-0b96-4f3d-af12-0e90b9e9ff70 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1371 microversion: 2.1 time: 0.638868 Oct 10 18:56:06.869369 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 758/1670] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:06 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1371 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:56:06.973618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-389d4e9e-52b4-4a83-b399-c6a925f10dfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:06.974500 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-389d4e9e-52b4-4a83-b399-c6a925f10dfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:06.986692 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-389d4e9e-52b4-4a83-b399-c6a925f10dfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:06.987438 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-389d4e9e-52b4-4a83-b399-c6a925f10dfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:06.989107 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-389d4e9e-52b4-4a83-b399-c6a925f10dfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:06.990038 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-389d4e9e-52b4-4a83-b399-c6a925f10dfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:07.002538 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-389d4e9e-52b4-4a83-b399-c6a925f10dfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:07.003232 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-389d4e9e-52b4-4a83-b399-c6a925f10dfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:07.260318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-389d4e9e-52b4-4a83-b399-c6a925f10dfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:07.270904 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:07.277491 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-389d4e9e-52b4-4a83-b399-c6a925f10dfb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.304740 Oct 10 18:56:07.279139 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 759/1671] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:06 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:56:07.288599 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-879c9f80-6cbb-426f-99ef-ea995f6b154f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:07.292395 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-879c9f80-6cbb-426f-99ef-ea995f6b154f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:07.317676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-879c9f80-6cbb-426f-99ef-ea995f6b154f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:07.324523 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-879c9f80-6cbb-426f-99ef-ea995f6b154f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:07.324523 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-879c9f80-6cbb-426f-99ef-ea995f6b154f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:07.324523 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-879c9f80-6cbb-426f-99ef-ea995f6b154f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:07.331198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-879c9f80-6cbb-426f-99ef-ea995f6b154f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:07.332056 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-879c9f80-6cbb-426f-99ef-ea995f6b154f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:07.622885 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55a1c4e0-93c5-49e3-bf1a-59510effc596 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:07.631400 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-879c9f80-6cbb-426f-99ef-ea995f6b154f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:07.654541 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-879c9f80-6cbb-426f-99ef-ea995f6b154f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:07.656342 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-879c9f80-6cbb-426f-99ef-ea995f6b154f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:07.660364 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55a1c4e0-93c5-49e3-bf1a-59510effc596 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:07.665504 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-879c9f80-6cbb-426f-99ef-ea995f6b154f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.383347 Oct 10 18:56:07.666855 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 760/1672] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:07 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:07.673720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-acb83a3f-fa88-4fd1-aa83-31ac4a77347d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:07.674195 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55a1c4e0-93c5-49e3-bf1a-59510effc596 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:07.674782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-acb83a3f-fa88-4fd1-aa83-31ac4a77347d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:07.681659 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-acb83a3f-fa88-4fd1-aa83-31ac4a77347d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:07.682425 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-acb83a3f-fa88-4fd1-aa83-31ac4a77347d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:07.683090 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-55a1c4e0-93c5-49e3-bf1a-59510effc596 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1359 microversion: 2.21 time: 0.991323 Oct 10 18:56:07.683617 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-acb83a3f-fa88-4fd1-aa83-31ac4a77347d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:07.685129 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-acb83a3f-fa88-4fd1-aa83-31ac4a77347d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:07.685640 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 913/1673] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:06 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1359 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:56:07.686044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-acb83a3f-fa88-4fd1-aa83-31ac4a77347d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:07.686653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-acb83a3f-fa88-4fd1-aa83-31ac4a77347d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:07.772677 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-acb83a3f-fa88-4fd1-aa83-31ac4a77347d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:07.785502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-acb83a3f-fa88-4fd1-aa83-31ac4a77347d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:07.787657 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-acb83a3f-fa88-4fd1-aa83-31ac4a77347d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:07.817002 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-acb83a3f-fa88-4fd1-aa83-31ac4a77347d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1560 microversion: 2.91 time: 0.147302 Oct 10 18:56:07.820260 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 761/1674] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:07 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:07.900952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e20262b8-b3e0-4730-8630-f2e929ab9649 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:07.902598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e20262b8-b3e0-4730-8630-f2e929ab9649 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:07.921495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e20262b8-b3e0-4730-8630-f2e929ab9649 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:07.926732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e20262b8-b3e0-4730-8630-f2e929ab9649 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:07.926732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e20262b8-b3e0-4730-8630-f2e929ab9649 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:07.926732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e20262b8-b3e0-4730-8630-f2e929ab9649 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:07.926732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e20262b8-b3e0-4730-8630-f2e929ab9649 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:07.926732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e20262b8-b3e0-4730-8630-f2e929ab9649 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:07.930304 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-3083d625-a644-4aa3-9823-225945d1493e req-f32fd452-dce8-4829-bf5e-d0d638fbbbce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d79eab-1807-4467-b325-fe5f723ac559", "name": "network-vif-unplugged", "status": "completed", "tag": "d4cf66ab-04c3-441b-9f60-e83abdbe71aa"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:07.951070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-3083d625-a644-4aa3-9823-225945d1493e req-f32fd452-dce8-4829-bf5e-d0d638fbbbce service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:07.951653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-3083d625-a644-4aa3-9823-225945d1493e req-f32fd452-dce8-4829-bf5e-d0d638fbbbce service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:07.952130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-3083d625-a644-4aa3-9823-225945d1493e req-f32fd452-dce8-4829-bf5e-d0d638fbbbce service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:07.977919 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-3083d625-a644-4aa3-9823-225945d1493e req-f32fd452-dce8-4829-bf5e-d0d638fbbbce service nova] Creating event network-vif-unplugged:d4cf66ab-04c3-441b-9f60-e83abdbe71aa for instance 96d79eab-1807-4467-b325-fe5f723ac559 on n-h1-860863-1 Oct 10 18:56:07.995234 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-3083d625-a644-4aa3-9823-225945d1493e req-f32fd452-dce8-4829-bf5e-d0d638fbbbce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069099 Oct 10 18:56:07.995898 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 762/1675] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:56:08.122581 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cc72bcb5-a4e2-4b35-a3b7-52755e1090a3 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "a4be274a-4fbc-49fa-921d-a25341408862"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:08.125394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cc72bcb5-a4e2-4b35-a3b7-52755e1090a3 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:08.138783 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc72bcb5-a4e2-4b35-a3b7-52755e1090a3 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:08.139324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc72bcb5-a4e2-4b35-a3b7-52755e1090a3 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:08.139703 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc72bcb5-a4e2-4b35-a3b7-52755e1090a3 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:08.140407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc72bcb5-a4e2-4b35-a3b7-52755e1090a3 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:08.153297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc72bcb5-a4e2-4b35-a3b7-52755e1090a3 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:08.154029 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc72bcb5-a4e2-4b35-a3b7-52755e1090a3 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:08.283158 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-cc72bcb5-a4e2-4b35-a3b7-52755e1090a3 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] HTTP exception thrown: Volume 17a805b7-9a6f-4767-9d95-f49e74eeaccf could not be found. Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cc72bcb5-a4e2-4b35-a3b7-52755e1090a3 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Request method failure captured: Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: request: PUT /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088/os-volume_attachments/17a805b7-9a6f-4767-9d95-f49e74eeaccf HTTP/1.1 Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 74 Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGov0ZJ5ZX9PpJVZXDwy1L8KC6BkNAAKrUvL7YyGaRBw0LGWGNmcBZhvdBcuzfNATyS65KVnUuuWYMBblmD_rTSXtMYX5OOVWOaJLsNX2FW6-bWYAXxSm7FIA8OnHjZIfbkPr7A9HLzPmZKVBBjnFjHXF6BcBGdMnxvm4Bv3_QfqIuQ Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: d1939d4e7b974c178c3e5d191df3d6f6 Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-VolumesAdminNegativeTest-555995593 Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader,admin Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader,admin Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d1939d4e7b974c178c3e5d191df3d6f6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d1939d4e7b974c178c3e5d191df3d6f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1939d4e7b974c178c3e5d191df3d6f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1939d4e7b974c178c3e5d191df3d6f6"}]}] Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-VolumesAdminNegativeTest-555995593 Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: d1939d4e7b974c178c3e5d191df3d6f6 Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-555995593 Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-VolumesAdminNegativeTest-555995593-project-admin Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 43406c14b23a4163bad7d8faf7a4645a Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-VolumesAdminNegativeTest-555995593-project-admin Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: {"volumeAttachment": {"volumeId": "a4be274a-4fbc-49fa-921d-a25341408862"}} Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: exception: Volume 17a805b7-9a6f-4767-9d95-f49e74eeaccf could not be found. Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'server_id': 'b9100c55-d968-439f-be48-7ae2dc34f088', 'id': '17a805b7-9a6f-4767-9d95-f49e74eeaccf', 'body': {'volumeAttachment': {'volumeId': 'a4be274a-4fbc-49fa-921d-a25341408862'}}} Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 17a805b7-9a6f-4767-9d95-f49e74eeaccf could not be found. (HTTP 404) (Request-ID: req-2a194de7-0367-43d0-b6f2-fa4ae0ab8bf8) Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 10 18:56:08.310541 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 17a805b7-9a6f-4767-9d95-f49e74eeaccf could not be found. Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 17a805b7-9a6f-4767-9d95-f49e74eeaccf could not be found. Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 17a805b7-9a6f-4767-9d95-f49e74eeaccf could not be found. Oct 10 18:56:08.316765 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:56:08.323684 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cc72bcb5-a4e2-4b35-a3b7-52755e1090a3 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] Returning 404 to user: Volume 17a805b7-9a6f-4767-9d95-f49e74eeaccf could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:56:08.324513 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cc72bcb5-a4e2-4b35-a3b7-52755e1090a3 tempest-VolumesAdminNegativeTest-555995593 tempest-VolumesAdminNegativeTest-555995593-project-admin] 10.222.0.43 "PUT /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088/os-volume_attachments/17a805b7-9a6f-4767-9d95-f49e74eeaccf" status: 404 len: 109 microversion: 2.1 time: 0.207176 Oct 10 18:56:08.325698 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 763/1676] 10.222.0.43 () {60 vars in 1433 bytes} [Mon Oct 10 18:56:08 2022] PUT /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088/os-volume_attachments/17a805b7-9a6f-4767-9d95-f49e74eeaccf => generated 109 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 18:56:08.343702 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a0dea281-60e7-4311-a2c4-640c7eeef86d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:08.350428 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a0dea281-60e7-4311-a2c4-640c7eeef86d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:08.357683 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:08.369453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a0dea281-60e7-4311-a2c4-640c7eeef86d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:08.370296 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a0dea281-60e7-4311-a2c4-640c7eeef86d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:08.373602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a0dea281-60e7-4311-a2c4-640c7eeef86d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:08.373602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a0dea281-60e7-4311-a2c4-640c7eeef86d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:08.373602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a0dea281-60e7-4311-a2c4-640c7eeef86d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:08.373602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a0dea281-60e7-4311-a2c4-640c7eeef86d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:08.572418 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a0dea281-60e7-4311-a2c4-640c7eeef86d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:08.596044 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a0dea281-60e7-4311-a2c4-640c7eeef86d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.268965 Oct 10 18:56:08.637174 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 764/1677] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:08 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:08.698054 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ab29b7b0-aff7-4575-86d3-555e2cc944a5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:08.698725 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ab29b7b0-aff7-4575-86d3-555e2cc944a5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:08.713658 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab29b7b0-aff7-4575-86d3-555e2cc944a5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:08.728919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab29b7b0-aff7-4575-86d3-555e2cc944a5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:08.729866 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab29b7b0-aff7-4575-86d3-555e2cc944a5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:08.730887 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab29b7b0-aff7-4575-86d3-555e2cc944a5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:08.731592 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab29b7b0-aff7-4575-86d3-555e2cc944a5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:08.732275 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab29b7b0-aff7-4575-86d3-555e2cc944a5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:08.964925 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e20262b8-b3e0-4730-8630-f2e929ab9649 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:08.975041 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e20262b8-b3e0-4730-8630-f2e929ab9649 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1371 microversion: 2.1 time: 1.083986 Oct 10 18:56:08.975629 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 914/1678] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:07 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1371 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:09.005298 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-51092fcc-6f5d-4a77-98bd-5fa53079fae1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:09.005298 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-51092fcc-6f5d-4a77-98bd-5fa53079fae1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:09.023195 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-51092fcc-6f5d-4a77-98bd-5fa53079fae1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:09.028735 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-51092fcc-6f5d-4a77-98bd-5fa53079fae1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:09.032090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-51092fcc-6f5d-4a77-98bd-5fa53079fae1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:09.032090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-51092fcc-6f5d-4a77-98bd-5fa53079fae1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:09.032090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-51092fcc-6f5d-4a77-98bd-5fa53079fae1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:09.032090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-51092fcc-6f5d-4a77-98bd-5fa53079fae1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:09.099553 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ab29b7b0-aff7-4575-86d3-555e2cc944a5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:09.145347 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ab29b7b0-aff7-4575-86d3-555e2cc944a5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:09.152088 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ab29b7b0-aff7-4575-86d3-555e2cc944a5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:09.159393 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ab29b7b0-aff7-4575-86d3-555e2cc944a5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.461660 Oct 10 18:56:09.162324 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 765/1679] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:08 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:56:09.187570 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1fd92924-7ce3-4ee1-ac87-68d857aa3260 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:09.191552 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1fd92924-7ce3-4ee1-ac87-68d857aa3260 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:09.215498 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1fd92924-7ce3-4ee1-ac87-68d857aa3260 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:09.215498 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1fd92924-7ce3-4ee1-ac87-68d857aa3260 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:09.223003 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1fd92924-7ce3-4ee1-ac87-68d857aa3260 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:09.227241 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1fd92924-7ce3-4ee1-ac87-68d857aa3260 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:09.228281 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1fd92924-7ce3-4ee1-ac87-68d857aa3260 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:09.232984 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1fd92924-7ce3-4ee1-ac87-68d857aa3260 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:09.681604 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1fd92924-7ce3-4ee1-ac87-68d857aa3260 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:09.692123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-51092fcc-6f5d-4a77-98bd-5fa53079fae1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:09.702470 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1fd92924-7ce3-4ee1-ac87-68d857aa3260 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:09.706985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-51092fcc-6f5d-4a77-98bd-5fa53079fae1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:09.708454 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1fd92924-7ce3-4ee1-ac87-68d857aa3260 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:09.715323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-51092fcc-6f5d-4a77-98bd-5fa53079fae1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:09.718831 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-51092fcc-6f5d-4a77-98bd-5fa53079fae1 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1359 microversion: 2.21 time: 0.734861 Oct 10 18:56:09.733655 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1fd92924-7ce3-4ee1-ac87-68d857aa3260 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.559286 Oct 10 18:56:09.733655 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 766/1680] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:09 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:09.739324 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 915/1681] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:08 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1359 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:09.745994 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e4d9839a-2ab5-49e7-a9f1-bc8dc47e45e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:09.746638 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e4d9839a-2ab5-49e7-a9f1-bc8dc47e45e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:09.769556 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e4d9839a-2ab5-49e7-a9f1-bc8dc47e45e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:09.770384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e4d9839a-2ab5-49e7-a9f1-bc8dc47e45e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:09.771887 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e4d9839a-2ab5-49e7-a9f1-bc8dc47e45e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:09.776260 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e4d9839a-2ab5-49e7-a9f1-bc8dc47e45e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:09.777416 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e4d9839a-2ab5-49e7-a9f1-bc8dc47e45e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:09.780620 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e4d9839a-2ab5-49e7-a9f1-bc8dc47e45e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:10.001560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3331d373-f791-4adc-8384-44047615ca34 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:10.002910 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3331d373-f791-4adc-8384-44047615ca34 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:10.018139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3331d373-f791-4adc-8384-44047615ca34 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:10.019711 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3331d373-f791-4adc-8384-44047615ca34 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:10.021095 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3331d373-f791-4adc-8384-44047615ca34 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:10.025098 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3331d373-f791-4adc-8384-44047615ca34 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:10.025098 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3331d373-f791-4adc-8384-44047615ca34 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:10.027514 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3331d373-f791-4adc-8384-44047615ca34 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:10.786330 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:10.842657 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3331d373-f791-4adc-8384-44047615ca34 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:10.852161 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3331d373-f791-4adc-8384-44047615ca34 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1371 microversion: 2.1 time: 0.854445 Oct 10 18:56:10.860489 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 916/1682] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:09 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1371 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:56:10.876571 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-c2d2a367-4585-4fb7-bce9-64a0cdc86e95 req-2f364b38-40f9-44a1-ada8-f4b8579a443f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d79eab-1807-4467-b325-fe5f723ac559", "tag": "d4cf66ab-04c3-441b-9f60-e83abdbe71aa"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:10.892836 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c2d2a367-4585-4fb7-bce9-64a0cdc86e95 req-2f364b38-40f9-44a1-ada8-f4b8579a443f service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:10.893663 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c2d2a367-4585-4fb7-bce9-64a0cdc86e95 req-2f364b38-40f9-44a1-ada8-f4b8579a443f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:10.894263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c2d2a367-4585-4fb7-bce9-64a0cdc86e95 req-2f364b38-40f9-44a1-ada8-f4b8579a443f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:10.939080 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-c2d2a367-4585-4fb7-bce9-64a0cdc86e95 req-2f364b38-40f9-44a1-ada8-f4b8579a443f service nova] Creating event network-changed:d4cf66ab-04c3-441b-9f60-e83abdbe71aa for instance 96d79eab-1807-4467-b325-fe5f723ac559 on n-h1-860863-1 Oct 10 18:56:10.954448 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-c2d2a367-4585-4fb7-bce9-64a0cdc86e95 req-2f364b38-40f9-44a1-ada8-f4b8579a443f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092404 Oct 10 18:56:10.955467 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 917/1683] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:10.969376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ed4ce2a0-5c29-4d03-8c35-10eaedae7638 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:10.970102 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ed4ce2a0-5c29-4d03-8c35-10eaedae7638 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:10.998921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed4ce2a0-5c29-4d03-8c35-10eaedae7638 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:10.999738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed4ce2a0-5c29-4d03-8c35-10eaedae7638 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:11.008053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed4ce2a0-5c29-4d03-8c35-10eaedae7638 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:11.009772 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed4ce2a0-5c29-4d03-8c35-10eaedae7638 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:11.010426 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed4ce2a0-5c29-4d03-8c35-10eaedae7638 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:11.011033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed4ce2a0-5c29-4d03-8c35-10eaedae7638 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:11.068568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:11.239110 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=14 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:11.813557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ed4ce2a0-5c29-4d03-8c35-10eaedae7638 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:11.835476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ed4ce2a0-5c29-4d03-8c35-10eaedae7638 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:11.844448 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ed4ce2a0-5c29-4d03-8c35-10eaedae7638 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:11.846596 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ed4ce2a0-5c29-4d03-8c35-10eaedae7638 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.889746 Oct 10 18:56:11.852674 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 918/1684] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:10 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:11.870656 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3db286b1-e915-4ccd-a7c9-790f52d85976 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:11.876423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3db286b1-e915-4ccd-a7c9-790f52d85976 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:11.903288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3db286b1-e915-4ccd-a7c9-790f52d85976 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:11.904043 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3db286b1-e915-4ccd-a7c9-790f52d85976 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:11.904618 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3db286b1-e915-4ccd-a7c9-790f52d85976 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:11.907014 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3db286b1-e915-4ccd-a7c9-790f52d85976 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:11.909166 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3db286b1-e915-4ccd-a7c9-790f52d85976 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:11.910444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3db286b1-e915-4ccd-a7c9-790f52d85976 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:12.052386 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e4d9839a-2ab5-49e7-a9f1-bc8dc47e45e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:12.062895 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e4d9839a-2ab5-49e7-a9f1-bc8dc47e45e0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 2.329104 Oct 10 18:56:12.066919 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 767/1685] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:09 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 2334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:12.090519 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a29bef83-f97b-4c9b-bb14-96c3b7f8b77f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:12.092010 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a29bef83-f97b-4c9b-bb14-96c3b7f8b77f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:12.126219 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a29bef83-f97b-4c9b-bb14-96c3b7f8b77f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:12.137103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a29bef83-f97b-4c9b-bb14-96c3b7f8b77f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:12.139286 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a29bef83-f97b-4c9b-bb14-96c3b7f8b77f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:12.140722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a29bef83-f97b-4c9b-bb14-96c3b7f8b77f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:12.142956 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a29bef83-f97b-4c9b-bb14-96c3b7f8b77f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:12.144686 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a29bef83-f97b-4c9b-bb14-96c3b7f8b77f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:12.385715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=10 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:12.628890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3db286b1-e915-4ccd-a7c9-790f52d85976 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:12.659884 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3db286b1-e915-4ccd-a7c9-790f52d85976 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:12.678761 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3db286b1-e915-4ccd-a7c9-790f52d85976 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:12.698412 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a29bef83-f97b-4c9b-bb14-96c3b7f8b77f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:12.698854 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3db286b1-e915-4ccd-a7c9-790f52d85976 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1359 microversion: 2.21 time: 0.827388 Oct 10 18:56:12.699016 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a29bef83-f97b-4c9b-bb14-96c3b7f8b77f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:12.699016 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a29bef83-f97b-4c9b-bb14-96c3b7f8b77f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:12.715282 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a29bef83-f97b-4c9b-bb14-96c3b7f8b77f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.629464 Oct 10 18:56:12.715578 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 919/1686] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:11 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1359 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:12.733771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0ab8ed6a-c7d7-4ec1-ada6-a424a7c1d8a3 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:12.735367 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 768/1687] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:12 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:12.735675 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0ab8ed6a-c7d7-4ec1-ada6-a424a7c1d8a3 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:12.753899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ab8ed6a-c7d7-4ec1-ada6-a424a7c1d8a3 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:12.758561 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ab8ed6a-c7d7-4ec1-ada6-a424a7c1d8a3 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:12.760018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ab8ed6a-c7d7-4ec1-ada6-a424a7c1d8a3 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:12.761126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ab8ed6a-c7d7-4ec1-ada6-a424a7c1d8a3 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:12.762407 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ab8ed6a-c7d7-4ec1-ada6-a424a7c1d8a3 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:12.766111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ab8ed6a-c7d7-4ec1-ada6-a424a7c1d8a3 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:12.882030 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a7b69879-40f4-4dcb-98c4-e64299b52924 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:12.886623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a7b69879-40f4-4dcb-98c4-e64299b52924 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:12.891133 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7b69879-40f4-4dcb-98c4-e64299b52924 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:12.892123 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7b69879-40f4-4dcb-98c4-e64299b52924 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:12.892828 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7b69879-40f4-4dcb-98c4-e64299b52924 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:12.893727 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7b69879-40f4-4dcb-98c4-e64299b52924 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:12.894354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7b69879-40f4-4dcb-98c4-e64299b52924 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:12.894949 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7b69879-40f4-4dcb-98c4-e64299b52924 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:13.127314 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0ab8ed6a-c7d7-4ec1-ada6-a424a7c1d8a3 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:13.146929 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0ab8ed6a-c7d7-4ec1-ada6-a424a7c1d8a3 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1371 microversion: 2.1 time: 0.424056 Oct 10 18:56:13.150416 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 920/1688] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:12 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1371 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:13.167889 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-6d9d9425-8c2c-48c0-bf08-4bc1adbc4a6d req-eae6984e-35ae-443d-9867-f5426f9b4c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae3aec4-c476-4f1a-a702-2cd1548b0895", "tag": "aee6febe-6708-48e6-afe9-c2adf2fe85c3"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:13.191124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6d9d9425-8c2c-48c0-bf08-4bc1adbc4a6d req-eae6984e-35ae-443d-9867-f5426f9b4c5b service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:13.197465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6d9d9425-8c2c-48c0-bf08-4bc1adbc4a6d req-eae6984e-35ae-443d-9867-f5426f9b4c5b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:13.199039 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6d9d9425-8c2c-48c0-bf08-4bc1adbc4a6d req-eae6984e-35ae-443d-9867-f5426f9b4c5b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:13.244089 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-6d9d9425-8c2c-48c0-bf08-4bc1adbc4a6d req-eae6984e-35ae-443d-9867-f5426f9b4c5b service nova] Creating event network-changed:aee6febe-6708-48e6-afe9-c2adf2fe85c3 for instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 on n-h1-860863-1 Oct 10 18:56:13.264203 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-6d9d9425-8c2c-48c0-bf08-4bc1adbc4a6d req-eae6984e-35ae-443d-9867-f5426f9b4c5b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108399 Oct 10 18:56:13.268142 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 921/1689] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:13.275341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f00f4278-db03-4b64-835d-9613846663bc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:13.285871 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f00f4278-db03-4b64-835d-9613846663bc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:13.298806 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f00f4278-db03-4b64-835d-9613846663bc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:13.313734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f00f4278-db03-4b64-835d-9613846663bc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:13.314531 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f00f4278-db03-4b64-835d-9613846663bc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:13.315940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f00f4278-db03-4b64-835d-9613846663bc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:13.322033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f00f4278-db03-4b64-835d-9613846663bc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:13.328006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f00f4278-db03-4b64-835d-9613846663bc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:13.657303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f00f4278-db03-4b64-835d-9613846663bc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:13.667885 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f00f4278-db03-4b64-835d-9613846663bc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.397873 Oct 10 18:56:13.688853 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 922/1690] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:13 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:13.720499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-486a697a-1940-424f-9df1-9f65920d6620 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:13.722837 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-486a697a-1940-424f-9df1-9f65920d6620 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:13.743260 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-486a697a-1940-424f-9df1-9f65920d6620 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:13.747062 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-486a697a-1940-424f-9df1-9f65920d6620 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:13.747911 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-486a697a-1940-424f-9df1-9f65920d6620 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:13.748972 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-486a697a-1940-424f-9df1-9f65920d6620 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:13.749779 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-486a697a-1940-424f-9df1-9f65920d6620 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:13.750422 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-486a697a-1940-424f-9df1-9f65920d6620 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:13.920030 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a7b69879-40f4-4dcb-98c4-e64299b52924 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:13.931839 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a7b69879-40f4-4dcb-98c4-e64299b52924 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:13.942564 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a7b69879-40f4-4dcb-98c4-e64299b52924 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:13.952351 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a7b69879-40f4-4dcb-98c4-e64299b52924 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 1.073949 Oct 10 18:56:13.953224 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 769/1691] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:12 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:56:13.968469 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c79ac571-b828-4236-90af-b35b673d4d00 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:13.977522 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c79ac571-b828-4236-90af-b35b673d4d00 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:14.003279 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c79ac571-b828-4236-90af-b35b673d4d00 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:14.008407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c79ac571-b828-4236-90af-b35b673d4d00 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:14.009230 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c79ac571-b828-4236-90af-b35b673d4d00 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:14.013126 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c79ac571-b828-4236-90af-b35b673d4d00 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:14.018573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c79ac571-b828-4236-90af-b35b673d4d00 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:14.019295 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c79ac571-b828-4236-90af-b35b673d4d00 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:14.571799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-486a697a-1940-424f-9df1-9f65920d6620 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:14.571799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-486a697a-1940-424f-9df1-9f65920d6620 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:14.571799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-486a697a-1940-424f-9df1-9f65920d6620 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:14.571799 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-486a697a-1940-424f-9df1-9f65920d6620 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1359 microversion: 2.21 time: 0.614106 Oct 10 18:56:14.571799 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 923/1692] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:13 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1359 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:56:14.571799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-84457085-0794-4d44-b7c3-4356411c2bd4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:14.571799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-84457085-0794-4d44-b7c3-4356411c2bd4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:14.571799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84457085-0794-4d44-b7c3-4356411c2bd4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:14.571799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84457085-0794-4d44-b7c3-4356411c2bd4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:14.571799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84457085-0794-4d44-b7c3-4356411c2bd4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:14.571799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84457085-0794-4d44-b7c3-4356411c2bd4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:14.625149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84457085-0794-4d44-b7c3-4356411c2bd4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:14.625149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84457085-0794-4d44-b7c3-4356411c2bd4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:14.626276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c79ac571-b828-4236-90af-b35b673d4d00 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:14.626276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c79ac571-b828-4236-90af-b35b673d4d00 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:14.626276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c79ac571-b828-4236-90af-b35b673d4d00 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:14.626276 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c79ac571-b828-4236-90af-b35b673d4d00 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.545896 Oct 10 18:56:14.626276 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 770/1693] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:13 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:14.626276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e7a11866-5d0c-486d-bc65-ae0132db0272 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:14.626276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e7a11866-5d0c-486d-bc65-ae0132db0272 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:14.626276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e7a11866-5d0c-486d-bc65-ae0132db0272 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:14.626276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e7a11866-5d0c-486d-bc65-ae0132db0272 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:14.626276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e7a11866-5d0c-486d-bc65-ae0132db0272 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:14.626276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e7a11866-5d0c-486d-bc65-ae0132db0272 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:14.629459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e7a11866-5d0c-486d-bc65-ae0132db0272 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:14.629459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e7a11866-5d0c-486d-bc65-ae0132db0272 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:14.709806 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e7a11866-5d0c-486d-bc65-ae0132db0272 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:56:15.107409 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-84457085-0794-4d44-b7c3-4356411c2bd4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:15.121313 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-84457085-0794-4d44-b7c3-4356411c2bd4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1371 microversion: 2.1 time: 0.791708 Oct 10 18:56:15.122124 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 924/1694] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:14 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1371 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:15.145364 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-76b8c761-8c34-4f70-96f4-b4bec89b0322 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:15.145914 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-76b8c761-8c34-4f70-96f4-b4bec89b0322 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:15.153505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-76b8c761-8c34-4f70-96f4-b4bec89b0322 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:15.154136 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-76b8c761-8c34-4f70-96f4-b4bec89b0322 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:15.154585 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-76b8c761-8c34-4f70-96f4-b4bec89b0322 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:15.155421 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-76b8c761-8c34-4f70-96f4-b4bec89b0322 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:15.155940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-76b8c761-8c34-4f70-96f4-b4bec89b0322 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:15.156425 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-76b8c761-8c34-4f70-96f4-b4bec89b0322 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:15.544395 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-76b8c761-8c34-4f70-96f4-b4bec89b0322 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:15.560158 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-76b8c761-8c34-4f70-96f4-b4bec89b0322 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1509 microversion: 2.1 time: 0.425173 Oct 10 18:56:15.561999 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e7a11866-5d0c-486d-bc65-ae0132db0272 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 204 len: 0 microversion: 2.1 time: 1.011147 Oct 10 18:56:15.573080 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 771/1695] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:56:14 2022] DELETE /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 0 bytes in 1023 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:56:15.580263 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a67c7915-ddc6-48e2-94ff-8d6884e1dcf6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:15.588479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a67c7915-ddc6-48e2-94ff-8d6884e1dcf6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:15.589013 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 925/1696] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:15 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1509 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:15.594633 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6e7ce420-ef60-4a89-a78f-ea0bb284d950 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:15.595230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6e7ce420-ef60-4a89-a78f-ea0bb284d950 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:15.596393 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a67c7915-ddc6-48e2-94ff-8d6884e1dcf6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:15.598370 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a67c7915-ddc6-48e2-94ff-8d6884e1dcf6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:15.603833 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a67c7915-ddc6-48e2-94ff-8d6884e1dcf6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:15.604921 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a67c7915-ddc6-48e2-94ff-8d6884e1dcf6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:15.605600 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a67c7915-ddc6-48e2-94ff-8d6884e1dcf6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:15.606256 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a67c7915-ddc6-48e2-94ff-8d6884e1dcf6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:15.614706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e7ce420-ef60-4a89-a78f-ea0bb284d950 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:15.615232 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e7ce420-ef60-4a89-a78f-ea0bb284d950 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:15.615672 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e7ce420-ef60-4a89-a78f-ea0bb284d950 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:15.621852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e7ce420-ef60-4a89-a78f-ea0bb284d950 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:15.622411 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e7ce420-ef60-4a89-a78f-ea0bb284d950 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:15.622992 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e7ce420-ef60-4a89-a78f-ea0bb284d950 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:15.650130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:16.111792 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6e7ce420-ef60-4a89-a78f-ea0bb284d950 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:16.125139 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6e7ce420-ef60-4a89-a78f-ea0bb284d950 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1512 microversion: 2.1 time: 0.542146 Oct 10 18:56:16.126384 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 926/1697] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:15 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1512 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:16.137213 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5dbfb4f6-b560-4650-8efc-d05541404b38 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:16.151996 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5dbfb4f6-b560-4650-8efc-d05541404b38 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:16.190122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dbfb4f6-b560-4650-8efc-d05541404b38 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:16.190656 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dbfb4f6-b560-4650-8efc-d05541404b38 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:16.195246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dbfb4f6-b560-4650-8efc-d05541404b38 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:16.196028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dbfb4f6-b560-4650-8efc-d05541404b38 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:16.198925 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dbfb4f6-b560-4650-8efc-d05541404b38 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:16.199187 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dbfb4f6-b560-4650-8efc-d05541404b38 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:16.402920 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a67c7915-ddc6-48e2-94ff-8d6884e1dcf6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:16.431057 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a67c7915-ddc6-48e2-94ff-8d6884e1dcf6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:16.435217 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a67c7915-ddc6-48e2-94ff-8d6884e1dcf6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:16.436474 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a67c7915-ddc6-48e2-94ff-8d6884e1dcf6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.861871 Oct 10 18:56:16.438879 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 772/1698] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:15 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:16.461242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-49655e9e-8868-4352-be54-fefc00140b0f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:16.484434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-49655e9e-8868-4352-be54-fefc00140b0f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:16.514640 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5dbfb4f6-b560-4650-8efc-d05541404b38 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:16.520928 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-49655e9e-8868-4352-be54-fefc00140b0f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:16.524107 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-49655e9e-8868-4352-be54-fefc00140b0f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:16.525645 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-49655e9e-8868-4352-be54-fefc00140b0f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:16.529140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-49655e9e-8868-4352-be54-fefc00140b0f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:16.530661 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-49655e9e-8868-4352-be54-fefc00140b0f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:16.532753 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-49655e9e-8868-4352-be54-fefc00140b0f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:16.544423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5dbfb4f6-b560-4650-8efc-d05541404b38 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:16.556959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5dbfb4f6-b560-4650-8efc-d05541404b38 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:16.566736 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5dbfb4f6-b560-4650-8efc-d05541404b38 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1359 microversion: 2.21 time: 0.430859 Oct 10 18:56:16.569699 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 927/1699] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:16 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1359 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:16.595843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-439fc1ec-a771-407a-a904-91a1cc68a1b5 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:16.599665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-439fc1ec-a771-407a-a904-91a1cc68a1b5 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:16.629972 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-439fc1ec-a771-407a-a904-91a1cc68a1b5 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:16.630996 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-439fc1ec-a771-407a-a904-91a1cc68a1b5 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:16.632262 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-439fc1ec-a771-407a-a904-91a1cc68a1b5 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:16.635948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-439fc1ec-a771-407a-a904-91a1cc68a1b5 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:16.637949 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-439fc1ec-a771-407a-a904-91a1cc68a1b5 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:16.638969 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-439fc1ec-a771-407a-a904-91a1cc68a1b5 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:16.941636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-49655e9e-8868-4352-be54-fefc00140b0f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:16.970742 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-49655e9e-8868-4352-be54-fefc00140b0f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:16.975418 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-49655e9e-8868-4352-be54-fefc00140b0f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:16.988048 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-49655e9e-8868-4352-be54-fefc00140b0f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.546245 Oct 10 18:56:17.006846 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 773/1700] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:16 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:17.033901 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-fbc03e59-cf92-4f17-9620-3bd5bad1644a req-d2c164f2-84a8-4345-b7d7-9cad9450b00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a19e7ee-040c-4614-87d7-622da642b798", "name": "network-vif-plugged", "status": "completed", "tag": "bdf44f97-51c7-41a6-858c-40107852753a"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:17.059969 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-fbc03e59-cf92-4f17-9620-3bd5bad1644a req-d2c164f2-84a8-4345-b7d7-9cad9450b00e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:17.062920 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-fbc03e59-cf92-4f17-9620-3bd5bad1644a req-d2c164f2-84a8-4345-b7d7-9cad9450b00e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:17.063588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-fbc03e59-cf92-4f17-9620-3bd5bad1644a req-d2c164f2-84a8-4345-b7d7-9cad9450b00e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:17.090707 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-fbc03e59-cf92-4f17-9620-3bd5bad1644a req-d2c164f2-84a8-4345-b7d7-9cad9450b00e service nova] Creating event network-vif-plugged:bdf44f97-51c7-41a6-858c-40107852753a for instance 4a19e7ee-040c-4614-87d7-622da642b798 on n-h2-860863-1 Oct 10 18:56:17.111650 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-fbc03e59-cf92-4f17-9620-3bd5bad1644a req-d2c164f2-84a8-4345-b7d7-9cad9450b00e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082631 Oct 10 18:56:17.113561 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 774/1701] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:17.126107 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0f8d48f7-9c6c-495e-89f7-943a698f0112 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:17.128730 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0f8d48f7-9c6c-495e-89f7-943a698f0112 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:17.166524 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f8d48f7-9c6c-495e-89f7-943a698f0112 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:17.167365 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f8d48f7-9c6c-495e-89f7-943a698f0112 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:17.167992 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f8d48f7-9c6c-495e-89f7-943a698f0112 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:17.169054 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f8d48f7-9c6c-495e-89f7-943a698f0112 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:17.169734 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f8d48f7-9c6c-495e-89f7-943a698f0112 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:17.171240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f8d48f7-9c6c-495e-89f7-943a698f0112 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:17.613522 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0f8d48f7-9c6c-495e-89f7-943a698f0112 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:17.627609 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0f8d48f7-9c6c-495e-89f7-943a698f0112 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1530 microversion: 2.1 time: 0.508039 Oct 10 18:56:17.629175 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 775/1702] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:17 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1530 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:17.642333 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d936d7f5-9f2d-4c48-912c-af3e2567b289 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:17.646601 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d936d7f5-9f2d-4c48-912c-af3e2567b289 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:17.660859 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d936d7f5-9f2d-4c48-912c-af3e2567b289 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:17.664752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d936d7f5-9f2d-4c48-912c-af3e2567b289 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:17.665464 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d936d7f5-9f2d-4c48-912c-af3e2567b289 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:17.666390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d936d7f5-9f2d-4c48-912c-af3e2567b289 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:17.667021 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d936d7f5-9f2d-4c48-912c-af3e2567b289 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:17.667780 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d936d7f5-9f2d-4c48-912c-af3e2567b289 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:17.685577 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-439fc1ec-a771-407a-a904-91a1cc68a1b5 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:17.701275 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-439fc1ec-a771-407a-a904-91a1cc68a1b5 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1371 microversion: 2.1 time: 1.129636 Oct 10 18:56:17.703370 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 928/1703] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:16 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1371 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:17.721787 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c8274029-aae2-4a5e-9ebf-cf1cba7f5c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:17.726288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c8274029-aae2-4a5e-9ebf-cf1cba7f5c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:17.759361 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8274029-aae2-4a5e-9ebf-cf1cba7f5c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:17.761131 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8274029-aae2-4a5e-9ebf-cf1cba7f5c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:17.761131 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8274029-aae2-4a5e-9ebf-cf1cba7f5c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:17.766531 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8274029-aae2-4a5e-9ebf-cf1cba7f5c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:17.769444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8274029-aae2-4a5e-9ebf-cf1cba7f5c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:17.769945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c8274029-aae2-4a5e-9ebf-cf1cba7f5c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:18.258054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c8274029-aae2-4a5e-9ebf-cf1cba7f5c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:18.278536 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c8274029-aae2-4a5e-9ebf-cf1cba7f5c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:18.291172 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c8274029-aae2-4a5e-9ebf-cf1cba7f5c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:18.293781 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c8274029-aae2-4a5e-9ebf-cf1cba7f5c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.588139 Oct 10 18:56:18.295731 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 929/1704] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:17 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:18.318287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a2a489c4-13af-428d-9abe-cc4cd3aab4ac tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:18.323300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a2a489c4-13af-428d-9abe-cc4cd3aab4ac tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:18.349848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a2a489c4-13af-428d-9abe-cc4cd3aab4ac tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:18.350253 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a2a489c4-13af-428d-9abe-cc4cd3aab4ac tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:18.355768 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a2a489c4-13af-428d-9abe-cc4cd3aab4ac tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:18.357237 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a2a489c4-13af-428d-9abe-cc4cd3aab4ac tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:18.359200 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a2a489c4-13af-428d-9abe-cc4cd3aab4ac tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:18.362288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a2a489c4-13af-428d-9abe-cc4cd3aab4ac tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:18.992911 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a2a489c4-13af-428d-9abe-cc4cd3aab4ac tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:19.008091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a2a489c4-13af-428d-9abe-cc4cd3aab4ac tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:19.014733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a2a489c4-13af-428d-9abe-cc4cd3aab4ac tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:19.016666 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a2a489c4-13af-428d-9abe-cc4cd3aab4ac tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1359 microversion: 2.21 time: 0.716537 Oct 10 18:56:19.020692 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 930/1705] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:18 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1359 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:19.032441 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a3683338-832d-4b99-a54a-0e534f8faac9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:19.034604 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a3683338-832d-4b99-a54a-0e534f8faac9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:19.051140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3683338-832d-4b99-a54a-0e534f8faac9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:19.053206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3683338-832d-4b99-a54a-0e534f8faac9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:19.055395 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3683338-832d-4b99-a54a-0e534f8faac9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:19.057800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3683338-832d-4b99-a54a-0e534f8faac9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:19.058792 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3683338-832d-4b99-a54a-0e534f8faac9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:19.061029 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3683338-832d-4b99-a54a-0e534f8faac9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:19.190834 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a3683338-832d-4b99-a54a-0e534f8faac9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:19.211246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a3683338-832d-4b99-a54a-0e534f8faac9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:19.214173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a3683338-832d-4b99-a54a-0e534f8faac9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:19.237373 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a3683338-832d-4b99-a54a-0e534f8faac9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.214400 Oct 10 18:56:19.259219 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 931/1706] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:19 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:19.269037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4e7085f2-132b-4d81-8bc0-1116f14b6e7b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:19.273931 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4e7085f2-132b-4d81-8bc0-1116f14b6e7b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:19.297328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e7085f2-132b-4d81-8bc0-1116f14b6e7b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:19.302101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e7085f2-132b-4d81-8bc0-1116f14b6e7b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:19.302101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e7085f2-132b-4d81-8bc0-1116f14b6e7b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:19.302101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e7085f2-132b-4d81-8bc0-1116f14b6e7b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:19.302101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e7085f2-132b-4d81-8bc0-1116f14b6e7b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:19.302101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e7085f2-132b-4d81-8bc0-1116f14b6e7b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:19.373683 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d936d7f5-9f2d-4c48-912c-af3e2567b289 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:19.390197 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d936d7f5-9f2d-4c48-912c-af3e2567b289 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1512 microversion: 2.1 time: 1.757948 Oct 10 18:56:19.391297 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 776/1707] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:17 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1512 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:19.405649 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bb92ba96-a959-4df9-942f-9a91e44c86a9 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:19.408751 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bb92ba96-a959-4df9-942f-9a91e44c86a9 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:19.454102 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb92ba96-a959-4df9-942f-9a91e44c86a9 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:19.460682 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb92ba96-a959-4df9-942f-9a91e44c86a9 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:19.461554 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb92ba96-a959-4df9-942f-9a91e44c86a9 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:19.465717 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb92ba96-a959-4df9-942f-9a91e44c86a9 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:19.467189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb92ba96-a959-4df9-942f-9a91e44c86a9 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:19.477103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb92ba96-a959-4df9-942f-9a91e44c86a9 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:20.040503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4e7085f2-132b-4d81-8bc0-1116f14b6e7b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:20.051637 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4e7085f2-132b-4d81-8bc0-1116f14b6e7b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.798742 Oct 10 18:56:20.074274 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 932/1708] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:19 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:20.080660 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b019dd9d-5c73-4715-9f6e-ef04884e229e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:20.082887 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b019dd9d-5c73-4715-9f6e-ef04884e229e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:20.089668 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b019dd9d-5c73-4715-9f6e-ef04884e229e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:20.092778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b019dd9d-5c73-4715-9f6e-ef04884e229e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:20.092778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b019dd9d-5c73-4715-9f6e-ef04884e229e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:20.092778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b019dd9d-5c73-4715-9f6e-ef04884e229e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:20.092778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b019dd9d-5c73-4715-9f6e-ef04884e229e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:20.092778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b019dd9d-5c73-4715-9f6e-ef04884e229e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:20.581575 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b019dd9d-5c73-4715-9f6e-ef04884e229e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:20.635874 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b019dd9d-5c73-4715-9f6e-ef04884e229e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:20.662179 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b019dd9d-5c73-4715-9f6e-ef04884e229e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:20.662504 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b019dd9d-5c73-4715-9f6e-ef04884e229e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.586614 Oct 10 18:56:20.678806 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 933/1709] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:20 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:20.705811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5aa8d995-c6c6-40fa-b1a7-d420af9ed95b tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:20.707274 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5aa8d995-c6c6-40fa-b1a7-d420af9ed95b tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:20.730588 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5aa8d995-c6c6-40fa-b1a7-d420af9ed95b tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:20.738603 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5aa8d995-c6c6-40fa-b1a7-d420af9ed95b tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:20.739378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5aa8d995-c6c6-40fa-b1a7-d420af9ed95b tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:20.740317 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5aa8d995-c6c6-40fa-b1a7-d420af9ed95b tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:20.744984 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5aa8d995-c6c6-40fa-b1a7-d420af9ed95b tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:20.749092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5aa8d995-c6c6-40fa-b1a7-d420af9ed95b tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:20.913286 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bb92ba96-a959-4df9-942f-9a91e44c86a9 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:20.923148 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bb92ba96-a959-4df9-942f-9a91e44c86a9 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1371 microversion: 2.1 time: 1.528383 Oct 10 18:56:20.929197 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 777/1710] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:19 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1371 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:20.956724 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ed8c4654-726f-4c31-93a9-fd9da2d4752f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:20.962606 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ed8c4654-726f-4c31-93a9-fd9da2d4752f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:20.987889 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ed8c4654-726f-4c31-93a9-fd9da2d4752f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:20.997407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ed8c4654-726f-4c31-93a9-fd9da2d4752f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:21.000401 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ed8c4654-726f-4c31-93a9-fd9da2d4752f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:21.004169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ed8c4654-726f-4c31-93a9-fd9da2d4752f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:21.005382 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ed8c4654-726f-4c31-93a9-fd9da2d4752f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:21.013080 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ed8c4654-726f-4c31-93a9-fd9da2d4752f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:21.240761 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ed8c4654-726f-4c31-93a9-fd9da2d4752f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:21.254347 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ed8c4654-726f-4c31-93a9-fd9da2d4752f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:21.261908 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ed8c4654-726f-4c31-93a9-fd9da2d4752f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:21.275635 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ed8c4654-726f-4c31-93a9-fd9da2d4752f tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.342280 Oct 10 18:56:21.293850 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 778/1711] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:20 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:21.300184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-80c9b7bd-cfcb-4578-bfc9-4c71a63ce5ac tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:21.305081 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-80c9b7bd-cfcb-4578-bfc9-4c71a63ce5ac tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:21.340671 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80c9b7bd-cfcb-4578-bfc9-4c71a63ce5ac tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:21.346520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80c9b7bd-cfcb-4578-bfc9-4c71a63ce5ac tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:21.350074 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80c9b7bd-cfcb-4578-bfc9-4c71a63ce5ac tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:21.353479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80c9b7bd-cfcb-4578-bfc9-4c71a63ce5ac tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:21.358215 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80c9b7bd-cfcb-4578-bfc9-4c71a63ce5ac tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:21.358685 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-80c9b7bd-cfcb-4578-bfc9-4c71a63ce5ac tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:21.659048 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-80c9b7bd-cfcb-4578-bfc9-4c71a63ce5ac tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:21.707523 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-80c9b7bd-cfcb-4578-bfc9-4c71a63ce5ac tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 200 len: 1470 microversion: 2.1 time: 0.402075 Oct 10 18:56:21.707523 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 779/1712] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:21 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 1470 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:21.735013 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9e408260-5fdc-44fd-991d-4da16bfc7a95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:21.741325 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9e408260-5fdc-44fd-991d-4da16bfc7a95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:21.777682 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e408260-5fdc-44fd-991d-4da16bfc7a95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:21.779859 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e408260-5fdc-44fd-991d-4da16bfc7a95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:21.791665 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e408260-5fdc-44fd-991d-4da16bfc7a95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:21.795833 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e408260-5fdc-44fd-991d-4da16bfc7a95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:21.796336 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e408260-5fdc-44fd-991d-4da16bfc7a95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:21.802875 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e408260-5fdc-44fd-991d-4da16bfc7a95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:22.145899 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9e408260-5fdc-44fd-991d-4da16bfc7a95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:22.159676 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9e408260-5fdc-44fd-991d-4da16bfc7a95 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.446645 Oct 10 18:56:22.160790 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 780/1713] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:21 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:22.410324 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5aa8d995-c6c6-40fa-b1a7-d420af9ed95b tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:22.419777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5aa8d995-c6c6-40fa-b1a7-d420af9ed95b tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:22.433667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5aa8d995-c6c6-40fa-b1a7-d420af9ed95b tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:22.436186 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5aa8d995-c6c6-40fa-b1a7-d420af9ed95b tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1552 microversion: 2.21 time: 1.756040 Oct 10 18:56:22.436744 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 934/1714] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:20 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1552 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:22.464934 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a3cc1ae2-3e13-4ca7-90bd-35eac68723bb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:22.468196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a3cc1ae2-3e13-4ca7-90bd-35eac68723bb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:22.494747 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3cc1ae2-3e13-4ca7-90bd-35eac68723bb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:22.504992 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3cc1ae2-3e13-4ca7-90bd-35eac68723bb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:22.507872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3cc1ae2-3e13-4ca7-90bd-35eac68723bb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:22.511775 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3cc1ae2-3e13-4ca7-90bd-35eac68723bb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:22.532699 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3cc1ae2-3e13-4ca7-90bd-35eac68723bb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:22.532699 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a3cc1ae2-3e13-4ca7-90bd-35eac68723bb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:22.626164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-745682984", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "07eb47a7-00e7-401a-93f7-8d76a105624c"}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:23.068373 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a3cc1ae2-3e13-4ca7-90bd-35eac68723bb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:23.072292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:23.082838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a3cc1ae2-3e13-4ca7-90bd-35eac68723bb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:23.091000 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a3cc1ae2-3e13-4ca7-90bd-35eac68723bb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:23.100827 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a3cc1ae2-3e13-4ca7-90bd-35eac68723bb tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.660316 Oct 10 18:56:23.105515 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 935/1715] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:22 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:23.121122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-22b7f4a7-3509-4733-af32-e58eb3204d5a req-49eb8c93-098a-4d4c-8e60-07bebaa0e71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9100c55-d968-439f-be48-7ae2dc34f088", "name": "network-vif-deleted", "tag": "bd1086b3-68d0-4b83-b228-5e51be022d0c"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:23.153283 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-22b7f4a7-3509-4733-af32-e58eb3204d5a req-49eb8c93-098a-4d4c-8e60-07bebaa0e71a service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:23.154028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-22b7f4a7-3509-4733-af32-e58eb3204d5a req-49eb8c93-098a-4d4c-8e60-07bebaa0e71a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:23.156681 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-22b7f4a7-3509-4733-af32-e58eb3204d5a req-49eb8c93-098a-4d4c-8e60-07bebaa0e71a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:23.203898 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-22b7f4a7-3509-4733-af32-e58eb3204d5a req-49eb8c93-098a-4d4c-8e60-07bebaa0e71a service nova] Creating event network-vif-deleted:bd1086b3-68d0-4b83-b228-5e51be022d0c for instance b9100c55-d968-439f-be48-7ae2dc34f088 on n-h1-860863-1 Oct 10 18:56:23.226756 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-22b7f4a7-3509-4733-af32-e58eb3204d5a req-49eb8c93-098a-4d4c-8e60-07bebaa0e71a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119703 Oct 10 18:56:23.235418 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 936/1716] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:23.251302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-35f6265a-6013-49a0-9789-912ba5aafebb tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:23.253533 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-35f6265a-6013-49a0-9789-912ba5aafebb tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:23.266373 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35f6265a-6013-49a0-9789-912ba5aafebb tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:23.269580 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35f6265a-6013-49a0-9789-912ba5aafebb tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:23.271654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35f6265a-6013-49a0-9789-912ba5aafebb tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:23.273353 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35f6265a-6013-49a0-9789-912ba5aafebb tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:23.274022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35f6265a-6013-49a0-9789-912ba5aafebb tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:23.277513 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-35f6265a-6013-49a0-9789-912ba5aafebb tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:24.056753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-35f6265a-6013-49a0-9789-912ba5aafebb tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:24.078278 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-35f6265a-6013-49a0-9789-912ba5aafebb tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1371 microversion: 2.1 time: 0.832380 Oct 10 18:56:24.093250 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 937/1717] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:23 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1371 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:24.117315 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-41a237bd-7f88-4685-8386-d55692c425bd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:24.120263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-41a237bd-7f88-4685-8386-d55692c425bd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:24.132983 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41a237bd-7f88-4685-8386-d55692c425bd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:24.224480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41a237bd-7f88-4685-8386-d55692c425bd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:24.224480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41a237bd-7f88-4685-8386-d55692c425bd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:24.224480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41a237bd-7f88-4685-8386-d55692c425bd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:24.224480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41a237bd-7f88-4685-8386-d55692c425bd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:24.224480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41a237bd-7f88-4685-8386-d55692c425bd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:24.394871 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-41a237bd-7f88-4685-8386-d55692c425bd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:24.406233 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-41a237bd-7f88-4685-8386-d55692c425bd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:24.407700 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-41a237bd-7f88-4685-8386-d55692c425bd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:24.413984 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-41a237bd-7f88-4685-8386-d55692c425bd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.317418 Oct 10 18:56:24.435662 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 938/1718] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:24 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:24.444666 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-581eecf9-d4c9-4a3b-8741-bde4a5596046 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:24.446050 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-581eecf9-d4c9-4a3b-8741-bde4a5596046 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:24.454661 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-581eecf9-d4c9-4a3b-8741-bde4a5596046 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:24.455403 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-581eecf9-d4c9-4a3b-8741-bde4a5596046 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:24.456052 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-581eecf9-d4c9-4a3b-8741-bde4a5596046 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:24.459809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-581eecf9-d4c9-4a3b-8741-bde4a5596046 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:24.460494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-581eecf9-d4c9-4a3b-8741-bde4a5596046 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:24.461117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-581eecf9-d4c9-4a3b-8741-bde4a5596046 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:24.496808 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-581eecf9-d4c9-4a3b-8741-bde4a5596046 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:56:24.973257 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-581eecf9-d4c9-4a3b-8741-bde4a5596046 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 204 len: 0 microversion: 2.21 time: 0.535541 Oct 10 18:56:24.973940 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 939/1719] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:56:24 2022] DELETE /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 18:56:24.980487 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f3b22280-6ac3-4f8b-bf59-f46b07c14e36 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:24.986038 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f3b22280-6ac3-4f8b-bf59-f46b07c14e36 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: b9100c55-d968-439f-be48-7ae2dc34f088] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:24.998231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3b22280-6ac3-4f8b-bf59-f46b07c14e36 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:25.001177 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3b22280-6ac3-4f8b-bf59-f46b07c14e36 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:25.002699 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3b22280-6ac3-4f8b-bf59-f46b07c14e36 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:25.005752 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3b22280-6ac3-4f8b-bf59-f46b07c14e36 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:25.007175 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3b22280-6ac3-4f8b-bf59-f46b07c14e36 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:25.009605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3b22280-6ac3-4f8b-bf59-f46b07c14e36 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:25.077407 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-f3b22280-6ac3-4f8b-bf59-f46b07c14e36 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] HTTP exception thrown: Instance b9100c55-d968-439f-be48-7ae2dc34f088 could not be found. Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f3b22280-6ac3-4f8b-bf59-f46b07c14e36 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Request method failure captured: Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 HTTP/1.1 Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGoev_sfC_W9MvHoUaS5ehYIlhDLyzTx3M44Cw0bITI1FxOEeqB8T6k-upBMscHUmhXL8T3wQDKyxv9XdLDRGQ91DwD-CMg3wN0Fo0LioXRy5WOSEUX4b2HRYG2ttO0Qz9nw1THgqmXV5kF7MNf8P90hObtgiaPXUnP8k1K_gvw4lr4 Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 92d05639af8046dd87fe6973ff26f161 Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-VolumesAdminNegativeTest-1330506656 Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92d05639af8046dd87fe6973ff26f161", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92d05639af8046dd87fe6973ff26f161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92d05639af8046dd87fe6973ff26f161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92d05639af8046dd87fe6973ff26f161"}]}] Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-VolumesAdminNegativeTest-1330506656 Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 92d05639af8046dd87fe6973ff26f161 Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1330506656 Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-VolumesAdminNegativeTest-1330506656-project Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: abed6abc941a421682af5e3f5df98040 Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-VolumesAdminNegativeTest-1330506656-project Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance b9100c55-d968-439f-be48-7ae2dc34f088 could not be found. Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'b9100c55-d968-439f-be48-7ae2dc34f088'} Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9100c55-d968-439f-be48-7ae2dc34f088 could not be found. Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9100c55-d968-439f-be48-7ae2dc34f088 could not be found. Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:56:25.134276 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:25.143094 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:25.143094 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:56:25.143094 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:56:25.143094 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:56:25.143094 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:56:25.143094 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9100c55-d968-439f-be48-7ae2dc34f088 could not be found. Oct 10 18:56:25.143094 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:25.150524 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f3b22280-6ac3-4f8b-bf59-f46b07c14e36 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Returning 404 to user: Instance b9100c55-d968-439f-be48-7ae2dc34f088 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:56:25.153758 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f3b22280-6ac3-4f8b-bf59-f46b07c14e36 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088" status: 404 len: 111 microversion: 2.1 time: 0.176170 Oct 10 18:56:25.158975 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 940/1720] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:24 2022] GET /compute/v2.1/servers/b9100c55-d968-439f-be48-7ae2dc34f088 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:56:25.181664 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e8866df5-4a0a-4369-b296-bab0f1aebcd6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:25.186222 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e8866df5-4a0a-4369-b296-bab0f1aebcd6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:25.214556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8866df5-4a0a-4369-b296-bab0f1aebcd6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:25.215063 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8866df5-4a0a-4369-b296-bab0f1aebcd6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:25.215486 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8866df5-4a0a-4369-b296-bab0f1aebcd6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:25.216207 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8866df5-4a0a-4369-b296-bab0f1aebcd6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:25.217154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8866df5-4a0a-4369-b296-bab0f1aebcd6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:25.217590 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8866df5-4a0a-4369-b296-bab0f1aebcd6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:25.684023 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e8866df5-4a0a-4369-b296-bab0f1aebcd6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:25.693789 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e8866df5-4a0a-4369-b296-bab0f1aebcd6 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.533396 Oct 10 18:56:25.696364 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 941/1721] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:25 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:25.703915 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f9fe5718-e950-49dd-8919-f8da70b44832 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:25.704470 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f9fe5718-e950-49dd-8919-f8da70b44832 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:25.719312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f9fe5718-e950-49dd-8919-f8da70b44832 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:25.721481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f9fe5718-e950-49dd-8919-f8da70b44832 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:25.722349 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f9fe5718-e950-49dd-8919-f8da70b44832 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:25.724826 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f9fe5718-e950-49dd-8919-f8da70b44832 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:25.726218 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f9fe5718-e950-49dd-8919-f8da70b44832 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:25.734621 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f9fe5718-e950-49dd-8919-f8da70b44832 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:26.186380 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f9fe5718-e950-49dd-8919-f8da70b44832 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:26.202786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f9fe5718-e950-49dd-8919-f8da70b44832 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:26.204888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f9fe5718-e950-49dd-8919-f8da70b44832 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:26.206512 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f9fe5718-e950-49dd-8919-f8da70b44832 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.508862 Oct 10 18:56:26.209919 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 942/1722] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:25 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:26.221972 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2ff62dbc-0d7c-4391-af07-f2cfed97d076 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:26.224395 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2ff62dbc-0d7c-4391-af07-f2cfed97d076 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:26.245076 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2ff62dbc-0d7c-4391-af07-f2cfed97d076 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:26.253972 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2ff62dbc-0d7c-4391-af07-f2cfed97d076 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:26.254805 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2ff62dbc-0d7c-4391-af07-f2cfed97d076 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:26.255737 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2ff62dbc-0d7c-4391-af07-f2cfed97d076 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:26.256803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2ff62dbc-0d7c-4391-af07-f2cfed97d076 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:26.257563 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2ff62dbc-0d7c-4391-af07-f2cfed97d076 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:27.050946 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] validate_networks() for [('07eb47a7-00e7-401a-93f7-8d76a105624c', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:56:27.452799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2ff62dbc-0d7c-4391-af07-f2cfed97d076 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:27.470777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2ff62dbc-0d7c-4391-af07-f2cfed97d076 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:27.478404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2ff62dbc-0d7c-4391-af07-f2cfed97d076 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:27.488243 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2ff62dbc-0d7c-4391-af07-f2cfed97d076 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1558 microversion: 2.21 time: 1.276980 Oct 10 18:56:27.491199 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 943/1723] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:26 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1558 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:27.512770 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-260835cd-d7c9-4759-a672-2acfd3f76f76 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:27.514383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-260835cd-d7c9-4759-a672-2acfd3f76f76 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:27.533701 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-260835cd-d7c9-4759-a672-2acfd3f76f76 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:27.539821 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-260835cd-d7c9-4759-a672-2acfd3f76f76 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:27.541046 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-260835cd-d7c9-4759-a672-2acfd3f76f76 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:27.541926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-260835cd-d7c9-4759-a672-2acfd3f76f76 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:27.542510 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-260835cd-d7c9-4759-a672-2acfd3f76f76 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:27.543268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-260835cd-d7c9-4759-a672-2acfd3f76f76 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:27.912344 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-260835cd-d7c9-4759-a672-2acfd3f76f76 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:27.935254 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-260835cd-d7c9-4759-a672-2acfd3f76f76 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1371 microversion: 2.1 time: 0.441141 Oct 10 18:56:27.943282 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 944/1724] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:27 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1371 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:27.958568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-29cb4cfd-927b-489e-8306-523843827d1e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:27.966308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-29cb4cfd-927b-489e-8306-523843827d1e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:27.999339 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29cb4cfd-927b-489e-8306-523843827d1e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:28.006741 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29cb4cfd-927b-489e-8306-523843827d1e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:28.007256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29cb4cfd-927b-489e-8306-523843827d1e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:28.012492 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29cb4cfd-927b-489e-8306-523843827d1e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:28.013750 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29cb4cfd-927b-489e-8306-523843827d1e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:28.016846 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-29cb4cfd-927b-489e-8306-523843827d1e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:28.264616 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-29cb4cfd-927b-489e-8306-523843827d1e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:28.276481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-29cb4cfd-927b-489e-8306-523843827d1e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:28.283100 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-29cb4cfd-927b-489e-8306-523843827d1e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:28.297435 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-29cb4cfd-927b-489e-8306-523843827d1e tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.351010 Oct 10 18:56:28.312672 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 945/1725] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:27 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:28.343323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-3c1f15a5-978c-439e-80d7-c6964b4b4fed req-55a66ab7-b122-4c8b-9861-a4a9f46fef06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab18d87-5b5b-4d03-a0c0-a07a998f411b", "name": "network-vif-plugged", "status": "completed", "tag": "64f367b9-222a-4fe3-919b-80f6bdc5452d"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:28.386549 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-3c1f15a5-978c-439e-80d7-c6964b4b4fed req-55a66ab7-b122-4c8b-9861-a4a9f46fef06 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:28.387106 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-3c1f15a5-978c-439e-80d7-c6964b4b4fed req-55a66ab7-b122-4c8b-9861-a4a9f46fef06 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:28.387804 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-3c1f15a5-978c-439e-80d7-c6964b4b4fed req-55a66ab7-b122-4c8b-9861-a4a9f46fef06 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:28.411140 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-3c1f15a5-978c-439e-80d7-c6964b4b4fed req-55a66ab7-b122-4c8b-9861-a4a9f46fef06 service nova] Creating event network-vif-plugged:64f367b9-222a-4fe3-919b-80f6bdc5452d for instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b on n-h2-860863-1 Oct 10 18:56:28.430927 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-3c1f15a5-978c-439e-80d7-c6964b4b4fed req-55a66ab7-b122-4c8b-9861-a4a9f46fef06 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114316 Oct 10 18:56:28.431929 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 946/1726] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:28.445707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3779c40e-2f0d-432e-b0d1-d00cfae90fba tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:28.449578 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3779c40e-2f0d-432e-b0d1-d00cfae90fba tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:28.458900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:28.477436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3779c40e-2f0d-432e-b0d1-d00cfae90fba tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:28.477436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3779c40e-2f0d-432e-b0d1-d00cfae90fba tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:28.477436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3779c40e-2f0d-432e-b0d1-d00cfae90fba tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:28.477436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3779c40e-2f0d-432e-b0d1-d00cfae90fba tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:28.477436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3779c40e-2f0d-432e-b0d1-d00cfae90fba tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:28.477436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3779c40e-2f0d-432e-b0d1-d00cfae90fba tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:29.322970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3779c40e-2f0d-432e-b0d1-d00cfae90fba tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:29.335858 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3779c40e-2f0d-432e-b0d1-d00cfae90fba tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.902622 Oct 10 18:56:29.350260 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 947/1727] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:28 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:29.364000 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c5576c53-c5e5-4b01-9596-f6340bc5c240 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:29.364654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c5576c53-c5e5-4b01-9596-f6340bc5c240 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:29.377991 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c5576c53-c5e5-4b01-9596-f6340bc5c240 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:29.378484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c5576c53-c5e5-4b01-9596-f6340bc5c240 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:29.378924 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c5576c53-c5e5-4b01-9596-f6340bc5c240 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:29.379667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c5576c53-c5e5-4b01-9596-f6340bc5c240 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:29.380127 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c5576c53-c5e5-4b01-9596-f6340bc5c240 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:29.387911 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c5576c53-c5e5-4b01-9596-f6340bc5c240 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:29.803851 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:56:29.804870 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:56:29.806306 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:56:29.806957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:56:29.807627 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:56:29.846854 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:29.850210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:29.851363 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:29.853629 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:29.855791 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:29.856485 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:29.913173 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Getting quotas for project 4cf3279c60d14e43bd109bc171698b7c. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:56:29.926782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Getting quotas for user 52edf1eb44d34155be5e71cdda6bf46b and project 4cf3279c60d14e43bd109bc171698b7c. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:56:29.965629 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:56:29.972780 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:56:30.202048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c5576c53-c5e5-4b01-9596-f6340bc5c240 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:30.216948 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3b25cea2-7c71-4a21-a52b-6e886b9824f1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.053364 Oct 10 18:56:30.217574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c5576c53-c5e5-4b01-9596-f6340bc5c240 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:30.221046 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c5576c53-c5e5-4b01-9596-f6340bc5c240 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:30.221195 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 781/1728] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:56:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 8059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:56:30.228469 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c5576c53-c5e5-4b01-9596-f6340bc5c240 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.876970 Oct 10 18:56:30.230966 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 948/1729] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:29 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:30.232298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:30.232970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:30.242709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c7756a41-1f25-4f14-9689-a072fe2cacee tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:30.244257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c7756a41-1f25-4f14-9689-a072fe2cacee tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:30.254976 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:30.255911 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:30.256607 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:30.257567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:30.258558 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:30.259280 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:30.269390 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7756a41-1f25-4f14-9689-a072fe2cacee tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:30.271984 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7756a41-1f25-4f14-9689-a072fe2cacee tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:30.273452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7756a41-1f25-4f14-9689-a072fe2cacee tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:30.274065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7756a41-1f25-4f14-9689-a072fe2cacee tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:30.274607 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7756a41-1f25-4f14-9689-a072fe2cacee tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:30.275097 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7756a41-1f25-4f14-9689-a072fe2cacee tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:30.430417 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:30.440796 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:30.442479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:30.444811 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lazy-loading 'fault' on Instance uuid 4a19e7ee-040c-4614-87d7-622da642b798 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:56:30.546050 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:30.572458 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:30.584457 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8e1818c8c5154ce4934f5a85272e52f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245cb89d7664082ad3ba7169cc152cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:30.585936 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f89f6caa-d5f0-422a-b1e0-80f79f88c2a2 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 200 len: 1349 microversion: 2.21 time: 0.364086 Oct 10 18:56:30.587176 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 782/1730] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:30 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 1349 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:30.634519 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-11798ddc-2f47-4406-a9e1-76397f218070 req-6beda92a-c9aa-436d-a3fb-f92ab45fed2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a19e7ee-040c-4614-87d7-622da642b798", "name": "network-vif-deleted", "tag": "bdf44f97-51c7-41a6-858c-40107852753a"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:30.689086 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-11798ddc-2f47-4406-a9e1-76397f218070 req-6beda92a-c9aa-436d-a3fb-f92ab45fed2c service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:30.704584 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-11798ddc-2f47-4406-a9e1-76397f218070 req-6beda92a-c9aa-436d-a3fb-f92ab45fed2c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:30.705035 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-11798ddc-2f47-4406-a9e1-76397f218070 req-6beda92a-c9aa-436d-a3fb-f92ab45fed2c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:30.756979 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-11798ddc-2f47-4406-a9e1-76397f218070 req-6beda92a-c9aa-436d-a3fb-f92ab45fed2c service nova] Creating event network-vif-deleted:bdf44f97-51c7-41a6-858c-40107852753a for instance 4a19e7ee-040c-4614-87d7-622da642b798 on n-h2-860863-1 Oct 10 18:56:30.785811 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-11798ddc-2f47-4406-a9e1-76397f218070 req-6beda92a-c9aa-436d-a3fb-f92ab45fed2c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166555 Oct 10 18:56:30.790714 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 783/1731] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:30.801430 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7504c5e3-5ce6-430a-b9ae-2f4bb8a19687 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:30.802550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7504c5e3-5ce6-430a-b9ae-2f4bb8a19687 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:30.824697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7504c5e3-5ce6-430a-b9ae-2f4bb8a19687 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:30.828979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7504c5e3-5ce6-430a-b9ae-2f4bb8a19687 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:30.828979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7504c5e3-5ce6-430a-b9ae-2f4bb8a19687 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:30.828979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7504c5e3-5ce6-430a-b9ae-2f4bb8a19687 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:30.828979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7504c5e3-5ce6-430a-b9ae-2f4bb8a19687 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:30.828979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7504c5e3-5ce6-430a-b9ae-2f4bb8a19687 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:30.833124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c7756a41-1f25-4f14-9689-a072fe2cacee tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:30.861324 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c7756a41-1f25-4f14-9689-a072fe2cacee tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1371 microversion: 2.1 time: 0.627438 Oct 10 18:56:30.863440 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 949/1732] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:30 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1371 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:30.888768 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-97844c5b-31bf-4ee3-826f-2a0e37176e7a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Action: 'create', calling method: .version_select at 0x7f318dd77dc0>, body: {"keypair": {"name": "tempest-keypair-1098169261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhyntK3gp8U6iCYnEzij8iT9UDgdLM5PGjELgDKCYG136skWzQaZxIT9HLIejnyC29N4FexYJKPiz431/adxmKHCjsPZFuLfbOnWdTalsRGMwiuXK/aGqKngBUNcxSFoA=="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:30.991944 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-97844c5b-31bf-4ee3-826f-2a0e37176e7a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Getting quotas for project 1267edbe51de42fbacc5c5d59c91e224. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:56:31.023437 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-97844c5b-31bf-4ee3-826f-2a0e37176e7a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Getting quotas for user 06d30b5629a7494db2b96ac955f6f385 and project 1267edbe51de42fbacc5c5d59c91e224. Resources: {'key_pairs'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:56:31.060820 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7504c5e3-5ce6-430a-b9ae-2f4bb8a19687 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:31.069301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7504c5e3-5ce6-430a-b9ae-2f4bb8a19687 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:31.070741 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7504c5e3-5ce6-430a-b9ae-2f4bb8a19687 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:31.106230 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7504c5e3-5ce6-430a-b9ae-2f4bb8a19687 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.312944 Oct 10 18:56:31.116495 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 784/1733] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:30 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:31.129923 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-eaede17b-9b1d-468b-b529-0adc6bd5e3be tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:31.130694 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-eaede17b-9b1d-468b-b529-0adc6bd5e3be tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:31.251187 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-eaede17b-9b1d-468b-b529-0adc6bd5e3be tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:31.260558 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-eaede17b-9b1d-468b-b529-0adc6bd5e3be tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1215 microversion: 2.1 time: 0.142791 Oct 10 18:56:31.266157 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 785/1734] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:31 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:31.271146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-99137d0b-fc50-4606-935f-b1b3f3c8d604 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:31.277154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-99137d0b-fc50-4606-935f-b1b3f3c8d604 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:31.295259 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-99137d0b-fc50-4606-935f-b1b3f3c8d604 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:31.295898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-99137d0b-fc50-4606-935f-b1b3f3c8d604 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:31.296287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-99137d0b-fc50-4606-935f-b1b3f3c8d604 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:31.296947 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-99137d0b-fc50-4606-935f-b1b3f3c8d604 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:31.298024 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-99137d0b-fc50-4606-935f-b1b3f3c8d604 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:31.299028 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-99137d0b-fc50-4606-935f-b1b3f3c8d604 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:31.674449 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-97844c5b-31bf-4ee3-826f-2a0e37176e7a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.804684 Oct 10 18:56:31.674449 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 950/1735] 10.222.0.43 () {62 vars in 1200 bytes} [Mon Oct 10 18:56:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 807 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 10 18:56:31.687856 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-131227a6-2dd2-4f76-a83d-05bb6dc3a697 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:31.688760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-131227a6-2dd2-4f76-a83d-05bb6dc3a697 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:31.701304 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-131227a6-2dd2-4f76-a83d-05bb6dc3a697 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:31.703747 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-131227a6-2dd2-4f76-a83d-05bb6dc3a697 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:31.713028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-131227a6-2dd2-4f76-a83d-05bb6dc3a697 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:31.713028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-131227a6-2dd2-4f76-a83d-05bb6dc3a697 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:31.713028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-131227a6-2dd2-4f76-a83d-05bb6dc3a697 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:31.713028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-131227a6-2dd2-4f76-a83d-05bb6dc3a697 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:31.748938 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-99137d0b-fc50-4606-935f-b1b3f3c8d604 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:31.762723 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-99137d0b-fc50-4606-935f-b1b3f3c8d604 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.495264 Oct 10 18:56:31.785031 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 786/1736] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:31 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:31.793036 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0cbd149d-5fa3-485e-877a-7098a9e9bc71 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:31.794004 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0cbd149d-5fa3-485e-877a-7098a9e9bc71 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:31.800711 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0cbd149d-5fa3-485e-877a-7098a9e9bc71 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:31.801460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0cbd149d-5fa3-485e-877a-7098a9e9bc71 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:31.801909 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0cbd149d-5fa3-485e-877a-7098a9e9bc71 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:31.803249 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0cbd149d-5fa3-485e-877a-7098a9e9bc71 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:31.806236 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0cbd149d-5fa3-485e-877a-7098a9e9bc71 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:31.806744 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0cbd149d-5fa3-485e-877a-7098a9e9bc71 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:31.825948 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-0cbd149d-5fa3-485e-877a-7098a9e9bc71 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] HTTP exception thrown: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0cbd149d-5fa3-485e-877a-7098a9e9bc71 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Request method failure captured: Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 HTTP/1.1 Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGq8Y98jHOi7wNnTn89uCe3G2lcwcNw_KiR9cZ0jAJLoXMxzJLLShOTx9QHc1ulwLMl4IUGE-UeaxF9_cp4WBumBkGjtsSk-ttuLoBNbHN9f2XvKs8XDZRVY4vYMTIgCfBNl65KZo_fAqHVW9ftH5p8n8BvVJa2xkbxjO7usfonoq0o Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Openstack-Nova-Api-Version: 2.21 Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 8245cb89d7664082ad3ba7169cc152cc Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-InstanceActionsV221TestJSON-567522160 Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8245cb89d7664082ad3ba7169cc152cc", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8245cb89d7664082ad3ba7169cc152cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8245cb89d7664082ad3ba7169cc152cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8245cb89d7664082ad3ba7169cc152cc"}]}] Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-InstanceActionsV221TestJSON-567522160 Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 8245cb89d7664082ad3ba7169cc152cc Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-567522160 Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-InstanceActionsV221TestJSON-567522160-project Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 8e1818c8c5154ce4934f5a85272e52f1 Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-InstanceActionsV221TestJSON-567522160-project Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '4a19e7ee-040c-4614-87d7-622da642b798'} Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:56:31.829755 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:56:31.836512 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:56:31.836512 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:31.836512 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:56:31.836512 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:56:31.836512 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:56:31.836512 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:56:31.836512 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:31.836512 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:56:31.839400 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0cbd149d-5fa3-485e-877a-7098a9e9bc71 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Returning 404 to user: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:56:31.840740 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0cbd149d-5fa3-485e-877a-7098a9e9bc71 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 404 len: 111 microversion: 2.21 time: 0.053129 Oct 10 18:56:31.844999 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 787/1737] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:31 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:56:31.851225 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8a375b0e-469a-41c7-9b9e-bdbb8984fae7 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '.version_select at 0x7f318dcc1670>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:31.857924 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8a375b0e-469a-41c7-9b9e-bdbb8984fae7 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:31.861961 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a375b0e-469a-41c7-9b9e-bdbb8984fae7 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:31.862707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a375b0e-469a-41c7-9b9e-bdbb8984fae7 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:31.863485 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a375b0e-469a-41c7-9b9e-bdbb8984fae7 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:31.864466 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a375b0e-469a-41c7-9b9e-bdbb8984fae7 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:31.865108 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a375b0e-469a-41c7-9b9e-bdbb8984fae7 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:31.865755 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a375b0e-469a-41c7-9b9e-bdbb8984fae7 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:32.131541 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8a375b0e-469a-41c7-9b9e-bdbb8984fae7 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.285167 Oct 10 18:56:32.132358 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 788/1738] 10.222.0.43 () {60 vars in 1337 bytes} [Mon Oct 10 18:56:31 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798/os-instance-actions => generated 611 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:56:32.153094 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-64140288-83d2-49de-9d45-5a0324e0fcd0 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:32.165726 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-64140288-83d2-49de-9d45-5a0324e0fcd0 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:32.182319 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64140288-83d2-49de-9d45-5a0324e0fcd0 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:32.183095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64140288-83d2-49de-9d45-5a0324e0fcd0 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:32.183706 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64140288-83d2-49de-9d45-5a0324e0fcd0 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:32.184761 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64140288-83d2-49de-9d45-5a0324e0fcd0 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:32.185238 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64140288-83d2-49de-9d45-5a0324e0fcd0 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:32.185682 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64140288-83d2-49de-9d45-5a0324e0fcd0 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:32.268037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-131227a6-2dd2-4f76-a83d-05bb6dc3a697 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:32.324798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-131227a6-2dd2-4f76-a83d-05bb6dc3a697 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:32.340808 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-131227a6-2dd2-4f76-a83d-05bb6dc3a697 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:32.340808 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-131227a6-2dd2-4f76-a83d-05bb6dc3a697 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1813 microversion: 2.25 time: 0.659299 Oct 10 18:56:32.340808 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 951/1739] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:31 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1813 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:32.370365 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-81395189-3c10-4bb0-b441-d69afc3d2e3a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:32.371774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-81395189-3c10-4bb0-b441-d69afc3d2e3a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:32.388856 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-81395189-3c10-4bb0-b441-d69afc3d2e3a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:32.389757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-81395189-3c10-4bb0-b441-d69afc3d2e3a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:32.392889 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-81395189-3c10-4bb0-b441-d69afc3d2e3a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:32.393952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-81395189-3c10-4bb0-b441-d69afc3d2e3a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:32.394659 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-81395189-3c10-4bb0-b441-d69afc3d2e3a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:32.395332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-81395189-3c10-4bb0-b441-d69afc3d2e3a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:32.482713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-81395189-3c10-4bb0-b441-d69afc3d2e3a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:32.491037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-81395189-3c10-4bb0-b441-d69afc3d2e3a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:32.494217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-81395189-3c10-4bb0-b441-d69afc3d2e3a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:32.499003 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-81395189-3c10-4bb0-b441-d69afc3d2e3a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.159170 Oct 10 18:56:32.500114 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 952/1740] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:32 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:32.504848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9774d4b1-56d8-4874-802b-6acbca5364a3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:32.506177 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-64140288-83d2-49de-9d45-5a0324e0fcd0 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:32.506635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9774d4b1-56d8-4874-802b-6acbca5364a3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:32.512893 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9774d4b1-56d8-4874-802b-6acbca5364a3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:32.513609 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9774d4b1-56d8-4874-802b-6acbca5364a3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:32.514239 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9774d4b1-56d8-4874-802b-6acbca5364a3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:32.515302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9774d4b1-56d8-4874-802b-6acbca5364a3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:32.519860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9774d4b1-56d8-4874-802b-6acbca5364a3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:32.527831 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-64140288-83d2-49de-9d45-5a0324e0fcd0 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1371 microversion: 2.1 time: 0.378550 Oct 10 18:56:32.527831 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 789/1741] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:32 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1371 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:32.528109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9774d4b1-56d8-4874-802b-6acbca5364a3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:32.536765 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-19f2b945-2959-41d6-b7cb-805ced7cfe82 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:32.537642 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-19f2b945-2959-41d6-b7cb-805ced7cfe82 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:32.561627 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-9774d4b1-56d8-4874-802b-6acbca5364a3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] HTTP exception thrown: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9774d4b1-56d8-4874-802b-6acbca5364a3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Request method failure captured: Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 HTTP/1.1 Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGq8Y98jHOi7wNnTn89uCe3G2lcwcNw_KiR9cZ0jAJLoXMxzJLLShOTx9QHc1ulwLMl4IUGE-UeaxF9_cp4WBumBkGjtsSk-ttuLoBNbHN9f2XvKs8XDZRVY4vYMTIgCfBNl65KZo_fAqHVW9ftH5p8n8BvVJa2xkbxjO7usfonoq0o Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Openstack-Nova-Api-Version: 2.21 Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 8245cb89d7664082ad3ba7169cc152cc Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-InstanceActionsV221TestJSON-567522160 Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8245cb89d7664082ad3ba7169cc152cc", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8245cb89d7664082ad3ba7169cc152cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8245cb89d7664082ad3ba7169cc152cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8245cb89d7664082ad3ba7169cc152cc"}]}] Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-InstanceActionsV221TestJSON-567522160 Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 8245cb89d7664082ad3ba7169cc152cc Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-567522160 Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-InstanceActionsV221TestJSON-567522160-project Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 8e1818c8c5154ce4934f5a85272e52f1 Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-InstanceActionsV221TestJSON-567522160-project Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '4a19e7ee-040c-4614-87d7-622da642b798'} Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:56:32.563932 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9774d4b1-56d8-4874-802b-6acbca5364a3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Returning 404 to user: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9774d4b1-56d8-4874-802b-6acbca5364a3 tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 404 len: 111 microversion: 2.21 time: 0.064178 Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 953/1742] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:56:32 2022] DELETE /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2fd593f9-2459-4642-b966-2178833d6ffe tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:32.575756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2fd593f9-2459-4642-b966-2178833d6ffe tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] [instance: 4a19e7ee-040c-4614-87d7-622da642b798] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:32.631628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd593f9-2459-4642-b966-2178833d6ffe tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:32.631628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd593f9-2459-4642-b966-2178833d6ffe tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:32.631628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd593f9-2459-4642-b966-2178833d6ffe tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:32.631628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd593f9-2459-4642-b966-2178833d6ffe tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:32.631628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd593f9-2459-4642-b966-2178833d6ffe tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:32.635010 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd593f9-2459-4642-b966-2178833d6ffe tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:32.714641 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-19f2b945-2959-41d6-b7cb-805ced7cfe82 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:32.726342 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-19f2b945-2959-41d6-b7cb-805ced7cfe82 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1215 microversion: 2.1 time: 0.202667 Oct 10 18:56:32.726903 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-2fd593f9-2459-4642-b966-2178833d6ffe tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] HTTP exception thrown: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:32.729031 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 790/1743] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:32 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1215 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2fd593f9-2459-4642-b966-2178833d6ffe tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Request method failure captured: Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 HTTP/1.1 Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGq8Y98jHOi7wNnTn89uCe3G2lcwcNw_KiR9cZ0jAJLoXMxzJLLShOTx9QHc1ulwLMl4IUGE-UeaxF9_cp4WBumBkGjtsSk-ttuLoBNbHN9f2XvKs8XDZRVY4vYMTIgCfBNl65KZo_fAqHVW9ftH5p8n8BvVJa2xkbxjO7usfonoq0o Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Openstack-Nova-Api-Version: 2.21 Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 8245cb89d7664082ad3ba7169cc152cc Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-InstanceActionsV221TestJSON-567522160 Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8245cb89d7664082ad3ba7169cc152cc", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8245cb89d7664082ad3ba7169cc152cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8245cb89d7664082ad3ba7169cc152cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8245cb89d7664082ad3ba7169cc152cc"}]}] Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-InstanceActionsV221TestJSON-567522160 Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 8245cb89d7664082ad3ba7169cc152cc Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-567522160 Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-InstanceActionsV221TestJSON-567522160-project Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 8e1818c8c5154ce4934f5a85272e52f1 Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-InstanceActionsV221TestJSON-567522160-project Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '4a19e7ee-040c-4614-87d7-622da642b798'} Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:32.731206 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:56:32.736829 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:32.736829 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:32.736829 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:56:32.736829 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:56:32.736829 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:56:32.736829 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:56:32.736829 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. Oct 10 18:56:32.736829 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:32.736829 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2fd593f9-2459-4642-b966-2178833d6ffe tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] Returning 404 to user: Instance 4a19e7ee-040c-4614-87d7-622da642b798 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:56:32.736829 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2fd593f9-2459-4642-b966-2178833d6ffe tempest-InstanceActionsV221TestJSON-567522160 tempest-InstanceActionsV221TestJSON-567522160-project] 10.222.0.43 "GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798" status: 404 len: 111 microversion: 2.21 time: 0.161272 Oct 10 18:56:32.736829 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 954/1744] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:32 2022] GET /compute/v2.1/servers/4a19e7ee-040c-4614-87d7-622da642b798 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:56:32.792067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-98fbee20-01ad-4218-a1b1-f12b187da68c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:32.792744 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-98fbee20-01ad-4218-a1b1-f12b187da68c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:32.803599 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98fbee20-01ad-4218-a1b1-f12b187da68c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:32.804090 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98fbee20-01ad-4218-a1b1-f12b187da68c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:32.804523 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98fbee20-01ad-4218-a1b1-f12b187da68c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:32.805265 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98fbee20-01ad-4218-a1b1-f12b187da68c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:32.805742 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98fbee20-01ad-4218-a1b1-f12b187da68c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:32.806201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98fbee20-01ad-4218-a1b1-f12b187da68c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:33.369227 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-98fbee20-01ad-4218-a1b1-f12b187da68c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:33.369933 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4812cc08-6af5-4f73-b2d8-b5f5d3c073b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:33.369933 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4812cc08-6af5-4f73-b2d8-b5f5d3c073b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:33.376400 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-98fbee20-01ad-4218-a1b1-f12b187da68c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.589234 Oct 10 18:56:33.392134 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 791/1745] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:32 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:33.393390 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4812cc08-6af5-4f73-b2d8-b5f5d3c073b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:33.393543 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4812cc08-6af5-4f73-b2d8-b5f5d3c073b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:33.394716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4812cc08-6af5-4f73-b2d8-b5f5d3c073b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:33.394716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4812cc08-6af5-4f73-b2d8-b5f5d3c073b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:33.395055 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4812cc08-6af5-4f73-b2d8-b5f5d3c073b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:33.395488 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4812cc08-6af5-4f73-b2d8-b5f5d3c073b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:33.421083 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:33.427840 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-77e48bf1-9bcd-4bc9-8a15-d020f80ac2b5 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:33.428799 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-77e48bf1-9bcd-4bc9-8a15-d020f80ac2b5 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:33.435695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-77e48bf1-9bcd-4bc9-8a15-d020f80ac2b5 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:33.450251 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-77e48bf1-9bcd-4bc9-8a15-d020f80ac2b5 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:33.450992 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-77e48bf1-9bcd-4bc9-8a15-d020f80ac2b5 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:33.451954 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-77e48bf1-9bcd-4bc9-8a15-d020f80ac2b5 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:33.453427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-77e48bf1-9bcd-4bc9-8a15-d020f80ac2b5 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:33.454148 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-77e48bf1-9bcd-4bc9-8a15-d020f80ac2b5 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:33.505325 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-77e48bf1-9bcd-4bc9-8a15-d020f80ac2b5 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:56:33.540962 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:33.786032 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:33.863236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4812cc08-6af5-4f73-b2d8-b5f5d3c073b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:33.864834 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-77e48bf1-9bcd-4bc9-8a15-d020f80ac2b5 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 204 len: 0 microversion: 2.1 time: 0.439782 Oct 10 18:56:33.865984 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 792/1746] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:56:33 2022] DELETE /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:56:33.874987 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cc75bd7d-b5e0-442a-b8d8-ad6525f01577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:33.881059 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cc75bd7d-b5e0-442a-b8d8-ad6525f01577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:33.883264 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4812cc08-6af5-4f73-b2d8-b5f5d3c073b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:33.899756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4812cc08-6af5-4f73-b2d8-b5f5d3c073b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:33.901650 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4812cc08-6af5-4f73-b2d8-b5f5d3c073b3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1803 microversion: 2.25 time: 0.546066 Oct 10 18:56:33.905563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc75bd7d-b5e0-442a-b8d8-ad6525f01577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:33.913787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc75bd7d-b5e0-442a-b8d8-ad6525f01577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:33.913787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc75bd7d-b5e0-442a-b8d8-ad6525f01577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:33.913787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc75bd7d-b5e0-442a-b8d8-ad6525f01577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:33.913787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc75bd7d-b5e0-442a-b8d8-ad6525f01577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:33.915218 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc75bd7d-b5e0-442a-b8d8-ad6525f01577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:33.922914 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 955/1747] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:33 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1803 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:33.944581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-32a906a7-f25d-42dd-aaf8-fe295b40a4cf tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:33.944581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-32a906a7-f25d-42dd-aaf8-fe295b40a4cf tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:33.953770 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32a906a7-f25d-42dd-aaf8-fe295b40a4cf tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:33.954265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32a906a7-f25d-42dd-aaf8-fe295b40a4cf tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:33.954707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32a906a7-f25d-42dd-aaf8-fe295b40a4cf tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:33.955427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32a906a7-f25d-42dd-aaf8-fe295b40a4cf tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:33.955877 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32a906a7-f25d-42dd-aaf8-fe295b40a4cf tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:33.956521 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32a906a7-f25d-42dd-aaf8-fe295b40a4cf tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:34.051277 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cc75bd7d-b5e0-442a-b8d8-ad6525f01577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:34.065545 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cc75bd7d-b5e0-442a-b8d8-ad6525f01577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:34.070836 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cc75bd7d-b5e0-442a-b8d8-ad6525f01577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:34.083937 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cc75bd7d-b5e0-442a-b8d8-ad6525f01577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.216245 Oct 10 18:56:34.088894 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 793/1748] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:33 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:34.096367 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-626f811e-29fb-4222-955d-b613bb5832e1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:34.103234 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-626f811e-29fb-4222-955d-b613bb5832e1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:34.122627 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-626f811e-29fb-4222-955d-b613bb5832e1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:34.126537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-626f811e-29fb-4222-955d-b613bb5832e1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:34.129331 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-626f811e-29fb-4222-955d-b613bb5832e1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:34.130360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-626f811e-29fb-4222-955d-b613bb5832e1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:34.130994 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-626f811e-29fb-4222-955d-b613bb5832e1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:34.132920 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-626f811e-29fb-4222-955d-b613bb5832e1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:34.260030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-32a906a7-f25d-42dd-aaf8-fe295b40a4cf tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:34.269519 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-32a906a7-f25d-42dd-aaf8-fe295b40a4cf tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1371 microversion: 2.1 time: 0.335875 Oct 10 18:56:34.271663 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 956/1749] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:33 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1371 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:34.285485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-71b07276-3ab3-4455-8701-2230a568a37d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:34.286690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-71b07276-3ab3-4455-8701-2230a568a37d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:34.303676 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-71b07276-3ab3-4455-8701-2230a568a37d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:34.306506 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-71b07276-3ab3-4455-8701-2230a568a37d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:34.307341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-71b07276-3ab3-4455-8701-2230a568a37d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:34.308263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-71b07276-3ab3-4455-8701-2230a568a37d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:34.311857 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-71b07276-3ab3-4455-8701-2230a568a37d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:34.312668 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-71b07276-3ab3-4455-8701-2230a568a37d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:34.320160 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-626f811e-29fb-4222-955d-b613bb5832e1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:34.337295 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-626f811e-29fb-4222-955d-b613bb5832e1 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1267 microversion: 2.1 time: 0.245835 Oct 10 18:56:34.356123 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 794/1750] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:34 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:34.370532 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9c3da8de-9fba-47f1-a902-ce90f94d4282 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '.version_select at 0x7f318dcc1670>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:34.394918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c3da8de-9fba-47f1-a902-ce90f94d4282 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:34.395817 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c3da8de-9fba-47f1-a902-ce90f94d4282 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:34.400342 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c3da8de-9fba-47f1-a902-ce90f94d4282 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:34.431362 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9c3da8de-9fba-47f1-a902-ce90f94d4282 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1276 microversion: 2.25 time: 0.070137 Oct 10 18:56:34.444635 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 795/1751] 10.222.0.43 () {60 vars in 1184 bytes} [Mon Oct 10 18:56:34 2022] GET /compute/v2.1/os-migrations => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:34.455133 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2683bac3-8a88-443d-bcb5-d88a53695230 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:34.458745 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2683bac3-8a88-443d-bcb5-d88a53695230 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:34.479868 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2683bac3-8a88-443d-bcb5-d88a53695230 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:34.480752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2683bac3-8a88-443d-bcb5-d88a53695230 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:34.481214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2683bac3-8a88-443d-bcb5-d88a53695230 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:34.485325 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2683bac3-8a88-443d-bcb5-d88a53695230 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:34.485828 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2683bac3-8a88-443d-bcb5-d88a53695230 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:34.486314 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2683bac3-8a88-443d-bcb5-d88a53695230 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:34.792371 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2683bac3-8a88-443d-bcb5-d88a53695230 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:34.803183 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2683bac3-8a88-443d-bcb5-d88a53695230 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.356915 Oct 10 18:56:34.809841 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 796/1752] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:34 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:34.817103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6b6178de-4990-4f77-a2da-aeb6ba671d65 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:34.818237 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6b6178de-4990-4f77-a2da-aeb6ba671d65 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:34.826023 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b6178de-4990-4f77-a2da-aeb6ba671d65 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:34.826348 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b6178de-4990-4f77-a2da-aeb6ba671d65 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:34.827023 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b6178de-4990-4f77-a2da-aeb6ba671d65 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:34.827740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b6178de-4990-4f77-a2da-aeb6ba671d65 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:34.828677 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b6178de-4990-4f77-a2da-aeb6ba671d65 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:34.829425 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b6178de-4990-4f77-a2da-aeb6ba671d65 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:34.917290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-71b07276-3ab3-4455-8701-2230a568a37d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:34.930103 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-71b07276-3ab3-4455-8701-2230a568a37d tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1678 microversion: 2.1 time: 0.654964 Oct 10 18:56:34.934249 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 957/1753] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:34 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1678 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:34.949237 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-813b1bfe-f913-406f-9800-a34c77487345 req-3d1a649a-6501-429e-a533-5b95a728b8ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae3aec4-c476-4f1a-a702-2cd1548b0895", "name": "network-vif-plugged", "status": "completed", "tag": "aee6febe-6708-48e6-afe9-c2adf2fe85c3"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:34.968058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-813b1bfe-f913-406f-9800-a34c77487345 req-3d1a649a-6501-429e-a533-5b95a728b8ea service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:34.970149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-813b1bfe-f913-406f-9800-a34c77487345 req-3d1a649a-6501-429e-a533-5b95a728b8ea service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:34.975125 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-813b1bfe-f913-406f-9800-a34c77487345 req-3d1a649a-6501-429e-a533-5b95a728b8ea service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:35.006455 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-813b1bfe-f913-406f-9800-a34c77487345 req-3d1a649a-6501-429e-a533-5b95a728b8ea service nova] Creating event network-vif-plugged:aee6febe-6708-48e6-afe9-c2adf2fe85c3 for instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 on n-h1-860863-1 Oct 10 18:56:35.013420 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-813b1bfe-f913-406f-9800-a34c77487345 req-3d1a649a-6501-429e-a533-5b95a728b8ea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077295 Oct 10 18:56:35.014798 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 958/1754] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:35.120690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-23725f7c-d6d5-465d-bae4-e16b82d9ef8a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:35.123489 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-23725f7c-d6d5-465d-bae4-e16b82d9ef8a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:35.140915 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23725f7c-d6d5-465d-bae4-e16b82d9ef8a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:35.141790 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23725f7c-d6d5-465d-bae4-e16b82d9ef8a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:35.143449 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23725f7c-d6d5-465d-bae4-e16b82d9ef8a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:35.145923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23725f7c-d6d5-465d-bae4-e16b82d9ef8a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:35.146561 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23725f7c-d6d5-465d-bae4-e16b82d9ef8a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:35.147180 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23725f7c-d6d5-465d-bae4-e16b82d9ef8a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:35.239758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-6b6178de-4990-4f77-a2da-aeb6ba671d65 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid 96d79eab-1807-4467-b325-fe5f723ac559 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:56:35.267924 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6b6178de-4990-4f77-a2da-aeb6ba671d65 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 2422 microversion: 2.25 time: 0.455189 Oct 10 18:56:35.268777 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 797/1755] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:34 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 2422 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:35.302614 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1a3ddb25-d0f4-4f50-91b2-f3f484f30d28 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:35.305330 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1a3ddb25-d0f4-4f50-91b2-f3f484f30d28 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:35.320261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a3ddb25-d0f4-4f50-91b2-f3f484f30d28 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:35.321070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a3ddb25-d0f4-4f50-91b2-f3f484f30d28 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:35.321722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a3ddb25-d0f4-4f50-91b2-f3f484f30d28 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:35.322651 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a3ddb25-d0f4-4f50-91b2-f3f484f30d28 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:35.323289 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a3ddb25-d0f4-4f50-91b2-f3f484f30d28 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:35.323963 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a3ddb25-d0f4-4f50-91b2-f3f484f30d28 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:35.406337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-23725f7c-d6d5-465d-bae4-e16b82d9ef8a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:35.420035 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-23725f7c-d6d5-465d-bae4-e16b82d9ef8a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:35.426137 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-23725f7c-d6d5-465d-bae4-e16b82d9ef8a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:35.434914 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-23725f7c-d6d5-465d-bae4-e16b82d9ef8a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1537 microversion: 2.91 time: 0.317971 Oct 10 18:56:35.436414 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 959/1756] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:35 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1537 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:35.454419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b2c56835-a91d-4e69-b4b2-df9192a06ea4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:35.455383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b2c56835-a91d-4e69-b4b2-df9192a06ea4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:35.472367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2c56835-a91d-4e69-b4b2-df9192a06ea4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:35.474502 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2c56835-a91d-4e69-b4b2-df9192a06ea4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:35.474927 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2c56835-a91d-4e69-b4b2-df9192a06ea4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:35.475834 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2c56835-a91d-4e69-b4b2-df9192a06ea4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:35.476454 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2c56835-a91d-4e69-b4b2-df9192a06ea4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:35.477068 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b2c56835-a91d-4e69-b4b2-df9192a06ea4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:35.700465 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-1a3ddb25-d0f4-4f50-91b2-f3f484f30d28 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid 96d79eab-1807-4467-b325-fe5f723ac559 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:56:35.740651 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1a3ddb25-d0f4-4f50-91b2-f3f484f30d28 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 2422 microversion: 2.25 time: 0.430171 Oct 10 18:56:35.740651 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 798/1757] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:35 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 2422 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:56:35.748196 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bddc7be1-2104-4e24-8cff-f3f28be813d6 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:35.748196 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bddc7be1-2104-4e24-8cff-f3f28be813d6 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:35.774827 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bddc7be1-2104-4e24-8cff-f3f28be813d6 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:35.774827 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bddc7be1-2104-4e24-8cff-f3f28be813d6 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:35.774827 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bddc7be1-2104-4e24-8cff-f3f28be813d6 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:35.774827 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bddc7be1-2104-4e24-8cff-f3f28be813d6 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:35.774827 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bddc7be1-2104-4e24-8cff-f3f28be813d6 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:35.774827 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bddc7be1-2104-4e24-8cff-f3f28be813d6 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:35.894201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bddc7be1-2104-4e24-8cff-f3f28be813d6 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:35.923677 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bddc7be1-2104-4e24-8cff-f3f28be813d6 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1267 microversion: 2.1 time: 0.185229 Oct 10 18:56:35.925142 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 799/1758] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:35 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:35.932303 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d4356f71-eb48-4c66-a3d6-39998a724b34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:35.933381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d4356f71-eb48-4c66-a3d6-39998a724b34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:35.941121 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d4356f71-eb48-4c66-a3d6-39998a724b34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:35.941919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d4356f71-eb48-4c66-a3d6-39998a724b34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:35.942548 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d4356f71-eb48-4c66-a3d6-39998a724b34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:35.943437 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d4356f71-eb48-4c66-a3d6-39998a724b34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:35.944135 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d4356f71-eb48-4c66-a3d6-39998a724b34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:35.945123 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d4356f71-eb48-4c66-a3d6-39998a724b34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:36.230067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b2c56835-a91d-4e69-b4b2-df9192a06ea4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:36.235849 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d4356f71-eb48-4c66-a3d6-39998a724b34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:36.241037 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b2c56835-a91d-4e69-b4b2-df9192a06ea4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1371 microversion: 2.1 time: 0.803238 Oct 10 18:56:36.256402 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d4356f71-eb48-4c66-a3d6-39998a724b34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.316724 Oct 10 18:56:36.257620 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 800/1759] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:35 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:36.257890 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 960/1760] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:35 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1371 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:36.264373 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b5eac01e-bde8-466f-bbc9-111f6eefbdb9 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:36.265335 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b5eac01e-bde8-466f-bbc9-111f6eefbdb9 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:36.266676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e61b1234-2bc9-4459-8538-bf9c4bcb0c8c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:36.267177 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e61b1234-2bc9-4459-8538-bf9c4bcb0c8c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:36.273031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5eac01e-bde8-466f-bbc9-111f6eefbdb9 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:36.273223 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e61b1234-2bc9-4459-8538-bf9c4bcb0c8c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:36.273633 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e61b1234-2bc9-4459-8538-bf9c4bcb0c8c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:36.274620 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e61b1234-2bc9-4459-8538-bf9c4bcb0c8c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:36.274840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5eac01e-bde8-466f-bbc9-111f6eefbdb9 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:36.275332 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e61b1234-2bc9-4459-8538-bf9c4bcb0c8c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:36.275622 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5eac01e-bde8-466f-bbc9-111f6eefbdb9 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:36.275785 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e61b1234-2bc9-4459-8538-bf9c4bcb0c8c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:36.276211 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e61b1234-2bc9-4459-8538-bf9c4bcb0c8c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:36.277757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5eac01e-bde8-466f-bbc9-111f6eefbdb9 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:36.278382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5eac01e-bde8-466f-bbc9-111f6eefbdb9 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:36.281211 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5eac01e-bde8-466f-bbc9-111f6eefbdb9 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:36.473689 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-e61b1234-2bc9-4459-8538-bf9c4bcb0c8c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lazy-loading 'services' on Instance uuid 96d79eab-1807-4467-b325-fe5f723ac559 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:56:36.750953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b5eac01e-bde8-466f-bbc9-111f6eefbdb9 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:36.779222 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b5eac01e-bde8-466f-bbc9-111f6eefbdb9 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1678 microversion: 2.1 time: 0.512844 Oct 10 18:56:36.784853 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 961/1761] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:36 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1678 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:36.831500 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e61b1234-2bc9-4459-8538-bf9c4bcb0c8c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "DELETE /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments/1a6222e2-6a92-4a91-b79a-528964c1590c" status: 202 len: 0 microversion: 2.25 time: 0.571915 Oct 10 18:56:36.835274 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 801/1762] 10.222.0.43 () {60 vars in 1457 bytes} [Mon Oct 10 18:56:36 2022] DELETE /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments/1a6222e2-6a92-4a91-b79a-528964c1590c => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:56:36.835451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6775b1f8-6aa2-4960-a0c3-66d3b9df3ccd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:36.858483 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6775b1f8-6aa2-4960-a0c3-66d3b9df3ccd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:36.876200 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2148da73-3782-4639-b223-c33210b7d648 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:36.876442 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6775b1f8-6aa2-4960-a0c3-66d3b9df3ccd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:36.876908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6775b1f8-6aa2-4960-a0c3-66d3b9df3ccd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:36.877342 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6775b1f8-6aa2-4960-a0c3-66d3b9df3ccd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:36.884746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6775b1f8-6aa2-4960-a0c3-66d3b9df3ccd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:36.885272 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6775b1f8-6aa2-4960-a0c3-66d3b9df3ccd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:36.885709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6775b1f8-6aa2-4960-a0c3-66d3b9df3ccd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:36.892746 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2148da73-3782-4639-b223-c33210b7d648 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:36.917118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2148da73-3782-4639-b223-c33210b7d648 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:36.921105 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2148da73-3782-4639-b223-c33210b7d648 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:36.921641 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2148da73-3782-4639-b223-c33210b7d648 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:36.923232 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2148da73-3782-4639-b223-c33210b7d648 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:36.923721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2148da73-3782-4639-b223-c33210b7d648 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:36.924162 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2148da73-3782-4639-b223-c33210b7d648 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:36.975814 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2148da73-3782-4639-b223-c33210b7d648 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.137222 Oct 10 18:56:36.982403 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 802/1763] 10.222.0.43 () {60 vars in 1343 bytes} [Mon Oct 10 18:56:36 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:56:36.988154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d3981851-11c5-4b3d-8f18-9fdad17e01d5 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:36.991551 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d3981851-11c5-4b3d-8f18-9fdad17e01d5 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:36.996739 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3981851-11c5-4b3d-8f18-9fdad17e01d5 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:36.997235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3981851-11c5-4b3d-8f18-9fdad17e01d5 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:37.001902 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3981851-11c5-4b3d-8f18-9fdad17e01d5 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:37.004515 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3981851-11c5-4b3d-8f18-9fdad17e01d5 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:37.005047 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3981851-11c5-4b3d-8f18-9fdad17e01d5 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:37.005493 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3981851-11c5-4b3d-8f18-9fdad17e01d5 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:37.141108 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6775b1f8-6aa2-4960-a0c3-66d3b9df3ccd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:37.155574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6775b1f8-6aa2-4960-a0c3-66d3b9df3ccd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:37.157651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6775b1f8-6aa2-4960-a0c3-66d3b9df3ccd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:37.183094 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6775b1f8-6aa2-4960-a0c3-66d3b9df3ccd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1537 microversion: 2.91 time: 0.375649 Oct 10 18:56:37.188629 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 962/1764] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:36 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1537 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:37.264600 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c9beee9d-d619-4f1c-8ddd-279485217e40 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:37.266560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c9beee9d-d619-4f1c-8ddd-279485217e40 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:37.286675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d3981851-11c5-4b3d-8f18-9fdad17e01d5 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:37.290684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9beee9d-d619-4f1c-8ddd-279485217e40 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:37.294002 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9beee9d-d619-4f1c-8ddd-279485217e40 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:37.298278 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9beee9d-d619-4f1c-8ddd-279485217e40 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:37.300188 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d3981851-11c5-4b3d-8f18-9fdad17e01d5 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1275 microversion: 2.1 time: 0.316462 Oct 10 18:56:37.302177 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 803/1765] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:36 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1275 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:37.303275 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9beee9d-d619-4f1c-8ddd-279485217e40 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:37.304973 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9beee9d-d619-4f1c-8ddd-279485217e40 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:37.309459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9beee9d-d619-4f1c-8ddd-279485217e40 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:37.331074 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b63873e3-6109-4761-b9e3-6a9e368ec206 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:37.333025 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b63873e3-6109-4761-b9e3-6a9e368ec206 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:37.349974 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b63873e3-6109-4761-b9e3-6a9e368ec206 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:37.351215 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b63873e3-6109-4761-b9e3-6a9e368ec206 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:37.353333 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b63873e3-6109-4761-b9e3-6a9e368ec206 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:37.354696 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b63873e3-6109-4761-b9e3-6a9e368ec206 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:37.355854 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b63873e3-6109-4761-b9e3-6a9e368ec206 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:37.356450 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b63873e3-6109-4761-b9e3-6a9e368ec206 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:37.813353 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c9beee9d-d619-4f1c-8ddd-279485217e40 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:37.829656 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c9beee9d-d619-4f1c-8ddd-279485217e40 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1371 microversion: 2.1 time: 0.569261 Oct 10 18:56:37.830254 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 963/1766] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:37 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1371 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:56:37.835594 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-47365b42-51d6-4bff-ae5f-12f7f8d0ea11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:37.835594 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-47365b42-51d6-4bff-ae5f-12f7f8d0ea11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:37.850698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47365b42-51d6-4bff-ae5f-12f7f8d0ea11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:37.851220 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47365b42-51d6-4bff-ae5f-12f7f8d0ea11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:37.852192 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47365b42-51d6-4bff-ae5f-12f7f8d0ea11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:37.855260 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47365b42-51d6-4bff-ae5f-12f7f8d0ea11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:37.855777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47365b42-51d6-4bff-ae5f-12f7f8d0ea11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:37.856222 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47365b42-51d6-4bff-ae5f-12f7f8d0ea11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:37.989763 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-47365b42-51d6-4bff-ae5f-12f7f8d0ea11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:37.999193 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-47365b42-51d6-4bff-ae5f-12f7f8d0ea11 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1610 microversion: 2.1 time: 0.167887 Oct 10 18:56:38.001777 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b63873e3-6109-4761-b9e3-6a9e368ec206 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:38.022961 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b63873e3-6109-4761-b9e3-6a9e368ec206 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.703523 Oct 10 18:56:38.023563 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 804/1767] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:37 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:38.048635 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 964/1768] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:37 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1610 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:38.093313 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-087b268e-04ed-4723-8873-00aa1ec5ed92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:38.095835 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-087b268e-04ed-4723-8873-00aa1ec5ed92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:38.119165 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-087b268e-04ed-4723-8873-00aa1ec5ed92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:38.120151 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-087b268e-04ed-4723-8873-00aa1ec5ed92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:38.120627 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-087b268e-04ed-4723-8873-00aa1ec5ed92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:38.121349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-087b268e-04ed-4723-8873-00aa1ec5ed92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:38.124454 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-087b268e-04ed-4723-8873-00aa1ec5ed92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:38.124939 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-087b268e-04ed-4723-8873-00aa1ec5ed92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:38.217060 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4d02ba45-46fe-4ad7-9ec0-db2ab1820fb8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:38.217776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4d02ba45-46fe-4ad7-9ec0-db2ab1820fb8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:38.233508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d02ba45-46fe-4ad7-9ec0-db2ab1820fb8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:38.236172 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d02ba45-46fe-4ad7-9ec0-db2ab1820fb8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:38.236691 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d02ba45-46fe-4ad7-9ec0-db2ab1820fb8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:38.237304 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-087b268e-04ed-4723-8873-00aa1ec5ed92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.204025 Oct 10 18:56:38.239738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d02ba45-46fe-4ad7-9ec0-db2ab1820fb8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:38.240243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d02ba45-46fe-4ad7-9ec0-db2ab1820fb8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:38.240679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d02ba45-46fe-4ad7-9ec0-db2ab1820fb8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:38.242387 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 805/1769] 10.222.0.43 () {60 vars in 1343 bytes} [Mon Oct 10 18:56:38 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:56:38.349815 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3bacba60-87c3-4c2e-b021-4cb0ba2a6a14 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:38.350533 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3bacba60-87c3-4c2e-b021-4cb0ba2a6a14 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:38.373879 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3bacba60-87c3-4c2e-b021-4cb0ba2a6a14 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:38.374378 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3bacba60-87c3-4c2e-b021-4cb0ba2a6a14 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:38.379616 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3bacba60-87c3-4c2e-b021-4cb0ba2a6a14 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:38.380404 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3bacba60-87c3-4c2e-b021-4cb0ba2a6a14 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:38.381313 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3bacba60-87c3-4c2e-b021-4cb0ba2a6a14 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:38.381817 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3bacba60-87c3-4c2e-b021-4cb0ba2a6a14 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:38.491906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4d02ba45-46fe-4ad7-9ec0-db2ab1820fb8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:38.527838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4d02ba45-46fe-4ad7-9ec0-db2ab1820fb8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:38.531468 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4d02ba45-46fe-4ad7-9ec0-db2ab1820fb8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:38.564370 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4d02ba45-46fe-4ad7-9ec0-db2ab1820fb8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1540 microversion: 2.91 time: 0.351805 Oct 10 18:56:38.585569 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 965/1770] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:38 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1540 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:38.608514 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-da1dc7dc-d4f4-41b8-8ac6-77bab40a3f24 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-860863-1"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:38.611160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-da1dc7dc-d4f4-41b8-8ac6-77bab40a3f24 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:38.635831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da1dc7dc-d4f4-41b8-8ac6-77bab40a3f24 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:38.636326 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da1dc7dc-d4f4-41b8-8ac6-77bab40a3f24 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:38.646325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da1dc7dc-d4f4-41b8-8ac6-77bab40a3f24 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:38.647644 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da1dc7dc-d4f4-41b8-8ac6-77bab40a3f24 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:38.652242 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da1dc7dc-d4f4-41b8-8ac6-77bab40a3f24 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:38.659012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-da1dc7dc-d4f4-41b8-8ac6-77bab40a3f24 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:38.815597 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-da1dc7dc-d4f4-41b8-8ac6-77bab40a3f24 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-860863-1". {{(pid=127288) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 18:56:39.241243 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-da1dc7dc-d4f4-41b8-8ac6-77bab40a3f24 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63/action" status: 202 len: 0 microversion: 2.91 time: 0.644018 Oct 10 18:56:39.242167 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 966/1771] 10.222.0.43 () {62 vars in 1319 bytes} [Mon Oct 10 18:56:38 2022] POST /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63/action => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:56:39.258094 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-6289420d-5b1d-41bf-9de5-552656e0ce38 req-00acb64c-1477-4e81-afee-3acaac735d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc84705b-369f-4b67-a7ad-4cb62ba09d40", "name": "network-vif-deleted", "tag": "7fa49e0d-3a83-4a67-b0a9-cfc6f8f332ef"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:39.268987 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6289420d-5b1d-41bf-9de5-552656e0ce38 req-00acb64c-1477-4e81-afee-3acaac735d9c service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:39.269840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6289420d-5b1d-41bf-9de5-552656e0ce38 req-00acb64c-1477-4e81-afee-3acaac735d9c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:39.270653 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6289420d-5b1d-41bf-9de5-552656e0ce38 req-00acb64c-1477-4e81-afee-3acaac735d9c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:39.288043 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-6289420d-5b1d-41bf-9de5-552656e0ce38 req-00acb64c-1477-4e81-afee-3acaac735d9c service nova] Creating event network-vif-deleted:7fa49e0d-3a83-4a67-b0a9-cfc6f8f332ef for instance bc84705b-369f-4b67-a7ad-4cb62ba09d40 on n-h2-860863-1 Oct 10 18:56:39.310176 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-6289420d-5b1d-41bf-9de5-552656e0ce38 req-00acb64c-1477-4e81-afee-3acaac735d9c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062071 Oct 10 18:56:39.311098 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 967/1772] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:39.339984 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-23e68856-a763-402e-bd89-0963cff410d8 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:39.345308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-23e68856-a763-402e-bd89-0963cff410d8 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:39.364078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23e68856-a763-402e-bd89-0963cff410d8 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:39.364878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23e68856-a763-402e-bd89-0963cff410d8 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:39.365490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23e68856-a763-402e-bd89-0963cff410d8 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:39.366405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23e68856-a763-402e-bd89-0963cff410d8 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:39.367045 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23e68856-a763-402e-bd89-0963cff410d8 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:39.367468 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-23e68856-a763-402e-bd89-0963cff410d8 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:39.481733 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3bacba60-87c3-4c2e-b021-4cb0ba2a6a14 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:39.495923 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3bacba60-87c3-4c2e-b021-4cb0ba2a6a14 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1273 microversion: 2.1 time: 1.159598 Oct 10 18:56:39.505107 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 806/1773] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:38 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1273 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:56:39.521438 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1262937298", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "680bfa67-149b-4060-88d3-3f9400887f3e"}, {"port": "b06ba07e-b1b2-4d01-8143-4688336bd7d5", "tag": "port-1"}, {"port": "e9beeca4-6e86-4e0e-8cdf-8cecd637d4b7", "tag": "port-2"}, {"uuid": "9a019098-aef1-42b1-b529-bd47cc98c201", "tag": "net-1"}, {"uuid": "9a019098-aef1-42b1-b529-bd47cc98c201"}, {"uuid": "27f843f0-8883-4d26-a1a3-e576b5544061", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "27f843f0-8883-4d26-a1a3-e576b5544061", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "bea576e3-d06d-4bf7-8dd4-f28ae3f9dc21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a9b3f6b6-31c0-4ff4-8e6b-a387eb361b5d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "71137d9b-3764-445e-9d48-1ec46a702a1a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--745787500"}], "key_name": "tempest-keypair-1098169261", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:39.668889 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-23e68856-a763-402e-bd89-0963cff410d8 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:39.677424 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-23e68856-a763-402e-bd89-0963cff410d8 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1557 microversion: 2.1 time: 0.364930 Oct 10 18:56:39.698191 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 968/1774] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:39 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1557 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:39.698191 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ea94dcab-3323-433b-89e3-560d9351d7af tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:39.698191 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ea94dcab-3323-433b-89e3-560d9351d7af tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:39.715032 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea94dcab-3323-433b-89e3-560d9351d7af tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:39.715531 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea94dcab-3323-433b-89e3-560d9351d7af tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:39.722382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea94dcab-3323-433b-89e3-560d9351d7af tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:39.727760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea94dcab-3323-433b-89e3-560d9351d7af tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:39.727760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea94dcab-3323-433b-89e3-560d9351d7af tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:39.727760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea94dcab-3323-433b-89e3-560d9351d7af tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:39.801640 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea94dcab-3323-433b-89e3-560d9351d7af tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:39.802176 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea94dcab-3323-433b-89e3-560d9351d7af tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:39.803274 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea94dcab-3323-433b-89e3-560d9351d7af tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:39.804431 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-ea94dcab-3323-433b-89e3-560d9351d7af tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lazy-loading 'fault' on Instance uuid bc84705b-369f-4b67-a7ad-4cb62ba09d40 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:56:39.889218 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:39.889935 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ea94dcab-3323-433b-89e3-560d9351d7af tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abed6abc941a421682af5e3f5df98040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92d05639af8046dd87fe6973ff26f161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:39.901947 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ea94dcab-3323-433b-89e3-560d9351d7af tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 200 len: 1330 microversion: 2.1 time: 0.215379 Oct 10 18:56:39.917573 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 969/1775] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:39 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 1330 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:39.929523 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-39466916-b4e3-4fba-82b2-1a59443e7fc7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:39.932967 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-39466916-b4e3-4fba-82b2-1a59443e7fc7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:39.945174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39466916-b4e3-4fba-82b2-1a59443e7fc7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:39.954350 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39466916-b4e3-4fba-82b2-1a59443e7fc7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:39.954350 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39466916-b4e3-4fba-82b2-1a59443e7fc7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:39.954350 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39466916-b4e3-4fba-82b2-1a59443e7fc7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:39.954350 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39466916-b4e3-4fba-82b2-1a59443e7fc7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:39.954350 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39466916-b4e3-4fba-82b2-1a59443e7fc7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:40.187913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-39466916-b4e3-4fba-82b2-1a59443e7fc7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:40.206571 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-39466916-b4e3-4fba-82b2-1a59443e7fc7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.287749 Oct 10 18:56:40.208009 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 970/1776] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:39 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:40.217204 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6bc3037d-6b6d-4482-ada9-5eea3bbb5141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:40.219932 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6bc3037d-6b6d-4482-ada9-5eea3bbb5141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:40.227616 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6bc3037d-6b6d-4482-ada9-5eea3bbb5141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:40.230012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6bc3037d-6b6d-4482-ada9-5eea3bbb5141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:40.230012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6bc3037d-6b6d-4482-ada9-5eea3bbb5141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:40.230803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6bc3037d-6b6d-4482-ada9-5eea3bbb5141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:40.231489 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6bc3037d-6b6d-4482-ada9-5eea3bbb5141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:40.232145 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6bc3037d-6b6d-4482-ada9-5eea3bbb5141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:40.288788 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] validate_networks() for [('680bfa67-149b-4060-88d3-3f9400887f3e', None, None, None, None, None), (None, None, 'b06ba07e-b1b2-4d01-8143-4688336bd7d5', None, None, None), (None, None, 'e9beeca4-6e86-4e0e-8cdf-8cecd637d4b7', None, None, None), ('9a019098-aef1-42b1-b529-bd47cc98c201', None, None, None, None, None), ('9a019098-aef1-42b1-b529-bd47cc98c201', None, None, None, None, None), ('27f843f0-8883-4d26-a1a3-e576b5544061', '10.2.2.100', None, None, None, None), ('27f843f0-8883-4d26-a1a3-e576b5544061', '10.2.2.200', None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:56:40.311826 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:40.347041 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6bc3037d-6b6d-4482-ada9-5eea3bbb5141 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.136505 Oct 10 18:56:40.357408 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 971/1777] 10.222.0.43 () {60 vars in 1343 bytes} [Mon Oct 10 18:56:40 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:56:40.370241 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-55226dc7-d1dc-4f50-bc18-158b980aa10a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:40.374435 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-55226dc7-d1dc-4f50-bc18-158b980aa10a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:40.404895 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55226dc7-d1dc-4f50-bc18-158b980aa10a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:40.405507 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55226dc7-d1dc-4f50-bc18-158b980aa10a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:40.405966 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55226dc7-d1dc-4f50-bc18-158b980aa10a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:40.407747 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55226dc7-d1dc-4f50-bc18-158b980aa10a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:40.409700 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55226dc7-d1dc-4f50-bc18-158b980aa10a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:40.410217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55226dc7-d1dc-4f50-bc18-158b980aa10a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:40.559937 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55226dc7-d1dc-4f50-bc18-158b980aa10a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:40.570427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55226dc7-d1dc-4f50-bc18-158b980aa10a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:40.571925 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55226dc7-d1dc-4f50-bc18-158b980aa10a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:40.578258 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-55226dc7-d1dc-4f50-bc18-158b980aa10a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1488 microversion: 2.91 time: 0.219604 Oct 10 18:56:40.589910 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 972/1778] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:40 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1488 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:40.606106 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-44d08f08-3b54-48de-b11e-fef86bad5721 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:40.606901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-44d08f08-3b54-48de-b11e-fef86bad5721 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:40.613948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44d08f08-3b54-48de-b11e-fef86bad5721 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:40.614728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44d08f08-3b54-48de-b11e-fef86bad5721 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:40.615407 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44d08f08-3b54-48de-b11e-fef86bad5721 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:40.616289 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44d08f08-3b54-48de-b11e-fef86bad5721 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:40.616943 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44d08f08-3b54-48de-b11e-fef86bad5721 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:40.617780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44d08f08-3b54-48de-b11e-fef86bad5721 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:40.784053 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-44d08f08-3b54-48de-b11e-fef86bad5721 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.192248 Oct 10 18:56:40.793386 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 973/1779] 10.222.0.43 () {58 vars in 1275 bytes} [Mon Oct 10 18:56:40 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895/os-interface => generated 285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:40.807025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4d751750-ac98-4b5e-b172-0d7e2b0a3ef4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:40.807769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4d751750-ac98-4b5e-b172-0d7e2b0a3ef4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:40.820144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d751750-ac98-4b5e-b172-0d7e2b0a3ef4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:40.820563 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d751750-ac98-4b5e-b172-0d7e2b0a3ef4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:40.821063 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d751750-ac98-4b5e-b172-0d7e2b0a3ef4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:40.821712 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d751750-ac98-4b5e-b172-0d7e2b0a3ef4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:40.822164 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d751750-ac98-4b5e-b172-0d7e2b0a3ef4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:40.822595 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4d751750-ac98-4b5e-b172-0d7e2b0a3ef4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:41.066348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:41.255180 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4d751750-ac98-4b5e-b172-0d7e2b0a3ef4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:41.275300 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4d751750-ac98-4b5e-b172-0d7e2b0a3ef4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1315 microversion: 2.1 time: 0.487514 Oct 10 18:56:41.285979 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 974/1780] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:40 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:41.295322 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7ecb1b7d-7264-4707-a782-29c67965f937 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:41.304470 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7ecb1b7d-7264-4707-a782-29c67965f937 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] [instance: bc84705b-369f-4b67-a7ad-4cb62ba09d40] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:41.325087 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ecb1b7d-7264-4707-a782-29c67965f937 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:41.325593 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ecb1b7d-7264-4707-a782-29c67965f937 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:41.326028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ecb1b7d-7264-4707-a782-29c67965f937 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:41.326743 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ecb1b7d-7264-4707-a782-29c67965f937 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:41.327200 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ecb1b7d-7264-4707-a782-29c67965f937 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:41.327628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ecb1b7d-7264-4707-a782-29c67965f937 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:41.371105 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-7ecb1b7d-7264-4707-a782-29c67965f937 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] HTTP exception thrown: Instance bc84705b-369f-4b67-a7ad-4cb62ba09d40 could not be found. Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7ecb1b7d-7264-4707-a782-29c67965f937 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Request method failure captured: Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 HTTP/1.1 Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGoev_sfC_W9MvHoUaS5ehYIlhDLyzTx3M44Cw0bITI1FxOEeqB8T6k-upBMscHUmhXL8T3wQDKyxv9XdLDRGQ91DwD-CMg3wN0Fo0LioXRy5WOSEUX4b2HRYG2ttO0Qz9nw1THgqmXV5kF7MNf8P90hObtgiaPXUnP8k1K_gvw4lr4 Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 92d05639af8046dd87fe6973ff26f161 Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-VolumesAdminNegativeTest-1330506656 Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_92d05639af8046dd87fe6973ff26f161", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/92d05639af8046dd87fe6973ff26f161"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92d05639af8046dd87fe6973ff26f161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/92d05639af8046dd87fe6973ff26f161"}]}] Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-VolumesAdminNegativeTest-1330506656 Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 92d05639af8046dd87fe6973ff26f161 Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1330506656 Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-VolumesAdminNegativeTest-1330506656-project Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: abed6abc941a421682af5e3f5df98040 Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-VolumesAdminNegativeTest-1330506656-project Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance bc84705b-369f-4b67-a7ad-4cb62ba09d40 could not be found. Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'bc84705b-369f-4b67-a7ad-4cb62ba09d40'} Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc84705b-369f-4b67-a7ad-4cb62ba09d40 could not be found. Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc84705b-369f-4b67-a7ad-4cb62ba09d40 could not be found. Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:56:41.372843 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:41.378689 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:56:41.378689 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:56:41.378689 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:56:41.378689 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:56:41.378689 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:56:41.378689 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc84705b-369f-4b67-a7ad-4cb62ba09d40 could not be found. Oct 10 18:56:41.378689 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:56:41.378689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7ecb1b7d-7264-4707-a782-29c67965f937 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Returning 404 to user: Instance bc84705b-369f-4b67-a7ad-4cb62ba09d40 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:56:41.378689 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7ecb1b7d-7264-4707-a782-29c67965f937 tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40" status: 404 len: 111 microversion: 2.1 time: 0.087085 Oct 10 18:56:41.385499 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 975/1781] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:41 2022] GET /compute/v2.1/servers/bc84705b-369f-4b67-a7ad-4cb62ba09d40 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:56:41.392052 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b9c56ed1-f11a-4741-b2fb-e6eb21cffef3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:41.406498 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b9c56ed1-f11a-4741-b2fb-e6eb21cffef3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:41.426285 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b9c56ed1-f11a-4741-b2fb-e6eb21cffef3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:41.427195 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b9c56ed1-f11a-4741-b2fb-e6eb21cffef3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:41.427824 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b9c56ed1-f11a-4741-b2fb-e6eb21cffef3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:41.428774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b9c56ed1-f11a-4741-b2fb-e6eb21cffef3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:41.433194 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b9c56ed1-f11a-4741-b2fb-e6eb21cffef3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:41.433897 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b9c56ed1-f11a-4741-b2fb-e6eb21cffef3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:41.708156 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b9c56ed1-f11a-4741-b2fb-e6eb21cffef3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:41.718823 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b9c56ed1-f11a-4741-b2fb-e6eb21cffef3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.331770 Oct 10 18:56:41.732357 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 976/1782] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:41 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:41.737998 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f7c12590-80b1-41b9-bbd6-ee71eb109f74 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:41.740506 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f7c12590-80b1-41b9-bbd6-ee71eb109f74 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:41.761480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7c12590-80b1-41b9-bbd6-ee71eb109f74 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:41.762238 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7c12590-80b1-41b9-bbd6-ee71eb109f74 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:41.763244 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7c12590-80b1-41b9-bbd6-ee71eb109f74 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:41.765340 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7c12590-80b1-41b9-bbd6-ee71eb109f74 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:41.766203 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7c12590-80b1-41b9-bbd6-ee71eb109f74 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:41.766827 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7c12590-80b1-41b9-bbd6-ee71eb109f74 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:41.840205 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f7c12590-80b1-41b9-bbd6-ee71eb109f74 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106313 Oct 10 18:56:41.841856 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 977/1783] 10.222.0.43 () {60 vars in 1343 bytes} [Mon Oct 10 18:56:41 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:56:41.846708 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-79673f78-73b2-4503-924b-94d6308e996b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] Calling method '.version_select at 0x7f318df914c0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:41.944920 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-79673f78-73b2-4503-924b-94d6308e996b tempest-VolumesAdminNegativeTest-1330506656 tempest-VolumesAdminNegativeTest-1330506656-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-597174242" status: 202 len: 0 microversion: 2.1 time: 0.100984 Oct 10 18:56:41.949785 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 978/1784] 10.222.0.43 () {58 vars in 1218 bytes} [Mon Oct 10 18:56:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-597174242 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:56:41.955495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8ff0eb4e-2b6b-4574-8b82-e97083437646 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:41.960672 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8ff0eb4e-2b6b-4574-8b82-e97083437646 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:41.970052 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ff0eb4e-2b6b-4574-8b82-e97083437646 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:41.973155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ff0eb4e-2b6b-4574-8b82-e97083437646 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:41.973870 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ff0eb4e-2b6b-4574-8b82-e97083437646 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:41.974871 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ff0eb4e-2b6b-4574-8b82-e97083437646 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:41.981097 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ff0eb4e-2b6b-4574-8b82-e97083437646 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:41.981794 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ff0eb4e-2b6b-4574-8b82-e97083437646 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:42.197639 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8ff0eb4e-2b6b-4574-8b82-e97083437646 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:42.209614 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8ff0eb4e-2b6b-4574-8b82-e97083437646 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:42.214153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8ff0eb4e-2b6b-4574-8b82-e97083437646 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:42.226646 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8ff0eb4e-2b6b-4574-8b82-e97083437646 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.275281 Oct 10 18:56:42.252089 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 979/1785] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:41 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:42.308897 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-84093c74-2215-4f86-83b7-0df732a481e4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:42.310265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-84093c74-2215-4f86-83b7-0df732a481e4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:42.320919 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84093c74-2215-4f86-83b7-0df732a481e4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:42.327643 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84093c74-2215-4f86-83b7-0df732a481e4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:42.331124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84093c74-2215-4f86-83b7-0df732a481e4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:42.333193 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84093c74-2215-4f86-83b7-0df732a481e4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:42.336805 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84093c74-2215-4f86-83b7-0df732a481e4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:42.337445 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84093c74-2215-4f86-83b7-0df732a481e4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:42.699120 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-84093c74-2215-4f86-83b7-0df732a481e4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:42.711115 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-84093c74-2215-4f86-83b7-0df732a481e4 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1315 microversion: 2.1 time: 0.407590 Oct 10 18:56:42.713305 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 980/1786] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:42 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:56:42.725764 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=10 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:42.756446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4b6c90b3-4aa7-4a1c-a6e9-c1b1b9d0bb56 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:42.757519 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4b6c90b3-4aa7-4a1c-a6e9-c1b1b9d0bb56 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:42.769955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:42.772366 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b6c90b3-4aa7-4a1c-a6e9-c1b1b9d0bb56 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:42.772900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b6c90b3-4aa7-4a1c-a6e9-c1b1b9d0bb56 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:42.775010 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b6c90b3-4aa7-4a1c-a6e9-c1b1b9d0bb56 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:42.776092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b6c90b3-4aa7-4a1c-a6e9-c1b1b9d0bb56 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:42.776591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b6c90b3-4aa7-4a1c-a6e9-c1b1b9d0bb56 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:42.777091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b6c90b3-4aa7-4a1c-a6e9-c1b1b9d0bb56 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:43.724673 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4b6c90b3-4aa7-4a1c-a6e9-c1b1b9d0bb56 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:43.736008 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4b6c90b3-4aa7-4a1c-a6e9-c1b1b9d0bb56 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.984528 Oct 10 18:56:43.753608 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 981/1787] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:42 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:43.753608 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c6c3bd7d-7d4f-4b46-a9c8-d0e3741b63d5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:43.753608 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c6c3bd7d-7d4f-4b46-a9c8-d0e3741b63d5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:43.769864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6c3bd7d-7d4f-4b46-a9c8-d0e3741b63d5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:43.775346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6c3bd7d-7d4f-4b46-a9c8-d0e3741b63d5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:43.775878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6c3bd7d-7d4f-4b46-a9c8-d0e3741b63d5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:43.776719 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6c3bd7d-7d4f-4b46-a9c8-d0e3741b63d5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:43.777270 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6c3bd7d-7d4f-4b46-a9c8-d0e3741b63d5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:43.777852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6c3bd7d-7d4f-4b46-a9c8-d0e3741b63d5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:43.849750 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c6c3bd7d-7d4f-4b46-a9c8-d0e3741b63d5 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109657 Oct 10 18:56:43.857005 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 982/1788] 10.222.0.43 () {60 vars in 1343 bytes} [Mon Oct 10 18:56:43 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:56:43.862418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ac899a0a-991f-4dc0-96de-d4d7131c9f90 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:43.870082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ac899a0a-991f-4dc0-96de-d4d7131c9f90 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:43.884405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac899a0a-991f-4dc0-96de-d4d7131c9f90 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:43.884992 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac899a0a-991f-4dc0-96de-d4d7131c9f90 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:43.885524 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac899a0a-991f-4dc0-96de-d4d7131c9f90 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:43.894646 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac899a0a-991f-4dc0-96de-d4d7131c9f90 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:43.895838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac899a0a-991f-4dc0-96de-d4d7131c9f90 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:43.896493 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac899a0a-991f-4dc0-96de-d4d7131c9f90 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:44.077795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ac899a0a-991f-4dc0-96de-d4d7131c9f90 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:44.094602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ac899a0a-991f-4dc0-96de-d4d7131c9f90 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:44.098269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ac899a0a-991f-4dc0-96de-d4d7131c9f90 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:44.116138 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ac899a0a-991f-4dc0-96de-d4d7131c9f90 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.257659 Oct 10 18:56:44.117384 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 983/1789] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:43 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:44.128609 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-acda36b8-fe19-4130-addb-7e56f33d79d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:44.129566 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-acda36b8-fe19-4130-addb-7e56f33d79d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:44.144129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acda36b8-fe19-4130-addb-7e56f33d79d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:44.147957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acda36b8-fe19-4130-addb-7e56f33d79d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:44.149698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acda36b8-fe19-4130-addb-7e56f33d79d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:44.150762 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acda36b8-fe19-4130-addb-7e56f33d79d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:44.153551 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acda36b8-fe19-4130-addb-7e56f33d79d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:44.154199 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acda36b8-fe19-4130-addb-7e56f33d79d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:44.885878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-acda36b8-fe19-4130-addb-7e56f33d79d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:44.894557 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-acda36b8-fe19-4130-addb-7e56f33d79d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1315 microversion: 2.1 time: 0.775639 Oct 10 18:56:44.908905 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 984/1790] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:44 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:44.911889 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6fb0b7d6-a765-401a-8874-6d8ff4bd2a34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:44.913644 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6fb0b7d6-a765-401a-8874-6d8ff4bd2a34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:44.925155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6fb0b7d6-a765-401a-8874-6d8ff4bd2a34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:44.925405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6fb0b7d6-a765-401a-8874-6d8ff4bd2a34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:44.931646 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6fb0b7d6-a765-401a-8874-6d8ff4bd2a34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:44.932326 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6fb0b7d6-a765-401a-8874-6d8ff4bd2a34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:44.932840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6fb0b7d6-a765-401a-8874-6d8ff4bd2a34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:44.933311 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6fb0b7d6-a765-401a-8874-6d8ff4bd2a34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:45.163250 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6fb0b7d6-a765-401a-8874-6d8ff4bd2a34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:45.209213 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6fb0b7d6-a765-401a-8874-6d8ff4bd2a34 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.306983 Oct 10 18:56:45.222508 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 985/1791] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:44 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:45.238065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ffeb4c95-a23c-44a7-ab7c-2ccaa02f6f4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:45.240877 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ffeb4c95-a23c-44a7-ab7c-2ccaa02f6f4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:45.296987 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffeb4c95-a23c-44a7-ab7c-2ccaa02f6f4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:45.307271 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffeb4c95-a23c-44a7-ab7c-2ccaa02f6f4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:45.310454 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffeb4c95-a23c-44a7-ab7c-2ccaa02f6f4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:45.311186 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffeb4c95-a23c-44a7-ab7c-2ccaa02f6f4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:45.318672 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffeb4c95-a23c-44a7-ab7c-2ccaa02f6f4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:45.320813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ffeb4c95-a23c-44a7-ab7c-2ccaa02f6f4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:45.402491 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ffeb4c95-a23c-44a7-ab7c-2ccaa02f6f4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.171503 Oct 10 18:56:45.405175 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 986/1792] 10.222.0.43 () {60 vars in 1343 bytes} [Mon Oct 10 18:56:45 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:56:45.414089 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-4a195d4d-c842-4c3b-b791-542549f1e65a req-f2b742fb-6413-408d-ba56-fdfa94b64b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae3aec4-c476-4f1a-a702-2cd1548b0895", "tag": "aee6febe-6708-48e6-afe9-c2adf2fe85c3"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:45.457247 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4a195d4d-c842-4c3b-b791-542549f1e65a req-f2b742fb-6413-408d-ba56-fdfa94b64b51 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:45.457788 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4a195d4d-c842-4c3b-b791-542549f1e65a req-f2b742fb-6413-408d-ba56-fdfa94b64b51 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:45.460195 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4a195d4d-c842-4c3b-b791-542549f1e65a req-f2b742fb-6413-408d-ba56-fdfa94b64b51 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:45.511765 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-4a195d4d-c842-4c3b-b791-542549f1e65a req-f2b742fb-6413-408d-ba56-fdfa94b64b51 service nova] Creating event network-changed:aee6febe-6708-48e6-afe9-c2adf2fe85c3 for instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 on n-h1-860863-1 Oct 10 18:56:45.522934 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-4a195d4d-c842-4c3b-b791-542549f1e65a req-f2b742fb-6413-408d-ba56-fdfa94b64b51 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116457 Oct 10 18:56:45.526839 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 987/1793] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:45.569436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5cca1929-f47d-45cd-be01-975f5053379c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:45.593394 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5cca1929-f47d-45cd-be01-975f5053379c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:45.616572 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cca1929-f47d-45cd-be01-975f5053379c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:45.618006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cca1929-f47d-45cd-be01-975f5053379c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:45.619288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cca1929-f47d-45cd-be01-975f5053379c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:45.628519 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cca1929-f47d-45cd-be01-975f5053379c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:45.629745 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cca1929-f47d-45cd-be01-975f5053379c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:45.630596 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5cca1929-f47d-45cd-be01-975f5053379c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:45.918511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5cca1929-f47d-45cd-be01-975f5053379c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:45.941333 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5cca1929-f47d-45cd-be01-975f5053379c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:45.956073 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5cca1929-f47d-45cd-be01-975f5053379c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:45.971965 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5cca1929-f47d-45cd-be01-975f5053379c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.442252 Oct 10 18:56:45.974479 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 988/1794] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:45 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:45.991736 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-b23ac089-f417-4001-aa77-2a2fc69c1015 req-37cfa5c6-baef-472d-a982-0cf96ad54daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be4204cf-67d2-46c7-9f84-605cb9262f2a", "tag": "526f93eb-13b0-4787-89ca-0fcf9f4f7082"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:46.028024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b23ac089-f417-4001-aa77-2a2fc69c1015 req-37cfa5c6-baef-472d-a982-0cf96ad54daf service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:46.032774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b23ac089-f417-4001-aa77-2a2fc69c1015 req-37cfa5c6-baef-472d-a982-0cf96ad54daf service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:46.035247 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b23ac089-f417-4001-aa77-2a2fc69c1015 req-37cfa5c6-baef-472d-a982-0cf96ad54daf service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:46.079905 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-b23ac089-f417-4001-aa77-2a2fc69c1015 req-37cfa5c6-baef-472d-a982-0cf96ad54daf service nova] Creating event network-changed:526f93eb-13b0-4787-89ca-0fcf9f4f7082 for instance be4204cf-67d2-46c7-9f84-605cb9262f2a on n-h2-860863-1 Oct 10 18:56:46.094568 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-b23ac089-f417-4001-aa77-2a2fc69c1015 req-37cfa5c6-baef-472d-a982-0cf96ad54daf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115852 Oct 10 18:56:46.096072 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 989/1795] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:46.114323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-40dd42b9-fa1c-4727-b951-d840e202c890 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:46.116963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-40dd42b9-fa1c-4727-b951-d840e202c890 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:46.136187 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-40dd42b9-fa1c-4727-b951-d840e202c890 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:46.136758 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-40dd42b9-fa1c-4727-b951-d840e202c890 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:46.137214 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-40dd42b9-fa1c-4727-b951-d840e202c890 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:46.138070 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-40dd42b9-fa1c-4727-b951-d840e202c890 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:46.138518 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-40dd42b9-fa1c-4727-b951-d840e202c890 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:46.138960 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-40dd42b9-fa1c-4727-b951-d840e202c890 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:46.727152 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-40dd42b9-fa1c-4727-b951-d840e202c890 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:46.740264 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-40dd42b9-fa1c-4727-b951-d840e202c890 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1315 microversion: 2.1 time: 0.641239 Oct 10 18:56:46.749736 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 990/1796] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:46 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1315 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:46.754769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ded2291a-1a9d-4318-9255-cf1bf2cb6ae7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:46.763828 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ded2291a-1a9d-4318-9255-cf1bf2cb6ae7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:46.773314 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ded2291a-1a9d-4318-9255-cf1bf2cb6ae7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:46.780908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ded2291a-1a9d-4318-9255-cf1bf2cb6ae7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:46.781181 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ded2291a-1a9d-4318-9255-cf1bf2cb6ae7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:46.781940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ded2291a-1a9d-4318-9255-cf1bf2cb6ae7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:46.782398 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ded2291a-1a9d-4318-9255-cf1bf2cb6ae7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:46.782829 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ded2291a-1a9d-4318-9255-cf1bf2cb6ae7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:46.827413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:47.227601 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ded2291a-1a9d-4318-9255-cf1bf2cb6ae7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:47.244673 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ded2291a-1a9d-4318-9255-cf1bf2cb6ae7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.493460 Oct 10 18:56:47.254480 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 991/1797] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:46 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:47.268413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d1470c7d-51a6-4f62-a61e-727c65b656d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:47.279282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d1470c7d-51a6-4f62-a61e-727c65b656d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:47.297548 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d1470c7d-51a6-4f62-a61e-727c65b656d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:47.311553 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d1470c7d-51a6-4f62-a61e-727c65b656d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:47.312891 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d1470c7d-51a6-4f62-a61e-727c65b656d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:47.314707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d1470c7d-51a6-4f62-a61e-727c65b656d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:47.316154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d1470c7d-51a6-4f62-a61e-727c65b656d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:47.317735 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d1470c7d-51a6-4f62-a61e-727c65b656d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:47.428253 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d1470c7d-51a6-4f62-a61e-727c65b656d3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.172223 Oct 10 18:56:47.429798 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 992/1798] 10.222.0.43 () {60 vars in 1343 bytes} [Mon Oct 10 18:56:47 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559/os-volume_attachments => generated 25 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:47.448765 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-88a61842-e1a6-41cc-b4c2-12f1eb463b54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:47.449752 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-88a61842-e1a6-41cc-b4c2-12f1eb463b54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:47.471927 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88a61842-e1a6-41cc-b4c2-12f1eb463b54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:47.475466 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88a61842-e1a6-41cc-b4c2-12f1eb463b54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:47.495229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88a61842-e1a6-41cc-b4c2-12f1eb463b54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:47.498791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88a61842-e1a6-41cc-b4c2-12f1eb463b54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:47.499551 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88a61842-e1a6-41cc-b4c2-12f1eb463b54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:47.501128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-88a61842-e1a6-41cc-b4c2-12f1eb463b54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:47.710192 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-88a61842-e1a6-41cc-b4c2-12f1eb463b54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:47.730787 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-88a61842-e1a6-41cc-b4c2-12f1eb463b54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:47.732329 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-88a61842-e1a6-41cc-b4c2-12f1eb463b54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:47.758104 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-88a61842-e1a6-41cc-b4c2-12f1eb463b54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.325618 Oct 10 18:56:47.773039 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 993/1799] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:47 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:47.799555 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0928c827-4f0a-45bd-b5ed-68e3c574b3cb tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:47.800504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0928c827-4f0a-45bd-b5ed-68e3c574b3cb tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:47.815993 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0928c827-4f0a-45bd-b5ed-68e3c574b3cb tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:47.817143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0928c827-4f0a-45bd-b5ed-68e3c574b3cb tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:47.820002 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0928c827-4f0a-45bd-b5ed-68e3c574b3cb tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:47.821181 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0928c827-4f0a-45bd-b5ed-68e3c574b3cb tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:47.825467 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0928c827-4f0a-45bd-b5ed-68e3c574b3cb tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:47.826138 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0928c827-4f0a-45bd-b5ed-68e3c574b3cb tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:48.107711 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0928c827-4f0a-45bd-b5ed-68e3c574b3cb tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:48.119125 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0928c827-4f0a-45bd-b5ed-68e3c574b3cb tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1315 microversion: 2.1 time: 0.344748 Oct 10 18:56:48.122730 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 994/1800] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:47 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:48.285991 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5b96b569-0246-47c2-a528-a126a9e24a64 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:48.291441 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5b96b569-0246-47c2-a528-a126a9e24a64 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:48.312835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b96b569-0246-47c2-a528-a126a9e24a64 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:48.313589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b96b569-0246-47c2-a528-a126a9e24a64 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:48.314293 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b96b569-0246-47c2-a528-a126a9e24a64 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:48.315434 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b96b569-0246-47c2-a528-a126a9e24a64 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:48.316249 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b96b569-0246-47c2-a528-a126a9e24a64 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:48.317253 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b96b569-0246-47c2-a528-a126a9e24a64 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:49.101497 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5b96b569-0246-47c2-a528-a126a9e24a64 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:49.111589 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5b96b569-0246-47c2-a528-a126a9e24a64 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.836306 Oct 10 18:56:49.118293 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 995/1801] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:48 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:49.134073 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e7762de2-7551-4fd4-8952-cda06a7d6bd5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:49.135090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e7762de2-7551-4fd4-8952-cda06a7d6bd5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:49.150884 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e7762de2-7551-4fd4-8952-cda06a7d6bd5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:49.151651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e7762de2-7551-4fd4-8952-cda06a7d6bd5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:49.152372 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e7762de2-7551-4fd4-8952-cda06a7d6bd5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:49.153543 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e7762de2-7551-4fd4-8952-cda06a7d6bd5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:49.154244 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e7762de2-7551-4fd4-8952-cda06a7d6bd5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:49.160088 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e7762de2-7551-4fd4-8952-cda06a7d6bd5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:49.478890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e7762de2-7551-4fd4-8952-cda06a7d6bd5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:49.486693 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:49.495530 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e7762de2-7551-4fd4-8952-cda06a7d6bd5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:49.507246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e7762de2-7551-4fd4-8952-cda06a7d6bd5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:49.518272 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e7762de2-7551-4fd4-8952-cda06a7d6bd5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.397571 Oct 10 18:56:49.519256 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 996/1802] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:49 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:49.564966 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6e4a7d73-93d1-4742-8749-b4005d1076a9 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:49.565854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6e4a7d73-93d1-4742-8749-b4005d1076a9 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:49.575493 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e4a7d73-93d1-4742-8749-b4005d1076a9 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:49.576054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e4a7d73-93d1-4742-8749-b4005d1076a9 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:49.576549 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e4a7d73-93d1-4742-8749-b4005d1076a9 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:49.577328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e4a7d73-93d1-4742-8749-b4005d1076a9 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:49.577823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e4a7d73-93d1-4742-8749-b4005d1076a9 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:49.578273 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e4a7d73-93d1-4742-8749-b4005d1076a9 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:50.148628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6e4a7d73-93d1-4742-8749-b4005d1076a9 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:50.162294 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6e4a7d73-93d1-4742-8749-b4005d1076a9 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1315 microversion: 2.1 time: 0.636352 Oct 10 18:56:50.162983 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 997/1803] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:49 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:50.183341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5dacdb3f-d718-4584-96e3-ebea9ee648a4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:50.183774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5dacdb3f-d718-4584-96e3-ebea9ee648a4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:50.203157 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dacdb3f-d718-4584-96e3-ebea9ee648a4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:50.203663 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dacdb3f-d718-4584-96e3-ebea9ee648a4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:50.216973 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dacdb3f-d718-4584-96e3-ebea9ee648a4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:50.217875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dacdb3f-d718-4584-96e3-ebea9ee648a4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:50.218391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dacdb3f-d718-4584-96e3-ebea9ee648a4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:50.218804 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dacdb3f-d718-4584-96e3-ebea9ee648a4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:50.494460 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5dacdb3f-d718-4584-96e3-ebea9ee648a4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:50.527962 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5dacdb3f-d718-4584-96e3-ebea9ee648a4 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.349311 Oct 10 18:56:50.529909 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 998/1804] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:50 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:50.561371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-423b6465-8f71-4801-a8f3-b30c699cc472 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:50.562108 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-423b6465-8f71-4801-a8f3-b30c699cc472 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:50.568339 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-423b6465-8f71-4801-a8f3-b30c699cc472 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:50.568979 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-423b6465-8f71-4801-a8f3-b30c699cc472 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:50.569718 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-423b6465-8f71-4801-a8f3-b30c699cc472 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:50.570655 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-423b6465-8f71-4801-a8f3-b30c699cc472 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:50.571257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-423b6465-8f71-4801-a8f3-b30c699cc472 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:50.571793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-423b6465-8f71-4801-a8f3-b30c699cc472 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:50.686034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-423b6465-8f71-4801-a8f3-b30c699cc472 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:50.703362 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-423b6465-8f71-4801-a8f3-b30c699cc472 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:50.705563 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-423b6465-8f71-4801-a8f3-b30c699cc472 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:50.725391 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-423b6465-8f71-4801-a8f3-b30c699cc472 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.167960 Oct 10 18:56:50.733249 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 999/1805] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:50 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:56:50.872774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:56:50.872774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:56:50.873718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:56:50.877400 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:56:50.879879 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:56:50.950651 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:50.952157 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:50.956588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:50.961177 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:50.962953 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:50.966576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:51.043587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Getting quotas for project 1267edbe51de42fbacc5c5d59c91e224. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:56:51.055975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Getting quotas for user 06d30b5629a7494db2b96ac955f6f385 and project 1267edbe51de42fbacc5c5d59c91e224. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:56:51.186103 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1ae832cf-1660-4c5e-a49f-2563310c7869 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:51.186672 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1ae832cf-1660-4c5e-a49f-2563310c7869 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:51.197895 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ae832cf-1660-4c5e-a49f-2563310c7869 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:51.201357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ae832cf-1660-4c5e-a49f-2563310c7869 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:51.203483 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ae832cf-1660-4c5e-a49f-2563310c7869 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:51.203483 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ae832cf-1660-4c5e-a49f-2563310c7869 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:51.208623 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ae832cf-1660-4c5e-a49f-2563310c7869 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:51.209141 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ae832cf-1660-4c5e-a49f-2563310c7869 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:51.430785 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:56:51.437047 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='bea576e3-d06d-4bf7-8dd4-f28ae3f9dc21',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a9b3f6b6-31c0-4ff4-8e6b-a387eb361b5d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71137d9b-3764-445e-9d48-1ec46a702a1a',volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:56:51.721040 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1ae832cf-1660-4c5e-a49f-2563310c7869 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:51.731599 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1ae832cf-1660-4c5e-a49f-2563310c7869 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1315 microversion: 2.1 time: 0.550034 Oct 10 18:56:51.752085 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1000/1806] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:51 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:51.776266 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-58c43cd7-7b23-4329-9360-74f841dcbd7e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:51.782984 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-58c43cd7-7b23-4329-9360-74f841dcbd7e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:51.810132 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-58c43cd7-7b23-4329-9360-74f841dcbd7e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:51.810630 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-58c43cd7-7b23-4329-9360-74f841dcbd7e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:51.817698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-58c43cd7-7b23-4329-9360-74f841dcbd7e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:51.818627 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-58c43cd7-7b23-4329-9360-74f841dcbd7e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:51.819109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-58c43cd7-7b23-4329-9360-74f841dcbd7e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:51.825748 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-58c43cd7-7b23-4329-9360-74f841dcbd7e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:52.050288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-58c43cd7-7b23-4329-9360-74f841dcbd7e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:52.061547 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-58c43cd7-7b23-4329-9360-74f841dcbd7e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.299133 Oct 10 18:56:52.070640 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1001/1807] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:51 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:52.094184 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d78364ef-01a9-4fca-87ea-1a1353f54fad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:52.094809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d78364ef-01a9-4fca-87ea-1a1353f54fad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:52.114690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d78364ef-01a9-4fca-87ea-1a1353f54fad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:52.115192 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d78364ef-01a9-4fca-87ea-1a1353f54fad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:52.115628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d78364ef-01a9-4fca-87ea-1a1353f54fad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:52.123955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d78364ef-01a9-4fca-87ea-1a1353f54fad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:52.124605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d78364ef-01a9-4fca-87ea-1a1353f54fad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:52.125362 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d78364ef-01a9-4fca-87ea-1a1353f54fad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:52.242485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d78364ef-01a9-4fca-87ea-1a1353f54fad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:52.259866 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d78364ef-01a9-4fca-87ea-1a1353f54fad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:52.271559 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d78364ef-01a9-4fca-87ea-1a1353f54fad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:52.293901 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d78364ef-01a9-4fca-87ea-1a1353f54fad tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.220786 Oct 10 18:56:52.309987 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1002/1808] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:52 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:52.760173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-96ba226d-f7c0-4c3d-b241-bb5d568c0611 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:52.761081 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-96ba226d-f7c0-4c3d-b241-bb5d568c0611 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:52.772159 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96ba226d-f7c0-4c3d-b241-bb5d568c0611 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:52.780797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96ba226d-f7c0-4c3d-b241-bb5d568c0611 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:52.782076 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96ba226d-f7c0-4c3d-b241-bb5d568c0611 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:52.782076 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96ba226d-f7c0-4c3d-b241-bb5d568c0611 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:52.782766 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96ba226d-f7c0-4c3d-b241-bb5d568c0611 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:52.783197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96ba226d-f7c0-4c3d-b241-bb5d568c0611 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:52.934817 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8d01c8c8-e8c6-4cca-8a98-06ff796135fc tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 13.427193 Oct 10 18:56:52.936421 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 807/1809] 10.222.0.43 () {62 vars in 1189 bytes} [Mon Oct 10 18:56:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 13430 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 18:56:52.965681 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8c17f308-916b-4fc9-ad99-d50aea209730 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:52.967108 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8c17f308-916b-4fc9-ad99-d50aea209730 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:53.108449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8c17f308-916b-4fc9-ad99-d50aea209730 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:53.157708 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8c17f308-916b-4fc9-ad99-d50aea209730 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:53.168038 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8c17f308-916b-4fc9-ad99-d50aea209730 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:53.172834 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8c17f308-916b-4fc9-ad99-d50aea209730 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1286 microversion: 2.42 time: 0.227342 Oct 10 18:56:53.187648 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 808/1810] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:52 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1286 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:53.188323 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-91b5589f-c34d-493d-815b-10359c521857 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:53.188473 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-91b5589f-c34d-493d-815b-10359c521857 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:53.201499 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91b5589f-c34d-493d-815b-10359c521857 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:53.202446 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91b5589f-c34d-493d-815b-10359c521857 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:53.202892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91b5589f-c34d-493d-815b-10359c521857 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:53.203612 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91b5589f-c34d-493d-815b-10359c521857 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:53.204073 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91b5589f-c34d-493d-815b-10359c521857 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:53.204766 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91b5589f-c34d-493d-815b-10359c521857 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:53.342463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-96ba226d-f7c0-4c3d-b241-bb5d568c0611 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:53.351252 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-96ba226d-f7c0-4c3d-b241-bb5d568c0611 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1315 microversion: 2.1 time: 0.596592 Oct 10 18:56:53.376525 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1003/1811] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:52 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:53.394899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ef08fcfd-d07b-402b-9ccd-ae004c2490b6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:53.397489 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ef08fcfd-d07b-402b-9ccd-ae004c2490b6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:53.435547 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ef08fcfd-d07b-402b-9ccd-ae004c2490b6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:53.440073 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ef08fcfd-d07b-402b-9ccd-ae004c2490b6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:53.447723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ef08fcfd-d07b-402b-9ccd-ae004c2490b6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:53.447723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ef08fcfd-d07b-402b-9ccd-ae004c2490b6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:53.451580 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ef08fcfd-d07b-402b-9ccd-ae004c2490b6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:53.453764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ef08fcfd-d07b-402b-9ccd-ae004c2490b6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:53.625160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ef08fcfd-d07b-402b-9ccd-ae004c2490b6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:53.639330 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ef08fcfd-d07b-402b-9ccd-ae004c2490b6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:53.641146 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ef08fcfd-d07b-402b-9ccd-ae004c2490b6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:53.648488 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ef08fcfd-d07b-402b-9ccd-ae004c2490b6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.268588 Oct 10 18:56:53.651441 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1004/1812] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:53 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:53.837996 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-91b5589f-c34d-493d-815b-10359c521857 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:53.852199 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-91b5589f-c34d-493d-815b-10359c521857 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1525 microversion: 2.1 time: 0.671031 Oct 10 18:56:53.853209 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 809/1813] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:53 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1525 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:54.187090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-ab0e653f-d147-47b2-80a3-3b4d1e18cc48 req-0bc96242-6d37-475a-bc20-8a1c90525630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4204cf-67d2-46c7-9f84-605cb9262f2a", "name": "network-vif-plugged", "status": "completed", "tag": "526f93eb-13b0-4787-89ca-0fcf9f4f7082"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:54.202960 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4e09e292-9c41-4044-8c27-7b4e6c7dd9b1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:54.204411 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4e09e292-9c41-4044-8c27-7b4e6c7dd9b1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:54.225142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-ab0e653f-d147-47b2-80a3-3b4d1e18cc48 req-0bc96242-6d37-475a-bc20-8a1c90525630 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:54.225624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-ab0e653f-d147-47b2-80a3-3b4d1e18cc48 req-0bc96242-6d37-475a-bc20-8a1c90525630 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:54.226077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-ab0e653f-d147-47b2-80a3-3b4d1e18cc48 req-0bc96242-6d37-475a-bc20-8a1c90525630 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:54.273748 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-ab0e653f-d147-47b2-80a3-3b4d1e18cc48 req-0bc96242-6d37-475a-bc20-8a1c90525630 service nova] Creating event network-vif-plugged:526f93eb-13b0-4787-89ca-0fcf9f4f7082 for instance be4204cf-67d2-46c7-9f84-605cb9262f2a on n-h2-860863-1 Oct 10 18:56:54.286768 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-ab0e653f-d147-47b2-80a3-3b4d1e18cc48 req-0bc96242-6d37-475a-bc20-8a1c90525630 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100888 Oct 10 18:56:54.287908 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1005/1814] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:54.379279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-01eab6c3-6235-41bf-b22e-dd28f2e23c60 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:54.381449 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-01eab6c3-6235-41bf-b22e-dd28f2e23c60 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:54.388165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01eab6c3-6235-41bf-b22e-dd28f2e23c60 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:54.393034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01eab6c3-6235-41bf-b22e-dd28f2e23c60 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:54.393857 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01eab6c3-6235-41bf-b22e-dd28f2e23c60 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:54.394842 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01eab6c3-6235-41bf-b22e-dd28f2e23c60 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:54.397918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01eab6c3-6235-41bf-b22e-dd28f2e23c60 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:54.398696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-01eab6c3-6235-41bf-b22e-dd28f2e23c60 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:54.411726 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4e09e292-9c41-4044-8c27-7b4e6c7dd9b1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:54.436128 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4e09e292-9c41-4044-8c27-7b4e6c7dd9b1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:54.446138 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4e09e292-9c41-4044-8c27-7b4e6c7dd9b1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:54.450300 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4e09e292-9c41-4044-8c27-7b4e6c7dd9b1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1286 microversion: 2.42 time: 0.248732 Oct 10 18:56:54.450300 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 810/1815] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:54 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1286 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:54.681678 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d3a6dfec-fa3f-4d84-9ec4-0861b8ec722c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:54.682713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d3a6dfec-fa3f-4d84-9ec4-0861b8ec722c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:54.690320 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3a6dfec-fa3f-4d84-9ec4-0861b8ec722c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:54.691231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3a6dfec-fa3f-4d84-9ec4-0861b8ec722c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:54.693352 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3a6dfec-fa3f-4d84-9ec4-0861b8ec722c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:54.694367 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3a6dfec-fa3f-4d84-9ec4-0861b8ec722c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:54.696845 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3a6dfec-fa3f-4d84-9ec4-0861b8ec722c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:54.697587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3a6dfec-fa3f-4d84-9ec4-0861b8ec722c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:54.885427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-01eab6c3-6235-41bf-b22e-dd28f2e23c60 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:54.897190 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-01eab6c3-6235-41bf-b22e-dd28f2e23c60 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1315 microversion: 2.1 time: 0.521116 Oct 10 18:56:54.898361 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1006/1816] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:54 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:56:54.929667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-05525fdc-3e71-4f73-b450-874a5c9fc36a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:54.929667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-05525fdc-3e71-4f73-b450-874a5c9fc36a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:54.938408 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-05525fdc-3e71-4f73-b450-874a5c9fc36a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:54.939722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-05525fdc-3e71-4f73-b450-874a5c9fc36a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:54.940403 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-05525fdc-3e71-4f73-b450-874a5c9fc36a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:54.943876 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-05525fdc-3e71-4f73-b450-874a5c9fc36a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:54.944795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-05525fdc-3e71-4f73-b450-874a5c9fc36a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:54.946226 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-05525fdc-3e71-4f73-b450-874a5c9fc36a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:55.263021 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d3a6dfec-fa3f-4d84-9ec4-0861b8ec722c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:55.309426 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d3a6dfec-fa3f-4d84-9ec4-0861b8ec722c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:55.312318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d3a6dfec-fa3f-4d84-9ec4-0861b8ec722c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:55.328740 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d3a6dfec-fa3f-4d84-9ec4-0861b8ec722c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.648499 Oct 10 18:56:55.329504 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 811/1817] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:54 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:55.444154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-05525fdc-3e71-4f73-b450-874a5c9fc36a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:55.457341 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-05525fdc-3e71-4f73-b450-874a5c9fc36a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1507 microversion: 2.1 time: 0.545424 Oct 10 18:56:55.465797 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1007/1818] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:54 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1507 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:55.479498 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3bd038a1-f703-43ab-a778-7579d5bc428b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:55.482140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3bd038a1-f703-43ab-a778-7579d5bc428b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:55.819913 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3bd038a1-f703-43ab-a778-7579d5bc428b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:55.829166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3bd038a1-f703-43ab-a778-7579d5bc428b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:55.835209 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3bd038a1-f703-43ab-a778-7579d5bc428b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:55.845964 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3bd038a1-f703-43ab-a778-7579d5bc428b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1286 microversion: 2.42 time: 0.366915 Oct 10 18:56:55.847372 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 812/1819] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:55 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1286 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:55.928878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-223fa538-33b7-4ac2-aed0-29aff04d6cfe tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:55.929772 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-223fa538-33b7-4ac2-aed0-29aff04d6cfe tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:55.946446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-223fa538-33b7-4ac2-aed0-29aff04d6cfe tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:55.947389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-223fa538-33b7-4ac2-aed0-29aff04d6cfe tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:55.948077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-223fa538-33b7-4ac2-aed0-29aff04d6cfe tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:55.949496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-223fa538-33b7-4ac2-aed0-29aff04d6cfe tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:55.950169 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-223fa538-33b7-4ac2-aed0-29aff04d6cfe tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:55.950800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-223fa538-33b7-4ac2-aed0-29aff04d6cfe tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:56.253935 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-223fa538-33b7-4ac2-aed0-29aff04d6cfe tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:56.263463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:56:56.281206 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-223fa538-33b7-4ac2-aed0-29aff04d6cfe tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1315 microversion: 2.1 time: 0.358699 Oct 10 18:56:56.283352 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1008/1820] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:55 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:56.368389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-06f7d4ec-8cbd-42c9-8749-b11f67a236de tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:56.369033 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-06f7d4ec-8cbd-42c9-8749-b11f67a236de tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:56.391315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-06f7d4ec-8cbd-42c9-8749-b11f67a236de tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:56.395380 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-06f7d4ec-8cbd-42c9-8749-b11f67a236de tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:56.397403 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-06f7d4ec-8cbd-42c9-8749-b11f67a236de tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:56.400252 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-06f7d4ec-8cbd-42c9-8749-b11f67a236de tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:56.401223 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-06f7d4ec-8cbd-42c9-8749-b11f67a236de tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:56.402869 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-06f7d4ec-8cbd-42c9-8749-b11f67a236de tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:56.499549 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-96da9cf9-c6d9-4c8b-8c56-c468dcfd9b6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:56.501168 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-96da9cf9-c6d9-4c8b-8c56-c468dcfd9b6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:56.523096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96da9cf9-c6d9-4c8b-8c56-c468dcfd9b6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:56.524905 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96da9cf9-c6d9-4c8b-8c56-c468dcfd9b6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:56.525611 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96da9cf9-c6d9-4c8b-8c56-c468dcfd9b6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:56.527461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96da9cf9-c6d9-4c8b-8c56-c468dcfd9b6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:56.529351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96da9cf9-c6d9-4c8b-8c56-c468dcfd9b6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:56.530453 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96da9cf9-c6d9-4c8b-8c56-c468dcfd9b6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:56.727307 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-06f7d4ec-8cbd-42c9-8749-b11f67a236de tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:56.735779 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-06f7d4ec-8cbd-42c9-8749-b11f67a236de tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:56.741561 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-06f7d4ec-8cbd-42c9-8749-b11f67a236de tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:56.756070 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-06f7d4ec-8cbd-42c9-8749-b11f67a236de tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.395303 Oct 10 18:56:56.757265 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 813/1821] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:56 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:56.840655 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-96da9cf9-c6d9-4c8b-8c56-c468dcfd9b6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:56.852841 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-96da9cf9-c6d9-4c8b-8c56-c468dcfd9b6a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1507 microversion: 2.1 time: 0.362042 Oct 10 18:56:56.856824 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1009/1822] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:56 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:56.890419 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f774e699-2cf5-4736-ab8a-3a9f293a58e9 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:56.894998 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f774e699-2cf5-4736-ab8a-3a9f293a58e9 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:57.251336 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f774e699-2cf5-4736-ab8a-3a9f293a58e9 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:57.256342 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f774e699-2cf5-4736-ab8a-3a9f293a58e9 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:57.258076 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f774e699-2cf5-4736-ab8a-3a9f293a58e9 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:57.259552 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f774e699-2cf5-4736-ab8a-3a9f293a58e9 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1286 microversion: 2.42 time: 0.384727 Oct 10 18:56:57.280587 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 814/1823] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:56 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1286 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:57.318198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3c3c8837-6dcf-4d27-ad37-02601e6eba79 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:57.319078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3c3c8837-6dcf-4d27-ad37-02601e6eba79 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:57.332349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-e94aa61c-3a54-4e73-9433-ea8fb78f7663 req-97bf9ef0-099c-451f-8a45-7b78e2a768f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab18d87-5b5b-4d03-a0c0-a07a998f411b", "name": "network-vif-unplugged", "status": "completed", "tag": "64f367b9-222a-4fe3-919b-80f6bdc5452d"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:56:57.348258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c3c8837-6dcf-4d27-ad37-02601e6eba79 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:57.351302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c3c8837-6dcf-4d27-ad37-02601e6eba79 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:57.351769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c3c8837-6dcf-4d27-ad37-02601e6eba79 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:57.353124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c3c8837-6dcf-4d27-ad37-02601e6eba79 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:57.357163 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c3c8837-6dcf-4d27-ad37-02601e6eba79 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:57.358446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c3c8837-6dcf-4d27-ad37-02601e6eba79 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:57.369672 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e94aa61c-3a54-4e73-9433-ea8fb78f7663 req-97bf9ef0-099c-451f-8a45-7b78e2a768f8 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:57.370312 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e94aa61c-3a54-4e73-9433-ea8fb78f7663 req-97bf9ef0-099c-451f-8a45-7b78e2a768f8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:57.370550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e94aa61c-3a54-4e73-9433-ea8fb78f7663 req-97bf9ef0-099c-451f-8a45-7b78e2a768f8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:57.386872 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-e94aa61c-3a54-4e73-9433-ea8fb78f7663 req-97bf9ef0-099c-451f-8a45-7b78e2a768f8 service nova] Creating event network-vif-unplugged:64f367b9-222a-4fe3-919b-80f6bdc5452d for instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b on n-h2-860863-1 Oct 10 18:56:57.395597 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-e94aa61c-3a54-4e73-9433-ea8fb78f7663 req-97bf9ef0-099c-451f-8a45-7b78e2a768f8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068327 Oct 10 18:56:57.397393 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 815/1824] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:56:57.789031 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b7372cd8-ffde-4bcf-9616-e8e0c0cdb995 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:57.789789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b7372cd8-ffde-4bcf-9616-e8e0c0cdb995 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:57.801146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b7372cd8-ffde-4bcf-9616-e8e0c0cdb995 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:57.802031 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b7372cd8-ffde-4bcf-9616-e8e0c0cdb995 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:57.802945 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b7372cd8-ffde-4bcf-9616-e8e0c0cdb995 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:57.804045 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b7372cd8-ffde-4bcf-9616-e8e0c0cdb995 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:57.804792 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b7372cd8-ffde-4bcf-9616-e8e0c0cdb995 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:57.805635 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b7372cd8-ffde-4bcf-9616-e8e0c0cdb995 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:57.830875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3c3c8837-6dcf-4d27-ad37-02601e6eba79 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:57.844276 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3c3c8837-6dcf-4d27-ad37-02601e6eba79 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1504 microversion: 2.1 time: 0.528699 Oct 10 18:56:57.845174 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1010/1825] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:57 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1504 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:57.868388 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-443e30fa-f07d-46dd-9721-059205f190d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:57.870281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-443e30fa-f07d-46dd-9721-059205f190d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:57.882712 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-443e30fa-f07d-46dd-9721-059205f190d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:57.884078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-443e30fa-f07d-46dd-9721-059205f190d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:57.884774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-443e30fa-f07d-46dd-9721-059205f190d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:57.890504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-443e30fa-f07d-46dd-9721-059205f190d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:57.892784 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-443e30fa-f07d-46dd-9721-059205f190d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:57.894248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-443e30fa-f07d-46dd-9721-059205f190d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:57.975389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-443e30fa-f07d-46dd-9721-059205f190d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:56:58.069753 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b7372cd8-ffde-4bcf-9616-e8e0c0cdb995 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:58.097472 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b7372cd8-ffde-4bcf-9616-e8e0c0cdb995 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:58.111851 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b7372cd8-ffde-4bcf-9616-e8e0c0cdb995 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:58.133872 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b7372cd8-ffde-4bcf-9616-e8e0c0cdb995 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.343332 Oct 10 18:56:58.140761 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 816/1826] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:57 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:56:58.157092 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bb3b4fb1-0821-4d3b-8c57-e2686489c968 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:58.158480 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bb3b4fb1-0821-4d3b-8c57-e2686489c968 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:58.168598 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb3b4fb1-0821-4d3b-8c57-e2686489c968 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:58.177056 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb3b4fb1-0821-4d3b-8c57-e2686489c968 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:58.182487 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb3b4fb1-0821-4d3b-8c57-e2686489c968 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:58.184157 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb3b4fb1-0821-4d3b-8c57-e2686489c968 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:58.185283 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb3b4fb1-0821-4d3b-8c57-e2686489c968 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:58.187656 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bb3b4fb1-0821-4d3b-8c57-e2686489c968 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:58.366917 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-443e30fa-f07d-46dd-9721-059205f190d7 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "DELETE /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 204 len: 0 microversion: 2.1 time: 0.502320 Oct 10 18:56:58.373146 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1011/1827] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:56:57 2022] DELETE /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:56:58.379545 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-46904e90-bd84-4bb3-a5a7-267f4fd7e66a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:58.381766 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-46904e90-bd84-4bb3-a5a7-267f4fd7e66a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:58.390723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-46904e90-bd84-4bb3-a5a7-267f4fd7e66a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:58.391564 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-46904e90-bd84-4bb3-a5a7-267f4fd7e66a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:58.392247 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-46904e90-bd84-4bb3-a5a7-267f4fd7e66a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:58.393379 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-46904e90-bd84-4bb3-a5a7-267f4fd7e66a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:58.425374 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-46904e90-bd84-4bb3-a5a7-267f4fd7e66a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:58.426282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-46904e90-bd84-4bb3-a5a7-267f4fd7e66a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:58.755967 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-46904e90-bd84-4bb3-a5a7-267f4fd7e66a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:58.765756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-46904e90-bd84-4bb3-a5a7-267f4fd7e66a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:58.767202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-46904e90-bd84-4bb3-a5a7-267f4fd7e66a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:58.772742 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-46904e90-bd84-4bb3-a5a7-267f4fd7e66a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1576 microversion: 2.42 time: 0.398780 Oct 10 18:56:58.773353 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1012/1828] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:58 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1576 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:58.784154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-79477358-de87-4ca0-82f5-24311b777f87 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:58.785311 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-79477358-de87-4ca0-82f5-24311b777f87 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:58.795976 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79477358-de87-4ca0-82f5-24311b777f87 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:58.796974 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79477358-de87-4ca0-82f5-24311b777f87 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:58.797588 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79477358-de87-4ca0-82f5-24311b777f87 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:58.798949 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79477358-de87-4ca0-82f5-24311b777f87 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:58.799411 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79477358-de87-4ca0-82f5-24311b777f87 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:58.799840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79477358-de87-4ca0-82f5-24311b777f87 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:58.904006 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bb3b4fb1-0821-4d3b-8c57-e2686489c968 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:58.918638 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bb3b4fb1-0821-4d3b-8c57-e2686489c968 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1507 microversion: 2.1 time: 0.775403 Oct 10 18:56:58.921650 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 817/1829] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:58 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1507 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:59.124274 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-79477358-de87-4ca0-82f5-24311b777f87 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:59.149345 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-79477358-de87-4ca0-82f5-24311b777f87 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1510 microversion: 2.1 time: 0.370828 Oct 10 18:56:59.151689 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1013/1830] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:58 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1510 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:56:59.173418 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-708d8869-3df9-44f8-92b0-94a1aaf5bea4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:59.174074 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-708d8869-3df9-44f8-92b0-94a1aaf5bea4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:59.191427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-708d8869-3df9-44f8-92b0-94a1aaf5bea4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:59.195377 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-708d8869-3df9-44f8-92b0-94a1aaf5bea4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:59.197247 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-708d8869-3df9-44f8-92b0-94a1aaf5bea4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:59.198248 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-708d8869-3df9-44f8-92b0-94a1aaf5bea4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:59.200031 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-708d8869-3df9-44f8-92b0-94a1aaf5bea4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:59.201919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-708d8869-3df9-44f8-92b0-94a1aaf5bea4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:59.463880 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-708d8869-3df9-44f8-92b0-94a1aaf5bea4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:59.478787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-708d8869-3df9-44f8-92b0-94a1aaf5bea4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:59.480845 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-708d8869-3df9-44f8-92b0-94a1aaf5bea4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:56:59.514803 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-708d8869-3df9-44f8-92b0-94a1aaf5bea4 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.323836 Oct 10 18:56:59.517843 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 818/1831] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:59 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:56:59.825609 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-139f887e-c43d-458e-9b37-24cf04a79b18 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:59.826465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-139f887e-c43d-458e-9b37-24cf04a79b18 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:59.844376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-139f887e-c43d-458e-9b37-24cf04a79b18 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:59.847875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-139f887e-c43d-458e-9b37-24cf04a79b18 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:59.850596 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-139f887e-c43d-458e-9b37-24cf04a79b18 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:59.851687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-139f887e-c43d-458e-9b37-24cf04a79b18 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:59.854941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-139f887e-c43d-458e-9b37-24cf04a79b18 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:59.855823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-139f887e-c43d-458e-9b37-24cf04a79b18 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:59.949833 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-90099a2d-1a29-4e6a-ae4c-4bebac95ceee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:56:59.953548 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-90099a2d-1a29-4e6a-ae4c-4bebac95ceee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:56:59.968772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90099a2d-1a29-4e6a-ae4c-4bebac95ceee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:59.969363 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90099a2d-1a29-4e6a-ae4c-4bebac95ceee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:59.969882 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90099a2d-1a29-4e6a-ae4c-4bebac95ceee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:56:59.970621 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90099a2d-1a29-4e6a-ae4c-4bebac95ceee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:56:59.971078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90099a2d-1a29-4e6a-ae4c-4bebac95ceee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:56:59.980921 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-90099a2d-1a29-4e6a-ae4c-4bebac95ceee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:00.124444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-139f887e-c43d-458e-9b37-24cf04a79b18 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:00.145698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-139f887e-c43d-458e-9b37-24cf04a79b18 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:00.145698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-139f887e-c43d-458e-9b37-24cf04a79b18 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:00.145698 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-139f887e-c43d-458e-9b37-24cf04a79b18 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1584 microversion: 2.42 time: 0.329333 Oct 10 18:57:00.159733 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1014/1832] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:56:59 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1584 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:00.184238 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9133142b-df22-47a5-90df-ee600e3f3058 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:00.187111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9133142b-df22-47a5-90df-ee600e3f3058 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:00.219794 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9133142b-df22-47a5-90df-ee600e3f3058 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:00.224953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9133142b-df22-47a5-90df-ee600e3f3058 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:00.225406 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9133142b-df22-47a5-90df-ee600e3f3058 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:00.233619 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9133142b-df22-47a5-90df-ee600e3f3058 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:00.234131 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9133142b-df22-47a5-90df-ee600e3f3058 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:00.238725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9133142b-df22-47a5-90df-ee600e3f3058 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:00.639349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-90099a2d-1a29-4e6a-ae4c-4bebac95ceee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:00.668971 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-90099a2d-1a29-4e6a-ae4c-4bebac95ceee tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1507 microversion: 2.1 time: 0.722467 Oct 10 18:57:00.672321 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 819/1833] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:56:59 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1507 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:00.686350 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5675bd42-4857-4c65-b4d9-55a197f7fe2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:00.688241 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5675bd42-4857-4c65-b4d9-55a197f7fe2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:00.707219 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5675bd42-4857-4c65-b4d9-55a197f7fe2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:00.712022 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5675bd42-4857-4c65-b4d9-55a197f7fe2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:00.712555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5675bd42-4857-4c65-b4d9-55a197f7fe2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:00.716173 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5675bd42-4857-4c65-b4d9-55a197f7fe2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:00.720413 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5675bd42-4857-4c65-b4d9-55a197f7fe2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:00.721183 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5675bd42-4857-4c65-b4d9-55a197f7fe2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:00.856890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9133142b-df22-47a5-90df-ee600e3f3058 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:00.887600 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9133142b-df22-47a5-90df-ee600e3f3058 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1510 microversion: 2.1 time: 0.699846 Oct 10 18:57:00.898524 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5675bd42-4857-4c65-b4d9-55a197f7fe2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:00.905273 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1015/1834] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:00 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1510 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:57:00.931324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5675bd42-4857-4c65-b4d9-55a197f7fe2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:00.935212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5675bd42-4857-4c65-b4d9-55a197f7fe2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:00.952003 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5675bd42-4857-4c65-b4d9-55a197f7fe2d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.277998 Oct 10 18:57:00.970685 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 820/1835] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:00 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:01.173272 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3890d6b0-acba-4fa6-b546-9b36d9fc4b1d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:01.175078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3890d6b0-acba-4fa6-b546-9b36d9fc4b1d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:01.189995 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3890d6b0-acba-4fa6-b546-9b36d9fc4b1d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:01.190498 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3890d6b0-acba-4fa6-b546-9b36d9fc4b1d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:01.195456 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3890d6b0-acba-4fa6-b546-9b36d9fc4b1d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:01.209033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3890d6b0-acba-4fa6-b546-9b36d9fc4b1d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:01.209634 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3890d6b0-acba-4fa6-b546-9b36d9fc4b1d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:01.210092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3890d6b0-acba-4fa6-b546-9b36d9fc4b1d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:01.384569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3890d6b0-acba-4fa6-b546-9b36d9fc4b1d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:01.403326 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3890d6b0-acba-4fa6-b546-9b36d9fc4b1d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:01.405012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3890d6b0-acba-4fa6-b546-9b36d9fc4b1d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:01.410273 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3890d6b0-acba-4fa6-b546-9b36d9fc4b1d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1594 microversion: 2.42 time: 0.242480 Oct 10 18:57:01.410870 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1016/1836] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:01 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1594 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:01.699003 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a7df48f4-c8d5-4e5d-8b9c-77811fe13d35 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:01.699707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a7df48f4-c8d5-4e5d-8b9c-77811fe13d35 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:01.716103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:01.720807 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7df48f4-c8d5-4e5d-8b9c-77811fe13d35 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:01.722361 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7df48f4-c8d5-4e5d-8b9c-77811fe13d35 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:01.722911 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7df48f4-c8d5-4e5d-8b9c-77811fe13d35 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:01.729334 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7df48f4-c8d5-4e5d-8b9c-77811fe13d35 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:01.730306 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7df48f4-c8d5-4e5d-8b9c-77811fe13d35 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:01.733527 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a7df48f4-c8d5-4e5d-8b9c-77811fe13d35 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:01.918000 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e966ca60-cdc2-4b8e-860e-c23e22f26724 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:01.918909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e966ca60-cdc2-4b8e-860e-c23e22f26724 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:01.930713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e966ca60-cdc2-4b8e-860e-c23e22f26724 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:01.931210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e966ca60-cdc2-4b8e-860e-c23e22f26724 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:01.931682 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e966ca60-cdc2-4b8e-860e-c23e22f26724 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:01.932347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e966ca60-cdc2-4b8e-860e-c23e22f26724 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:01.940484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e966ca60-cdc2-4b8e-860e-c23e22f26724 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:01.946374 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e966ca60-cdc2-4b8e-860e-c23e22f26724 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:02.144293 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e966ca60-cdc2-4b8e-860e-c23e22f26724 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:02.166825 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e966ca60-cdc2-4b8e-860e-c23e22f26724 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1468 microversion: 2.1 time: 0.253136 Oct 10 18:57:02.175089 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1017/1837] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:01 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1468 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:02.192857 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e73ef5c5-6d18-4ff9-9975-b69014e88af0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:02.197690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e73ef5c5-6d18-4ff9-9975-b69014e88af0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:02.214578 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e73ef5c5-6d18-4ff9-9975-b69014e88af0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:02.217733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e73ef5c5-6d18-4ff9-9975-b69014e88af0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:02.218440 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e73ef5c5-6d18-4ff9-9975-b69014e88af0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:02.221144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e73ef5c5-6d18-4ff9-9975-b69014e88af0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:02.224703 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e73ef5c5-6d18-4ff9-9975-b69014e88af0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:02.225899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e73ef5c5-6d18-4ff9-9975-b69014e88af0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:02.420216 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e73ef5c5-6d18-4ff9-9975-b69014e88af0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:02.433007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e73ef5c5-6d18-4ff9-9975-b69014e88af0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:02.438735 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e73ef5c5-6d18-4ff9-9975-b69014e88af0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:02.453677 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e73ef5c5-6d18-4ff9-9975-b69014e88af0 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.274827 Oct 10 18:57:02.455161 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1018/1838] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:02 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:02.464083 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b3646c2c-f07e-4ac2-85ac-c6b32a8d6536 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:02.469833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b3646c2c-f07e-4ac2-85ac-c6b32a8d6536 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:02.486254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3646c2c-f07e-4ac2-85ac-c6b32a8d6536 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:02.490019 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3646c2c-f07e-4ac2-85ac-c6b32a8d6536 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:02.490691 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3646c2c-f07e-4ac2-85ac-c6b32a8d6536 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:02.491432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3646c2c-f07e-4ac2-85ac-c6b32a8d6536 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:02.491883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3646c2c-f07e-4ac2-85ac-c6b32a8d6536 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:02.492311 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3646c2c-f07e-4ac2-85ac-c6b32a8d6536 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:02.647270 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a7df48f4-c8d5-4e5d-8b9c-77811fe13d35 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:02.663045 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a7df48f4-c8d5-4e5d-8b9c-77811fe13d35 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 200 len: 1510 microversion: 2.1 time: 0.969630 Oct 10 18:57:02.670919 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 821/1839] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:01 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 1510 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:02.703368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:02.703368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:02.721336 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:02.723526 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:02.724146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:02.734675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:02.738004 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:02.738801 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:02.829107 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:57:02.844760 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.compute.api [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Working on deleting snapshot dcfd5d00-5107-4f2c-a6b4-89e13b404f0f from shelved instance... Oct 10 18:57:03.991224 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b3646c2c-f07e-4ac2-85ac-c6b32a8d6536 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:04.005560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b3646c2c-f07e-4ac2-85ac-c6b32a8d6536 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:04.007578 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b3646c2c-f07e-4ac2-85ac-c6b32a8d6536 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:04.010288 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b3646c2c-f07e-4ac2-85ac-c6b32a8d6536 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1661 microversion: 2.42 time: 1.553911 Oct 10 18:57:04.011353 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1019/1840] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:02 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1661 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:04.016829 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-c2d1d80c-0d05-4cf6-8a8f-63d2bef8bb05 req-0d72899d-a9ba-498f-9942-98aa49eb58f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4204cf-67d2-46c7-9f84-605cb9262f2a", "name": "network-vif-deleted", "tag": "526f93eb-13b0-4787-89ca-0fcf9f4f7082"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:04.037961 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:04.050985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c2d1d80c-0d05-4cf6-8a8f-63d2bef8bb05 req-0d72899d-a9ba-498f-9942-98aa49eb58f6 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:04.052989 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c2d1d80c-0d05-4cf6-8a8f-63d2bef8bb05 req-0d72899d-a9ba-498f-9942-98aa49eb58f6 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:04.054130 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c2d1d80c-0d05-4cf6-8a8f-63d2bef8bb05 req-0d72899d-a9ba-498f-9942-98aa49eb58f6 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:04.076331 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-c2d1d80c-0d05-4cf6-8a8f-63d2bef8bb05 req-0d72899d-a9ba-498f-9942-98aa49eb58f6 service nova] Creating event network-vif-deleted:526f93eb-13b0-4787-89ca-0fcf9f4f7082 for instance be4204cf-67d2-46c7-9f84-605cb9262f2a on n-h2-860863-1 Oct 10 18:57:04.083173 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-c2d1d80c-0d05-4cf6-8a8f-63d2bef8bb05 req-0d72899d-a9ba-498f-9942-98aa49eb58f6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070090 Oct 10 18:57:04.084613 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1020/1841] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:04.104660 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-08000dc7-5a3a-4904-901b-d168a663c317 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:04.106957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-08000dc7-5a3a-4904-901b-d168a663c317 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:04.119488 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08000dc7-5a3a-4904-901b-d168a663c317 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:04.125734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08000dc7-5a3a-4904-901b-d168a663c317 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:04.125734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08000dc7-5a3a-4904-901b-d168a663c317 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:04.125734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08000dc7-5a3a-4904-901b-d168a663c317 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:04.125734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08000dc7-5a3a-4904-901b-d168a663c317 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:04.125734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08000dc7-5a3a-4904-901b-d168a663c317 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:04.176569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08000dc7-5a3a-4904-901b-d168a663c317 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:04.177897 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08000dc7-5a3a-4904-901b-d168a663c317 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:04.179191 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08000dc7-5a3a-4904-901b-d168a663c317 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:04.180732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-08000dc7-5a3a-4904-901b-d168a663c317 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lazy-loading 'fault' on Instance uuid be4204cf-67d2-46c7-9f84-605cb9262f2a {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:57:04.373939 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-08000dc7-5a3a-4904-901b-d168a663c317 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52edf1eb44d34155be5e71cdda6bf46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf3279c60d14e43bd109bc171698b7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:04.388656 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-08000dc7-5a3a-4904-901b-d168a663c317 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 200 len: 1305 microversion: 2.1 time: 0.292006 Oct 10 18:57:04.392218 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1021/1842] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:04 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 1305 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:04.404400 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8d8cc702-24da-486e-bf94-ae45093d5dc3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:04.405049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8d8cc702-24da-486e-bf94-ae45093d5dc3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:04.420998 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d8cc702-24da-486e-bf94-ae45093d5dc3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:04.421466 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d8cc702-24da-486e-bf94-ae45093d5dc3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:04.426253 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d8cc702-24da-486e-bf94-ae45093d5dc3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:04.427758 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d8cc702-24da-486e-bf94-ae45093d5dc3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:04.428232 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d8cc702-24da-486e-bf94-ae45093d5dc3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:04.428717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d8cc702-24da-486e-bf94-ae45093d5dc3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:04.815674 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8d8cc702-24da-486e-bf94-ae45093d5dc3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:04.831236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8d8cc702-24da-486e-bf94-ae45093d5dc3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:04.838966 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8d8cc702-24da-486e-bf94-ae45093d5dc3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:04.866575 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8d8cc702-24da-486e-bf94-ae45093d5dc3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.470021 Oct 10 18:57:04.867222 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1022/1843] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:04 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:05.042263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5d3098b0-3f5a-4fa5-bcd2-39491eaf6c66 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:05.046219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5d3098b0-3f5a-4fa5-bcd2-39491eaf6c66 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:05.055414 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d3098b0-3f5a-4fa5-bcd2-39491eaf6c66 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:05.055907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d3098b0-3f5a-4fa5-bcd2-39491eaf6c66 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:05.056337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d3098b0-3f5a-4fa5-bcd2-39491eaf6c66 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:05.057088 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d3098b0-3f5a-4fa5-bcd2-39491eaf6c66 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:05.072833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d3098b0-3f5a-4fa5-bcd2-39491eaf6c66 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:05.074058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5d3098b0-3f5a-4fa5-bcd2-39491eaf6c66 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:05.217713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:05.219975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Doing local delete in cell 1649e55c-2282-4aa8-b943-d6661d4bffa2(cell1) {{(pid=127289) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 10 18:57:05.221280 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:05.224067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:05.225394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:05.227860 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.compute.api [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 10 18:57:05.240185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] deallocate_for_instance() {{(pid=127289) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 10 18:57:05.675310 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5d3098b0-3f5a-4fa5-bcd2-39491eaf6c66 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:05.697561 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5d3098b0-3f5a-4fa5-bcd2-39491eaf6c66 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:05.708150 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5d3098b0-3f5a-4fa5-bcd2-39491eaf6c66 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:05.711028 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5d3098b0-3f5a-4fa5-bcd2-39491eaf6c66 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1661 microversion: 2.42 time: 0.673752 Oct 10 18:57:05.727112 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1023/1844] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:05 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1661 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:57:05.738295 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8f151035-763d-490b-bebd-348b34d3652e tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:05.738921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8f151035-763d-490b-bebd-348b34d3652e tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:05.764297 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f151035-763d-490b-bebd-348b34d3652e tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:05.769139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f151035-763d-490b-bebd-348b34d3652e tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:05.771309 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f151035-763d-490b-bebd-348b34d3652e tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:05.782446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f151035-763d-490b-bebd-348b34d3652e tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:05.784944 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f151035-763d-490b-bebd-348b34d3652e tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:05.786522 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8f151035-763d-490b-bebd-348b34d3652e tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:05.825366 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:05.829380 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-8f151035-763d-490b-bebd-348b34d3652e tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] HTTP exception thrown: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8f151035-763d-490b-bebd-348b34d3652e tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Request method failure captured: Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a HTTP/1.1 Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGrV-2lxMHtlOnu_r7LwqyjnFxYBbOHsTwM5Hauk1lzpb0-_UGwbpYKEAuaYoSv819N4fWpkSfVj2N6S8JHWPZy5eAknneGaMoWmnFyu81n6YsbfkdoPMjE97JfVl-gaXtXFnrUSP0eMYOFmBHDaxvNRFjpHWLZSAUw2HSOXKMxtftk Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 4cf3279c60d14e43bd109bc171698b7c Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4cf3279c60d14e43bd109bc171698b7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4cf3279c60d14e43bd109bc171698b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cf3279c60d14e43bd109bc171698b7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cf3279c60d14e43bd109bc171698b7c"}]}] Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 4cf3279c60d14e43bd109bc171698b7c Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesNegativeTestJSON-561479099-project Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 52edf1eb44d34155be5e71cdda6bf46b Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesNegativeTestJSON-561479099-project Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'be4204cf-67d2-46c7-9f84-605cb9262f2a'} Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:05.833046 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:05.838824 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:05.838824 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:05.838824 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:05.838824 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:57:05.838824 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:57:05.838824 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:05.838824 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:05.849849 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8f151035-763d-490b-bebd-348b34d3652e tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Returning 404 to user: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:57:05.850992 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8f151035-763d-490b-bebd-348b34d3652e tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 404 len: 111 microversion: 2.1 time: 0.122583 Oct 10 18:57:05.854133 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1024/1845] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:05 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:57:05.867941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f90ac6ed-58aa-466b-ba9d-3e35fb947b46 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1030118215", "metadata": {"image_type": "test"}}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:05.872725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f90ac6ed-58aa-466b-ba9d-3e35fb947b46 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:05.889197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f90ac6ed-58aa-466b-ba9d-3e35fb947b46 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:05.890248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f90ac6ed-58aa-466b-ba9d-3e35fb947b46 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:05.890757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f90ac6ed-58aa-466b-ba9d-3e35fb947b46 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:05.891542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f90ac6ed-58aa-466b-ba9d-3e35fb947b46 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:05.891988 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f90ac6ed-58aa-466b-ba9d-3e35fb947b46 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:05.894413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f90ac6ed-58aa-466b-ba9d-3e35fb947b46 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:05.926166 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-f90ac6ed-58aa-466b-ba9d-3e35fb947b46 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] HTTP exception thrown: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f90ac6ed-58aa-466b-ba9d-3e35fb947b46 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Request method failure captured: Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a/action HTTP/1.1 Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 112 Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGrV-2lxMHtlOnu_r7LwqyjnFxYBbOHsTwM5Hauk1lzpb0-_UGwbpYKEAuaYoSv819N4fWpkSfVj2N6S8JHWPZy5eAknneGaMoWmnFyu81n6YsbfkdoPMjE97JfVl-gaXtXFnrUSP0eMYOFmBHDaxvNRFjpHWLZSAUw2HSOXKMxtftk Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 4cf3279c60d14e43bd109bc171698b7c Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4cf3279c60d14e43bd109bc171698b7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4cf3279c60d14e43bd109bc171698b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cf3279c60d14e43bd109bc171698b7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cf3279c60d14e43bd109bc171698b7c"}]}] Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 4cf3279c60d14e43bd109bc171698b7c Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesNegativeTestJSON-561479099-project Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 52edf1eb44d34155be5e71cdda6bf46b Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesNegativeTestJSON-561479099-project Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1030118215", "metadata": {"image_type": "test"}}} Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'be4204cf-67d2-46c7-9f84-605cb9262f2a', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1030118215', 'metadata': {'image_type': 'test'}}}} Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 18:57:05.946404 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:05.957625 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f90ac6ed-58aa-466b-ba9d-3e35fb947b46 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Returning 404 to user: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:57:05.963516 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f90ac6ed-58aa-466b-ba9d-3e35fb947b46 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "POST /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a/action" status: 404 len: 111 microversion: 2.1 time: 0.095594 Oct 10 18:57:05.965995 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1025/1846] 10.222.0.43 () {60 vars in 1279 bytes} [Mon Oct 10 18:57:05 2022] POST /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a/action => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:57:05.977983 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1f2a2152-e156-4cff-8ef4-6a54f2c6fa6d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:05.983506 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1f2a2152-e156-4cff-8ef4-6a54f2c6fa6d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:05.990554 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f2a2152-e156-4cff-8ef4-6a54f2c6fa6d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:05.994300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f2a2152-e156-4cff-8ef4-6a54f2c6fa6d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:05.995127 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f2a2152-e156-4cff-8ef4-6a54f2c6fa6d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:05.996193 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f2a2152-e156-4cff-8ef4-6a54f2c6fa6d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:05.998268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f2a2152-e156-4cff-8ef4-6a54f2c6fa6d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:05.999128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f2a2152-e156-4cff-8ef4-6a54f2c6fa6d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:06.187655 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1f2a2152-e156-4cff-8ef4-6a54f2c6fa6d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:06.201947 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1f2a2152-e156-4cff-8ef4-6a54f2c6fa6d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:06.203718 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1f2a2152-e156-4cff-8ef4-6a54f2c6fa6d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:06.209376 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1f2a2152-e156-4cff-8ef4-6a54f2c6fa6d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.241884 Oct 10 18:57:06.210512 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1026/1847] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:05 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:06.215958 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2d44c359-cb07-4802-8c21-4ab569fe01b8 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1500620019", "metadata": {"image_type": "test"}}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:06.218505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2d44c359-cb07-4802-8c21-4ab569fe01b8 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Failed to fetch instance by id tempest-invalid-1952640976 {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 18:57:06.219175 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-2d44c359-cb07-4802-8c21-4ab569fe01b8 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] HTTP exception thrown: Instance tempest-invalid-1952640976 could not be found. Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2d44c359-cb07-4802-8c21-4ab569fe01b8 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Request method failure captured: Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/servers/tempest-invalid-1952640976/action HTTP/1.1 Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 112 Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGrV-2lxMHtlOnu_r7LwqyjnFxYBbOHsTwM5Hauk1lzpb0-_UGwbpYKEAuaYoSv819N4fWpkSfVj2N6S8JHWPZy5eAknneGaMoWmnFyu81n6YsbfkdoPMjE97JfVl-gaXtXFnrUSP0eMYOFmBHDaxvNRFjpHWLZSAUw2HSOXKMxtftk Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 4cf3279c60d14e43bd109bc171698b7c Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4cf3279c60d14e43bd109bc171698b7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4cf3279c60d14e43bd109bc171698b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cf3279c60d14e43bd109bc171698b7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cf3279c60d14e43bd109bc171698b7c"}]}] Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 4cf3279c60d14e43bd109bc171698b7c Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesNegativeTestJSON-561479099-project Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 52edf1eb44d34155be5e71cdda6bf46b Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesNegativeTestJSON-561479099-project Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1500620019", "metadata": {"image_type": "test"}}} Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance tempest-invalid-1952640976 could not be found. Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'tempest-invalid-1952640976', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1500620019', 'metadata': {'image_type': 'test'}}}} Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1952640976 could not be found. Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:57:06.220902 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1952640976 could not be found. Oct 10 18:57:06.233452 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.233452 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:06.233452 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.233452 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.233452 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:06.233452 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:06.233452 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:57:06.233452 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:57:06.233452 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1952640976 could not be found. Oct 10 18:57:06.233452 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.233452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2d44c359-cb07-4802-8c21-4ab569fe01b8 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Returning 404 to user: Instance tempest-invalid-1952640976 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:57:06.233452 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2d44c359-cb07-4802-8c21-4ab569fe01b8 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "POST /compute/v2.1/servers/tempest-invalid-1952640976/action" status: 404 len: 101 microversion: 2.1 time: 0.010336 Oct 10 18:57:06.233452 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1027/1848] 10.222.0.43 () {60 vars in 1249 bytes} [Mon Oct 10 18:57:06 2022] POST /compute/v2.1/servers/tempest-invalid-1952640976/action => generated 101 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:57:06.245609 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4126497d-2215-4fc5-b834-4fbefc6d8967 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1349173250"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:06.261064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4126497d-2215-4fc5-b834-4fbefc6d8967 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 18:57:06.261597 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-4126497d-2215-4fc5-b834-4fbefc6d8967 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4126497d-2215-4fc5-b834-4fbefc6d8967 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Request method failure captured: Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 57 Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGrV-2lxMHtlOnu_r7LwqyjnFxYBbOHsTwM5Hauk1lzpb0-_UGwbpYKEAuaYoSv819N4fWpkSfVj2N6S8JHWPZy5eAknneGaMoWmnFyu81n6YsbfkdoPMjE97JfVl-gaXtXFnrUSP0eMYOFmBHDaxvNRFjpHWLZSAUw2HSOXKMxtftk Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 4cf3279c60d14e43bd109bc171698b7c Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4cf3279c60d14e43bd109bc171698b7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4cf3279c60d14e43bd109bc171698b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cf3279c60d14e43bd109bc171698b7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cf3279c60d14e43bd109bc171698b7c"}]}] Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 4cf3279c60d14e43bd109bc171698b7c Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesNegativeTestJSON-561479099-project Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 52edf1eb44d34155be5e71cdda6bf46b Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesNegativeTestJSON-561479099-project Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: {"createImage": {"name": "tempest-test-snap-1349173250"}} Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1349173250'}}} Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 18:57:06.263481 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.268923 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:06.268923 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.268923 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.268923 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:06.268923 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:06.268923 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:57:06.268923 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:57:06.268923 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 18:57:06.268923 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.268923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4126497d-2215-4fc5-b834-4fbefc6d8967 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:57:06.268923 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4126497d-2215-4fc5-b834-4fbefc6d8967 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.034524 Oct 10 18:57:06.268923 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1028/1849] 10.222.0.43 () {60 vars in 1275 bytes} [Mon Oct 10 18:57:06 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:57:06.296420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0aed268f-22d4-4cee-bfee-204bb8c3d63b tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-37409042"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:06.303111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0aed268f-22d4-4cee-bfee-204bb8c3d63b tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 18:57:06.305754 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-0aed268f-22d4-4cee-bfee-204bb8c3d63b tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0aed268f-22d4-4cee-bfee-204bb8c3d63b tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Request method failure captured: Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 55 Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGrV-2lxMHtlOnu_r7LwqyjnFxYBbOHsTwM5Hauk1lzpb0-_UGwbpYKEAuaYoSv819N4fWpkSfVj2N6S8JHWPZy5eAknneGaMoWmnFyu81n6YsbfkdoPMjE97JfVl-gaXtXFnrUSP0eMYOFmBHDaxvNRFjpHWLZSAUw2HSOXKMxtftk Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 4cf3279c60d14e43bd109bc171698b7c Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4cf3279c60d14e43bd109bc171698b7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4cf3279c60d14e43bd109bc171698b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cf3279c60d14e43bd109bc171698b7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cf3279c60d14e43bd109bc171698b7c"}]}] Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 4cf3279c60d14e43bd109bc171698b7c Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesNegativeTestJSON-561479099-project Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 52edf1eb44d34155be5e71cdda6bf46b Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesNegativeTestJSON-561479099-project Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: {"createImage": {"name": "tempest-test-snap-37409042"}} Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-37409042'}}} Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 18:57:06.306073 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.312188 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:06.312188 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.312188 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.312188 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:06.312188 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:06.312188 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:57:06.312188 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:57:06.312188 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 10 18:57:06.312188 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.312188 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0aed268f-22d4-4cee-bfee-204bb8c3d63b tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:57:06.312188 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0aed268f-22d4-4cee-bfee-204bb8c3d63b tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.035731 Oct 10 18:57:06.312188 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1029/1850] 10.222.0.43 () {60 vars in 1281 bytes} [Mon Oct 10 18:57:06 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:57:06.325011 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bec718a0-083a-4190-8226-ff798c376e62 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:06.331063 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bec718a0-083a-4190-8226-ff798c376e62 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:06.339792 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bec718a0-083a-4190-8226-ff798c376e62 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:06.340459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bec718a0-083a-4190-8226-ff798c376e62 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:06.341065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bec718a0-083a-4190-8226-ff798c376e62 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:06.342180 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bec718a0-083a-4190-8226-ff798c376e62 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:06.343537 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bec718a0-083a-4190-8226-ff798c376e62 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:06.344219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bec718a0-083a-4190-8226-ff798c376e62 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:06.367452 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-bec718a0-083a-4190-8226-ff798c376e62 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] HTTP exception thrown: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bec718a0-083a-4190-8226-ff798c376e62 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Request method failure captured: Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a HTTP/1.1 Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGrV-2lxMHtlOnu_r7LwqyjnFxYBbOHsTwM5Hauk1lzpb0-_UGwbpYKEAuaYoSv819N4fWpkSfVj2N6S8JHWPZy5eAknneGaMoWmnFyu81n6YsbfkdoPMjE97JfVl-gaXtXFnrUSP0eMYOFmBHDaxvNRFjpHWLZSAUw2HSOXKMxtftk Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 4cf3279c60d14e43bd109bc171698b7c Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4cf3279c60d14e43bd109bc171698b7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4cf3279c60d14e43bd109bc171698b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cf3279c60d14e43bd109bc171698b7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cf3279c60d14e43bd109bc171698b7c"}]}] Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 4cf3279c60d14e43bd109bc171698b7c Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesNegativeTestJSON-561479099-project Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 52edf1eb44d34155be5e71cdda6bf46b Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesNegativeTestJSON-561479099-project Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'be4204cf-67d2-46c7-9f84-605cb9262f2a'} Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:57:06.370052 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:57:06.374944 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:06.374944 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.374944 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:06.374944 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.374944 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.374944 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:06.374944 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:06.374944 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:57:06.374944 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:57:06.374944 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:06.374944 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.381337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bec718a0-083a-4190-8226-ff798c376e62 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Returning 404 to user: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:57:06.383807 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bec718a0-083a-4190-8226-ff798c376e62 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "DELETE /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 404 len: 111 microversion: 2.1 time: 0.070475 Oct 10 18:57:06.385026 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1030/1851] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:57:06 2022] DELETE /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:57:06.395468 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b3be98a3-558b-4ce4-b6c4-26d1e72f8e40 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:06.397567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b3be98a3-558b-4ce4-b6c4-26d1e72f8e40 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] [instance: be4204cf-67d2-46c7-9f84-605cb9262f2a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:06.406854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3be98a3-558b-4ce4-b6c4-26d1e72f8e40 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:06.408476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3be98a3-558b-4ce4-b6c4-26d1e72f8e40 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:06.410411 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3be98a3-558b-4ce4-b6c4-26d1e72f8e40 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:06.411489 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3be98a3-558b-4ce4-b6c4-26d1e72f8e40 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:06.412205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3be98a3-558b-4ce4-b6c4-26d1e72f8e40 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:06.412891 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3be98a3-558b-4ce4-b6c4-26d1e72f8e40 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:06.438902 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-b3be98a3-558b-4ce4-b6c4-26d1e72f8e40 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] HTTP exception thrown: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b3be98a3-558b-4ce4-b6c4-26d1e72f8e40 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Request method failure captured: Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a HTTP/1.1 Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGrV-2lxMHtlOnu_r7LwqyjnFxYBbOHsTwM5Hauk1lzpb0-_UGwbpYKEAuaYoSv819N4fWpkSfVj2N6S8JHWPZy5eAknneGaMoWmnFyu81n6YsbfkdoPMjE97JfVl-gaXtXFnrUSP0eMYOFmBHDaxvNRFjpHWLZSAUw2HSOXKMxtftk Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 4cf3279c60d14e43bd109bc171698b7c Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4cf3279c60d14e43bd109bc171698b7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4cf3279c60d14e43bd109bc171698b7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cf3279c60d14e43bd109bc171698b7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cf3279c60d14e43bd109bc171698b7c"}]}] Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 4cf3279c60d14e43bd109bc171698b7c Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-561479099 Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesNegativeTestJSON-561479099-project Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 52edf1eb44d34155be5e71cdda6bf46b Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesNegativeTestJSON-561479099-project Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'be4204cf-67d2-46c7-9f84-605cb9262f2a'} Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:06.442524 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.448273 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:06.448273 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:06.448273 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:06.448273 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:57:06.448273 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:57:06.448273 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. Oct 10 18:57:06.448273 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:06.450098 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b3be98a3-558b-4ce4-b6c4-26d1e72f8e40 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] Returning 404 to user: Instance be4204cf-67d2-46c7-9f84-605cb9262f2a could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:57:06.453411 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b3be98a3-558b-4ce4-b6c4-26d1e72f8e40 tempest-ImagesNegativeTestJSON-561479099 tempest-ImagesNegativeTestJSON-561479099-project] 10.222.0.43 "GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a" status: 404 len: 111 microversion: 2.1 time: 0.063471 Oct 10 18:57:06.453411 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1031/1852] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:06 2022] GET /compute/v2.1/servers/be4204cf-67d2-46c7-9f84-605cb9262f2a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 18:57:06.746558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-04b92287-5bba-47c7-bb35-b035e90fa72f tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:06.747886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-04b92287-5bba-47c7-bb35-b035e90fa72f tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:06.761289 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04b92287-5bba-47c7-bb35-b035e90fa72f tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:06.761941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04b92287-5bba-47c7-bb35-b035e90fa72f tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:06.766075 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04b92287-5bba-47c7-bb35-b035e90fa72f tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:06.766870 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04b92287-5bba-47c7-bb35-b035e90fa72f tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:06.767368 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04b92287-5bba-47c7-bb35-b035e90fa72f tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:06.767798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04b92287-5bba-47c7-bb35-b035e90fa72f tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:07.249437 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=14 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:07.298986 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Updating instance_info_cache with network_info: [] {{(pid=127289) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 10 18:57:07.418294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-04b92287-5bba-47c7-bb35-b035e90fa72f tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:07.436851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-04b92287-5bba-47c7-bb35-b035e90fa72f tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:07.442420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-04b92287-5bba-47c7-bb35-b035e90fa72f tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:07.443979 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-04b92287-5bba-47c7-bb35-b035e90fa72f tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1661 microversion: 2.42 time: 0.706789 Oct 10 18:57:07.447800 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1032/1853] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:06 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1661 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:07.460601 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-c3b4fb1e-586f-47a5-a0fe-53dfcbeb8f6e req-81493a58-c4d5-4090-8d50-77d2fd429ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab18d87-5b5b-4d03-a0c0-a07a998f411b", "name": "network-vif-deleted", "tag": "64f367b9-222a-4fe3-919b-80f6bdc5452d"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:07.489626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c3b4fb1e-586f-47a5-a0fe-53dfcbeb8f6e req-81493a58-c4d5-4090-8d50-77d2fd429ab0 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:07.491791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c3b4fb1e-586f-47a5-a0fe-53dfcbeb8f6e req-81493a58-c4d5-4090-8d50-77d2fd429ab0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:07.493033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-c3b4fb1e-586f-47a5-a0fe-53dfcbeb8f6e req-81493a58-c4d5-4090-8d50-77d2fd429ab0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:07.525991 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.compute.server_external_events [req-c3b4fb1e-586f-47a5-a0fe-53dfcbeb8f6e req-81493a58-c4d5-4090-8d50-77d2fd429ab0 service nova] Unable to find a host for instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b. Dropping event network-vif-deleted {{(pid=127288) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 10 18:57:07.533984 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-c3b4fb1e-586f-47a5-a0fe-53dfcbeb8f6e req-81493a58-c4d5-4090-8d50-77d2fd429ab0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.075972 Oct 10 18:57:07.548627 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1033/1854] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 10 18:57:07.598508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b8e94f1e-1f65-41e1-b03e-56fbdc4144e5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:07.599160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b8e94f1e-1f65-41e1-b03e-56fbdc4144e5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:07.621538 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b8e94f1e-1f65-41e1-b03e-56fbdc4144e5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:07.623186 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b8e94f1e-1f65-41e1-b03e-56fbdc4144e5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:07.625595 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b8e94f1e-1f65-41e1-b03e-56fbdc4144e5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:07.627294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b8e94f1e-1f65-41e1-b03e-56fbdc4144e5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:07.630126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b8e94f1e-1f65-41e1-b03e-56fbdc4144e5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:07.633883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b8e94f1e-1f65-41e1-b03e-56fbdc4144e5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:08.058744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b8e94f1e-1f65-41e1-b03e-56fbdc4144e5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:08.073586 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b8e94f1e-1f65-41e1-b03e-56fbdc4144e5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:08.075580 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b8e94f1e-1f65-41e1-b03e-56fbdc4144e5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:08.084087 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b8e94f1e-1f65-41e1-b03e-56fbdc4144e5 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.514184 Oct 10 18:57:08.085582 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1034/1855] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:07 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:08.347652 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:08.440051 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1a079340-74a1-4228-84d2-266f83242bc3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 204 len: 0 microversion: 2.1 time: 5.746714 Oct 10 18:57:08.440978 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 822/1856] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:57:02 2022] DELETE /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 0 bytes in 5748 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 18:57:08.451239 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-64227100-dbbc-43f9-b973-8042fcc451cc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:08.453101 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-64227100-dbbc-43f9-b973-8042fcc451cc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:08.472714 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64227100-dbbc-43f9-b973-8042fcc451cc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:08.475527 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64227100-dbbc-43f9-b973-8042fcc451cc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:08.477474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-01be2f1d-c641-4871-97a2-b9a38a0ea6bf tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:08.478139 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-01be2f1d-c641-4871-97a2-b9a38a0ea6bf tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:08.480315 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64227100-dbbc-43f9-b973-8042fcc451cc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:08.482992 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64227100-dbbc-43f9-b973-8042fcc451cc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:08.483636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64227100-dbbc-43f9-b973-8042fcc451cc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:08.485890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64227100-dbbc-43f9-b973-8042fcc451cc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:08.512215 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-01be2f1d-c641-4871-97a2-b9a38a0ea6bf tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:08.512801 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-01be2f1d-c641-4871-97a2-b9a38a0ea6bf tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:08.513242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-01be2f1d-c641-4871-97a2-b9a38a0ea6bf tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:08.519541 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-01be2f1d-c641-4871-97a2-b9a38a0ea6bf tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:08.520149 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-01be2f1d-c641-4871-97a2-b9a38a0ea6bf tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:08.520669 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-01be2f1d-c641-4871-97a2-b9a38a0ea6bf tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:08.526946 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-64227100-dbbc-43f9-b973-8042fcc451cc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-64227100-dbbc-43f9-b973-8042fcc451cc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b HTTP/1.1 Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '2ab18d87-5b5b-4d03-a0c0-a07a998f411b'} Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:08.532353 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:08.538716 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:08.538716 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:08.538716 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:08.538716 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:57:08.538716 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:57:08.538716 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:57:08.538716 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:08.557258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-64227100-dbbc-43f9-b973-8042fcc451cc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:57:08.560373 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-64227100-dbbc-43f9-b973-8042fcc451cc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 404 len: 111 microversion: 2.1 time: 0.113321 Oct 10 18:57:08.598345 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1035/1857] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:08 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:57:08.852657 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-485799091", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "d618544b-e911-430e-af15-268a6710c3f9"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:08.975126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] validate_networks() for [('d618544b-e911-430e-af15-268a6710c3f9', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:57:09.210014 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-01be2f1d-c641-4871-97a2-b9a38a0ea6bf tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:09.233040 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-01be2f1d-c641-4871-97a2-b9a38a0ea6bf tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:09.234562 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-01be2f1d-c641-4871-97a2-b9a38a0ea6bf tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:09.244646 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-01be2f1d-c641-4871-97a2-b9a38a0ea6bf tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1707 microversion: 2.42 time: 0.772784 Oct 10 18:57:09.248496 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 823/1858] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:08 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1707 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:09.259720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1302944553", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "737898c7-94e7-46dc-b9d9-724fb5cc9d52"}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:09.355095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] validate_networks() for [('737898c7-94e7-46dc-b9d9-724fb5cc9d52', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:57:09.904682 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:57:09.906215 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:57:09.906736 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:57:09.913853 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:57:09.914483 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:57:09.951796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:09.951796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:09.951796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:09.955976 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:09.957364 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:09.961035 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:10.040878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Getting quotas for project 107b5e9043cf4f4a94f9d6bce3e0c32f. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:57:10.048065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Getting quotas for user 9fcff3ee4700482faa4a53214db748aa and project 107b5e9043cf4f4a94f9d6bce3e0c32f. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:57:10.097602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:57:10.100082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:57:10.326683 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0444f8f8-3d3f-4f9e-8d33-4c178c43e838 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.585614 Oct 10 18:57:10.330315 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1036/1859] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:57:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 18:57:10.341167 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a28bb67d-2d07-4c5b-a88c-b90c7903a586 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:10.342035 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a28bb67d-2d07-4c5b-a88c-b90c7903a586 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:10.378549 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a28bb67d-2d07-4c5b-a88c-b90c7903a586 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:10.379196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a28bb67d-2d07-4c5b-a88c-b90c7903a586 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:10.379715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a28bb67d-2d07-4c5b-a88c-b90c7903a586 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:10.380564 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a28bb67d-2d07-4c5b-a88c-b90c7903a586 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:10.392780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a28bb67d-2d07-4c5b-a88c-b90c7903a586 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:10.395479 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a28bb67d-2d07-4c5b-a88c-b90c7903a586 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:10.618706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a28bb67d-2d07-4c5b-a88c-b90c7903a586 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:10.646983 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a28bb67d-2d07-4c5b-a88c-b90c7903a586 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:10.658604 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a28bb67d-2d07-4c5b-a88c-b90c7903a586 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:10.673101 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a28bb67d-2d07-4c5b-a88c-b90c7903a586 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1533 microversion: 2.91 time: 0.341212 Oct 10 18:57:10.673565 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1037/1860] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:10 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1533 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:10.741343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b6de50cc-a746-4499-ba8c-c73351b0ba96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:10.741343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b6de50cc-a746-4499-ba8c-c73351b0ba96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:10.741343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b6de50cc-a746-4499-ba8c-c73351b0ba96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:10.741343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b6de50cc-a746-4499-ba8c-c73351b0ba96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:10.741343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b6de50cc-a746-4499-ba8c-c73351b0ba96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:10.741343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b6de50cc-a746-4499-ba8c-c73351b0ba96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:10.741343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b6de50cc-a746-4499-ba8c-c73351b0ba96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:10.741343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b6de50cc-a746-4499-ba8c-c73351b0ba96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:11.109611 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b6de50cc-a746-4499-ba8c-c73351b0ba96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:11.120617 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:57:11.121134 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:57:11.121494 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:57:11.122221 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:57:11.122916 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:57:11.143345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b6de50cc-a746-4499-ba8c-c73351b0ba96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:11.146025 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:11.146371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b6de50cc-a746-4499-ba8c-c73351b0ba96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:11.149166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:11.150067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:11.155741 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b6de50cc-a746-4499-ba8c-c73351b0ba96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1753 microversion: 2.42 time: 0.456406 Oct 10 18:57:11.158286 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:11.175427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:11.175427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:11.176801 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1038/1861] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:10 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1753 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:11.207843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-325ca886-05cd-4fb2-80fd-8d999f69167d tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:11.212684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-325ca886-05cd-4fb2-80fd-8d999f69167d tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:11.264694 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Getting quotas for project c5d5fb01be0c409d98c222551a2c0e2e. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:57:11.271693 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Getting quotas for user afedfd9cc5b241ad97e27f6e911244a1 and project c5d5fb01be0c409d98c222551a2c0e2e. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:57:11.292915 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:57:11.296254 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:57:11.370927 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-325ca886-05cd-4fb2-80fd-8d999f69167d tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fcff3ee4700482faa4a53214db748aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107b5e9043cf4f4a94f9d6bce3e0c32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:11.381193 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-325ca886-05cd-4fb2-80fd-8d999f69167d tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 200 len: 1215 microversion: 2.1 time: 0.217125 Oct 10 18:57:11.384794 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1039/1862] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:11 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:11.390918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-eb2631e6-b529-49a8-96aa-12b91f293ef7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:11.391942 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-eb2631e6-b529-49a8-96aa-12b91f293ef7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:11.398117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eb2631e6-b529-49a8-96aa-12b91f293ef7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:11.402241 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eb2631e6-b529-49a8-96aa-12b91f293ef7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:11.402241 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eb2631e6-b529-49a8-96aa-12b91f293ef7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:11.407486 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eb2631e6-b529-49a8-96aa-12b91f293ef7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:11.410847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eb2631e6-b529-49a8-96aa-12b91f293ef7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:11.418061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eb2631e6-b529-49a8-96aa-12b91f293ef7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:11.480276 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-450e0713-5345-4fb8-bb6c-54a0cd43c7d9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.228483 Oct 10 18:57:11.491757 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 824/1863] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:57:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:57:11.507636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-864c615e-f039-4894-a390-fb160c6f210c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:11.511356 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-864c615e-f039-4894-a390-fb160c6f210c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:11.609334 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-eb2631e6-b529-49a8-96aa-12b91f293ef7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lazy-loading 'services' on Instance uuid 09b8e807-521f-4b1d-9082-71ffd73f2d63 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:57:11.654473 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-eb2631e6-b529-49a8-96aa-12b91f293ef7 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1938 microversion: 2.91 time: 0.268334 Oct 10 18:57:11.655062 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1040/1864] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:11 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1938 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:11.677879 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-864c615e-f039-4894-a390-fb160c6f210c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:11.686957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b3ccb8a2-d5ed-4298-890a-9f7ab1b7840c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:11.687496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b3ccb8a2-d5ed-4298-890a-9f7ab1b7840c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:11.707718 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-864c615e-f039-4894-a390-fb160c6f210c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1215 microversion: 2.1 time: 0.205427 Oct 10 18:57:11.716653 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3ccb8a2-d5ed-4298-890a-9f7ab1b7840c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:11.717507 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3ccb8a2-d5ed-4298-890a-9f7ab1b7840c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:11.717661 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 825/1865] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:11 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:11.720163 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3ccb8a2-d5ed-4298-890a-9f7ab1b7840c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:11.721893 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3ccb8a2-d5ed-4298-890a-9f7ab1b7840c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:11.724942 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3ccb8a2-d5ed-4298-890a-9f7ab1b7840c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:11.725619 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b3ccb8a2-d5ed-4298-890a-9f7ab1b7840c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:11.816665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-b3ccb8a2-d5ed-4298-890a-9f7ab1b7840c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lazy-loading 'flavor' on Instance uuid 09b8e807-521f-4b1d-9082-71ffd73f2d63 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:57:12.198892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e18409ca-7e90-41e5-900c-247dd492a003 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:12.200801 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e18409ca-7e90-41e5-900c-247dd492a003 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:12.215653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e18409ca-7e90-41e5-900c-247dd492a003 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:12.219587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e18409ca-7e90-41e5-900c-247dd492a003 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:12.219587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e18409ca-7e90-41e5-900c-247dd492a003 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:12.219587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e18409ca-7e90-41e5-900c-247dd492a003 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:12.220730 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e18409ca-7e90-41e5-900c-247dd492a003 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:12.224310 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e18409ca-7e90-41e5-900c-247dd492a003 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:12.599958 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b3ccb8a2-d5ed-4298-890a-9f7ab1b7840c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "POST /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63/action" status: 202 len: 0 microversion: 2.91 time: 0.917442 Oct 10 18:57:12.610728 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1041/1866] 10.222.0.43 () {62 vars in 1319 bytes} [Mon Oct 10 18:57:11 2022] POST /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63/action => generated 0 bytes in 929 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:57:12.622059 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0242f49f-be85-437e-bb91-4db73cb2448b tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:12.623109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0242f49f-be85-437e-bb91-4db73cb2448b tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:12.639708 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0242f49f-be85-437e-bb91-4db73cb2448b tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:12.640804 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0242f49f-be85-437e-bb91-4db73cb2448b tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:12.641506 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0242f49f-be85-437e-bb91-4db73cb2448b tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:12.651609 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0242f49f-be85-437e-bb91-4db73cb2448b tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:12.655251 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0242f49f-be85-437e-bb91-4db73cb2448b tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:12.656110 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0242f49f-be85-437e-bb91-4db73cb2448b tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:12.868866 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0242f49f-be85-437e-bb91-4db73cb2448b tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fcff3ee4700482faa4a53214db748aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107b5e9043cf4f4a94f9d6bce3e0c32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:12.883908 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0242f49f-be85-437e-bb91-4db73cb2448b tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 200 len: 1219 microversion: 2.1 time: 0.268465 Oct 10 18:57:12.885142 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1042/1867] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:12 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 1219 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:12.896278 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1e77848e-b63d-495d-b2c0-a7f6357240fd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:12.897300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1e77848e-b63d-495d-b2c0-a7f6357240fd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:12.912331 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e77848e-b63d-495d-b2c0-a7f6357240fd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:12.914390 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e77848e-b63d-495d-b2c0-a7f6357240fd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:12.915033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e77848e-b63d-495d-b2c0-a7f6357240fd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:12.917861 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e77848e-b63d-495d-b2c0-a7f6357240fd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:12.918528 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e77848e-b63d-495d-b2c0-a7f6357240fd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:12.931672 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e77848e-b63d-495d-b2c0-a7f6357240fd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:13.162142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1e77848e-b63d-495d-b2c0-a7f6357240fd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:13.175046 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1e77848e-b63d-495d-b2c0-a7f6357240fd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:13.177427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1e77848e-b63d-495d-b2c0-a7f6357240fd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:13.198703 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1e77848e-b63d-495d-b2c0-a7f6357240fd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.311533 Oct 10 18:57:13.219795 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1043/1868] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:12 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:13.234541 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-86e67ebf-b681-4519-9d79-007086de6b18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:13.235463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-86e67ebf-b681-4519-9d79-007086de6b18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:13.251179 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-86e67ebf-b681-4519-9d79-007086de6b18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:13.252063 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-86e67ebf-b681-4519-9d79-007086de6b18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:13.253308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-86e67ebf-b681-4519-9d79-007086de6b18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:13.254231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-86e67ebf-b681-4519-9d79-007086de6b18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:13.255219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-86e67ebf-b681-4519-9d79-007086de6b18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:13.255803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-86e67ebf-b681-4519-9d79-007086de6b18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:13.302420 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e18409ca-7e90-41e5-900c-247dd492a003 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:13.327415 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e18409ca-7e90-41e5-900c-247dd492a003 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:13.331215 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e18409ca-7e90-41e5-900c-247dd492a003 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:13.337088 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e18409ca-7e90-41e5-900c-247dd492a003 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1753 microversion: 2.42 time: 1.142793 Oct 10 18:57:13.340356 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 826/1869] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:12 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1753 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:13.489834 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-86e67ebf-b681-4519-9d79-007086de6b18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:13.516810 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-86e67ebf-b681-4519-9d79-007086de6b18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1219 microversion: 2.1 time: 0.294609 Oct 10 18:57:13.523942 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1044/1870] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:13 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1219 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:13.912002 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-986e9cd4-b78c-4bd0-a52d-36f96fc68c60 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:13.912730 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-986e9cd4-b78c-4bd0-a52d-36f96fc68c60 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:13.926705 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-986e9cd4-b78c-4bd0-a52d-36f96fc68c60 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:13.940391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-986e9cd4-b78c-4bd0-a52d-36f96fc68c60 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:13.940391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-986e9cd4-b78c-4bd0-a52d-36f96fc68c60 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:13.940391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-986e9cd4-b78c-4bd0-a52d-36f96fc68c60 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:13.940391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-986e9cd4-b78c-4bd0-a52d-36f96fc68c60 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:13.940391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-986e9cd4-b78c-4bd0-a52d-36f96fc68c60 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:14.179218 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-986e9cd4-b78c-4bd0-a52d-36f96fc68c60 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fcff3ee4700482faa4a53214db748aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107b5e9043cf4f4a94f9d6bce3e0c32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:14.189397 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-986e9cd4-b78c-4bd0-a52d-36f96fc68c60 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 200 len: 1267 microversion: 2.1 time: 0.282373 Oct 10 18:57:14.192863 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 827/1871] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:13 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:14.227576 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1793d29c-e375-42bd-bf73-cf3d16baf1ec tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:14.230502 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1793d29c-e375-42bd-bf73-cf3d16baf1ec tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:14.245002 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1793d29c-e375-42bd-bf73-cf3d16baf1ec tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:14.245968 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1793d29c-e375-42bd-bf73-cf3d16baf1ec tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:14.246874 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1793d29c-e375-42bd-bf73-cf3d16baf1ec tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:14.247844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1793d29c-e375-42bd-bf73-cf3d16baf1ec tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:14.248305 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1793d29c-e375-42bd-bf73-cf3d16baf1ec tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:14.248757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1793d29c-e375-42bd-bf73-cf3d16baf1ec tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:14.365959 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bfa8d1fc-1570-460a-835e-b8b133db7d96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:14.367364 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bfa8d1fc-1570-460a-835e-b8b133db7d96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:14.382481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1793d29c-e375-42bd-bf73-cf3d16baf1ec tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:14.385050 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bfa8d1fc-1570-460a-835e-b8b133db7d96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:14.385761 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bfa8d1fc-1570-460a-835e-b8b133db7d96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:14.389735 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bfa8d1fc-1570-460a-835e-b8b133db7d96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:14.390974 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bfa8d1fc-1570-460a-835e-b8b133db7d96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:14.391714 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bfa8d1fc-1570-460a-835e-b8b133db7d96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:14.392378 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bfa8d1fc-1570-460a-835e-b8b133db7d96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:14.398310 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1793d29c-e375-42bd-bf73-cf3d16baf1ec tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:14.402785 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1793d29c-e375-42bd-bf73-cf3d16baf1ec tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:14.430815 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1793d29c-e375-42bd-bf73-cf3d16baf1ec tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.208210 Oct 10 18:57:14.435726 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1045/1872] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:14 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:14.574720 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-588e6017-c733-431c-9b47-adc06e56f4db tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:14.576287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-588e6017-c733-431c-9b47-adc06e56f4db tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:14.596423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-588e6017-c733-431c-9b47-adc06e56f4db tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:14.597456 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-588e6017-c733-431c-9b47-adc06e56f4db tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:14.598496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-588e6017-c733-431c-9b47-adc06e56f4db tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:14.599577 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-588e6017-c733-431c-9b47-adc06e56f4db tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:14.600198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-588e6017-c733-431c-9b47-adc06e56f4db tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:14.601406 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-588e6017-c733-431c-9b47-adc06e56f4db tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:14.795222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bfa8d1fc-1570-460a-835e-b8b133db7d96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:14.814660 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bfa8d1fc-1570-460a-835e-b8b133db7d96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:14.818048 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bfa8d1fc-1570-460a-835e-b8b133db7d96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:14.823594 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bfa8d1fc-1570-460a-835e-b8b133db7d96 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1799 microversion: 2.42 time: 0.460327 Oct 10 18:57:14.827369 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 828/1873] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:14 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1799 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:14.897837 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-588e6017-c733-431c-9b47-adc06e56f4db tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:14.910000 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-588e6017-c733-431c-9b47-adc06e56f4db tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1267 microversion: 2.1 time: 0.352788 Oct 10 18:57:14.912603 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1046/1874] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:14 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1267 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:15.214737 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1b9fae9a-eb5b-4380-8c95-54cbe67cf531 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:15.215360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1b9fae9a-eb5b-4380-8c95-54cbe67cf531 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:15.225343 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b9fae9a-eb5b-4380-8c95-54cbe67cf531 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:15.225800 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b9fae9a-eb5b-4380-8c95-54cbe67cf531 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:15.226232 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b9fae9a-eb5b-4380-8c95-54cbe67cf531 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:15.232321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b9fae9a-eb5b-4380-8c95-54cbe67cf531 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:15.232856 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b9fae9a-eb5b-4380-8c95-54cbe67cf531 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:15.233464 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1b9fae9a-eb5b-4380-8c95-54cbe67cf531 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:15.459091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d01b319d-9c34-4670-ae3c-e4844acf87b3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:15.460848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d01b319d-9c34-4670-ae3c-e4844acf87b3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:15.473759 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d01b319d-9c34-4670-ae3c-e4844acf87b3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:15.476626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d01b319d-9c34-4670-ae3c-e4844acf87b3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:15.478061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d01b319d-9c34-4670-ae3c-e4844acf87b3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:15.480732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d01b319d-9c34-4670-ae3c-e4844acf87b3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:15.482924 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d01b319d-9c34-4670-ae3c-e4844acf87b3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:15.483666 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d01b319d-9c34-4670-ae3c-e4844acf87b3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:15.546842 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:15.733653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1b9fae9a-eb5b-4380-8c95-54cbe67cf531 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fcff3ee4700482faa4a53214db748aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107b5e9043cf4f4a94f9d6bce3e0c32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:15.743963 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1b9fae9a-eb5b-4380-8c95-54cbe67cf531 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 200 len: 1273 microversion: 2.1 time: 0.534410 Oct 10 18:57:15.745135 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 829/1875] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:15 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 1273 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:15.850672 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-58b224a2-1f97-4a49-8cd5-7e2952ada03d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:15.851541 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-58b224a2-1f97-4a49-8cd5-7e2952ada03d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:15.863977 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-58b224a2-1f97-4a49-8cd5-7e2952ada03d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:15.865282 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-58b224a2-1f97-4a49-8cd5-7e2952ada03d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:15.866475 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-58b224a2-1f97-4a49-8cd5-7e2952ada03d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:15.867406 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-58b224a2-1f97-4a49-8cd5-7e2952ada03d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:15.868027 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-58b224a2-1f97-4a49-8cd5-7e2952ada03d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:15.868640 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-58b224a2-1f97-4a49-8cd5-7e2952ada03d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:16.246440 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d01b319d-9c34-4670-ae3c-e4844acf87b3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:16.257432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d01b319d-9c34-4670-ae3c-e4844acf87b3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:16.261092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d01b319d-9c34-4670-ae3c-e4844acf87b3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:16.273212 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d01b319d-9c34-4670-ae3c-e4844acf87b3 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.818751 Oct 10 18:57:16.284023 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1047/1876] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:15 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:16.316184 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ada499ff-eabb-42d3-8a0a-3cc486a77df3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:16.318344 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ada499ff-eabb-42d3-8a0a-3cc486a77df3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:16.336512 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ada499ff-eabb-42d3-8a0a-3cc486a77df3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:16.340568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ada499ff-eabb-42d3-8a0a-3cc486a77df3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:16.343371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ada499ff-eabb-42d3-8a0a-3cc486a77df3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:16.346699 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ada499ff-eabb-42d3-8a0a-3cc486a77df3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:16.350680 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ada499ff-eabb-42d3-8a0a-3cc486a77df3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:16.351444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ada499ff-eabb-42d3-8a0a-3cc486a77df3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:16.456258 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-58b224a2-1f97-4a49-8cd5-7e2952ada03d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:16.470034 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-58b224a2-1f97-4a49-8cd5-7e2952ada03d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:16.474330 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-58b224a2-1f97-4a49-8cd5-7e2952ada03d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:16.480480 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-58b224a2-1f97-4a49-8cd5-7e2952ada03d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1845 microversion: 2.42 time: 0.634207 Oct 10 18:57:16.484792 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 830/1877] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:15 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1845 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:16.624482 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ada499ff-eabb-42d3-8a0a-3cc486a77df3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:16.659220 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ada499ff-eabb-42d3-8a0a-3cc486a77df3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1273 microversion: 2.1 time: 0.372940 Oct 10 18:57:16.679977 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1048/1878] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:16 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1273 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:16.769173 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6328db38-63c1-4a94-9f09-5ace9ccedacc tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:16.770545 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6328db38-63c1-4a94-9f09-5ace9ccedacc tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:16.789471 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6328db38-63c1-4a94-9f09-5ace9ccedacc tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:16.791697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6328db38-63c1-4a94-9f09-5ace9ccedacc tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:16.798356 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6328db38-63c1-4a94-9f09-5ace9ccedacc tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:16.802604 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6328db38-63c1-4a94-9f09-5ace9ccedacc tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:16.804103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6328db38-63c1-4a94-9f09-5ace9ccedacc tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:16.806004 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6328db38-63c1-4a94-9f09-5ace9ccedacc tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:17.319941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-298297f8-d4ea-49d3-a667-5cabc5259f59 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:17.324319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-298297f8-d4ea-49d3-a667-5cabc5259f59 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:17.332700 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-298297f8-d4ea-49d3-a667-5cabc5259f59 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:17.333443 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-298297f8-d4ea-49d3-a667-5cabc5259f59 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:17.334074 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-298297f8-d4ea-49d3-a667-5cabc5259f59 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:17.334961 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-298297f8-d4ea-49d3-a667-5cabc5259f59 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:17.337233 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-298297f8-d4ea-49d3-a667-5cabc5259f59 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:17.341279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-298297f8-d4ea-49d3-a667-5cabc5259f59 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:17.559491 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-298297f8-d4ea-49d3-a667-5cabc5259f59 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:17.621269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-298297f8-d4ea-49d3-a667-5cabc5259f59 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:17.627206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-298297f8-d4ea-49d3-a667-5cabc5259f59 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:17.639225 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-298297f8-d4ea-49d3-a667-5cabc5259f59 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.323667 Oct 10 18:57:17.663230 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1049/1879] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:17 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:57:17.674686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ea07f917-656a-43bf-bde4-530b385b8068 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:17.675585 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ea07f917-656a-43bf-bde4-530b385b8068 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:17.700720 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea07f917-656a-43bf-bde4-530b385b8068 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:17.706449 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea07f917-656a-43bf-bde4-530b385b8068 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:17.709329 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea07f917-656a-43bf-bde4-530b385b8068 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:17.711783 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea07f917-656a-43bf-bde4-530b385b8068 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:17.715971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea07f917-656a-43bf-bde4-530b385b8068 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:17.718118 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea07f917-656a-43bf-bde4-530b385b8068 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:18.231524 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6328db38-63c1-4a94-9f09-5ace9ccedacc tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fcff3ee4700482faa4a53214db748aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107b5e9043cf4f4a94f9d6bce3e0c32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:18.248731 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6328db38-63c1-4a94-9f09-5ace9ccedacc tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 200 len: 1315 microversion: 2.1 time: 1.485201 Oct 10 18:57:18.252116 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 831/1880] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:16 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 1315 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:18.282721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-58074890-3c89-4a8f-8667-49b4bd15d474 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:18.286624 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-58074890-3c89-4a8f-8667-49b4bd15d474 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:18.292332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ea07f917-656a-43bf-bde4-530b385b8068 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:18.312698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ea07f917-656a-43bf-bde4-530b385b8068 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:18.317868 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ea07f917-656a-43bf-bde4-530b385b8068 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:18.321625 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ea07f917-656a-43bf-bde4-530b385b8068 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1845 microversion: 2.42 time: 0.653706 Oct 10 18:57:18.327324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-58074890-3c89-4a8f-8667-49b4bd15d474 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:18.328152 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-58074890-3c89-4a8f-8667-49b4bd15d474 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:18.328865 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-58074890-3c89-4a8f-8667-49b4bd15d474 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:18.331554 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-58074890-3c89-4a8f-8667-49b4bd15d474 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:18.332449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-58074890-3c89-4a8f-8667-49b4bd15d474 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:18.333143 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-58074890-3c89-4a8f-8667-49b4bd15d474 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:18.347276 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1050/1881] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:17 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1845 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:18.457147 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-58074890-3c89-4a8f-8667-49b4bd15d474 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:18.466904 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-58074890-3c89-4a8f-8667-49b4bd15d474 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1273 microversion: 2.1 time: 0.197769 Oct 10 18:57:18.467493 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 832/1882] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:18 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1273 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:18.668118 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-004f0b7e-4bf2-4e1a-96d0-ab6b06cd4e3d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:18.670835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-004f0b7e-4bf2-4e1a-96d0-ab6b06cd4e3d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:18.676481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-004f0b7e-4bf2-4e1a-96d0-ab6b06cd4e3d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:18.677188 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-004f0b7e-4bf2-4e1a-96d0-ab6b06cd4e3d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:18.686320 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-004f0b7e-4bf2-4e1a-96d0-ab6b06cd4e3d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:18.687123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-004f0b7e-4bf2-4e1a-96d0-ab6b06cd4e3d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:18.695337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-004f0b7e-4bf2-4e1a-96d0-ab6b06cd4e3d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:18.695852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-004f0b7e-4bf2-4e1a-96d0-ab6b06cd4e3d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:18.953145 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-004f0b7e-4bf2-4e1a-96d0-ab6b06cd4e3d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:18.970210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-004f0b7e-4bf2-4e1a-96d0-ab6b06cd4e3d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:18.979453 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-004f0b7e-4bf2-4e1a-96d0-ab6b06cd4e3d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:18.990277 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-004f0b7e-4bf2-4e1a-96d0-ab6b06cd4e3d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.326871 Oct 10 18:57:19.005649 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1051/1883] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:18 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:19.273775 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3ba7cc7b-4042-4667-8bbc-ce260d6dd4e2 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:19.274517 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3ba7cc7b-4042-4667-8bbc-ce260d6dd4e2 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:19.306549 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3ba7cc7b-4042-4667-8bbc-ce260d6dd4e2 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:19.307875 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3ba7cc7b-4042-4667-8bbc-ce260d6dd4e2 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:19.310557 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3ba7cc7b-4042-4667-8bbc-ce260d6dd4e2 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:19.312983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3ba7cc7b-4042-4667-8bbc-ce260d6dd4e2 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:19.313568 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3ba7cc7b-4042-4667-8bbc-ce260d6dd4e2 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:19.314851 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3ba7cc7b-4042-4667-8bbc-ce260d6dd4e2 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:19.352890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fd30679a-00d9-46e3-8d15-4d1d17e5b130 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:19.353798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fd30679a-00d9-46e3-8d15-4d1d17e5b130 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:19.365433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd30679a-00d9-46e3-8d15-4d1d17e5b130 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:19.368414 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd30679a-00d9-46e3-8d15-4d1d17e5b130 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:19.369078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd30679a-00d9-46e3-8d15-4d1d17e5b130 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:19.369981 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd30679a-00d9-46e3-8d15-4d1d17e5b130 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:19.370591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd30679a-00d9-46e3-8d15-4d1d17e5b130 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:19.374739 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd30679a-00d9-46e3-8d15-4d1d17e5b130 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:19.790251 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fd30679a-00d9-46e3-8d15-4d1d17e5b130 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:19.803192 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fd30679a-00d9-46e3-8d15-4d1d17e5b130 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:19.807015 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fd30679a-00d9-46e3-8d15-4d1d17e5b130 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:19.808844 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fd30679a-00d9-46e3-8d15-4d1d17e5b130 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1845 microversion: 2.42 time: 0.461413 Oct 10 18:57:19.809648 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1052/1884] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:19 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1845 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:19.815075 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f6f1210f-64a9-408e-a139-fb8c4f48be86 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:19.816133 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f6f1210f-64a9-408e-a139-fb8c4f48be86 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:19.822818 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f6f1210f-64a9-408e-a139-fb8c4f48be86 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:19.823677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f6f1210f-64a9-408e-a139-fb8c4f48be86 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:19.824425 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f6f1210f-64a9-408e-a139-fb8c4f48be86 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:19.825433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f6f1210f-64a9-408e-a139-fb8c4f48be86 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:19.826122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f6f1210f-64a9-408e-a139-fb8c4f48be86 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:19.827147 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f6f1210f-64a9-408e-a139-fb8c4f48be86 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:19.931958 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3ba7cc7b-4042-4667-8bbc-ce260d6dd4e2 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fcff3ee4700482faa4a53214db748aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107b5e9043cf4f4a94f9d6bce3e0c32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:19.942050 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3ba7cc7b-4042-4667-8bbc-ce260d6dd4e2 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 200 len: 1315 microversion: 2.1 time: 0.674463 Oct 10 18:57:19.945769 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 833/1885] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:19 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 1315 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:20.006239 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:20.025139 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5d59a683-a26d-464a-ab8f-8d6aa01e0c9d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:20.027092 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5d59a683-a26d-464a-ab8f-8d6aa01e0c9d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:20.042491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d59a683-a26d-464a-ab8f-8d6aa01e0c9d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:20.044672 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d59a683-a26d-464a-ab8f-8d6aa01e0c9d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:20.045786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d59a683-a26d-464a-ab8f-8d6aa01e0c9d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:20.047739 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d59a683-a26d-464a-ab8f-8d6aa01e0c9d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:20.050154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d59a683-a26d-464a-ab8f-8d6aa01e0c9d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:20.050819 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d59a683-a26d-464a-ab8f-8d6aa01e0c9d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:20.063048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f6f1210f-64a9-408e-a139-fb8c4f48be86 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:20.075519 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f6f1210f-64a9-408e-a139-fb8c4f48be86 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1315 microversion: 2.1 time: 0.262549 Oct 10 18:57:20.089717 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1053/1886] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:19 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:20.320125 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5d59a683-a26d-464a-ab8f-8d6aa01e0c9d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:20.327102 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1454e3f8-aa16-44f4-a8fd-5132b16b77b7 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca5e31ea-140c-45df-b6eb-ffd98d6f48cc"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:20.330550 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1454e3f8-aa16-44f4-a8fd-5132b16b77b7 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:20.334842 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5d59a683-a26d-464a-ab8f-8d6aa01e0c9d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:20.343492 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5d59a683-a26d-464a-ab8f-8d6aa01e0c9d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:20.345519 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:20.347257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1454e3f8-aa16-44f4-a8fd-5132b16b77b7 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:20.347947 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1454e3f8-aa16-44f4-a8fd-5132b16b77b7 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:20.351401 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1454e3f8-aa16-44f4-a8fd-5132b16b77b7 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:20.352892 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1454e3f8-aa16-44f4-a8fd-5132b16b77b7 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:20.355924 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1454e3f8-aa16-44f4-a8fd-5132b16b77b7 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:20.356589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1454e3f8-aa16-44f4-a8fd-5132b16b77b7 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:20.359948 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5d59a683-a26d-464a-ab8f-8d6aa01e0c9d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.340715 Oct 10 18:57:20.360587 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 834/1887] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:20 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:57:20.843471 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e793dfa8-0fa4-411d-ab1b-50dfdd4593b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:20.844010 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e793dfa8-0fa4-411d-ab1b-50dfdd4593b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:20.850261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e793dfa8-0fa4-411d-ab1b-50dfdd4593b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:20.850746 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e793dfa8-0fa4-411d-ab1b-50dfdd4593b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:20.851545 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e793dfa8-0fa4-411d-ab1b-50dfdd4593b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:20.852862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e793dfa8-0fa4-411d-ab1b-50dfdd4593b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:20.853328 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e793dfa8-0fa4-411d-ab1b-50dfdd4593b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:20.853760 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e793dfa8-0fa4-411d-ab1b-50dfdd4593b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:21.033220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e793dfa8-0fa4-411d-ab1b-50dfdd4593b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:21.043181 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e793dfa8-0fa4-411d-ab1b-50dfdd4593b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:21.045339 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e793dfa8-0fa4-411d-ab1b-50dfdd4593b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:21.046521 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e793dfa8-0fa4-411d-ab1b-50dfdd4593b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1845 microversion: 2.42 time: 0.207193 Oct 10 18:57:21.047200 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 835/1888] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:20 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1845 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:57:21.051808 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-57331646-d0ae-4d22-9269-00f48b7a6a52 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:21.052504 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-57331646-d0ae-4d22-9269-00f48b7a6a52 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:21.058991 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-57331646-d0ae-4d22-9269-00f48b7a6a52 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:21.059545 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-57331646-d0ae-4d22-9269-00f48b7a6a52 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:21.060051 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-57331646-d0ae-4d22-9269-00f48b7a6a52 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:21.060893 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-57331646-d0ae-4d22-9269-00f48b7a6a52 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:21.061414 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-57331646-d0ae-4d22-9269-00f48b7a6a52 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:21.062083 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-57331646-d0ae-4d22-9269-00f48b7a6a52 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:21.216740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:21.379946 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=8 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:21.691850 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=8 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:22.007522 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1454e3f8-aa16-44f4-a8fd-5132b16b77b7 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "POST /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.685882 Oct 10 18:57:22.014804 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1054/1889] 10.222.0.43 () {60 vars in 1323 bytes} [Mon Oct 10 18:57:20 2022] POST /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895/os-volume_attachments => generated 194 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:57:22.021270 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-61cf68b9-0774-412d-92d4-cbdc6017ff70 req-18d6faaf-6436-4d18-bd25-c479d845fe8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d6b5c8-b9fb-4328-ad04-c2d8879f427c", "tag": "64c55d0d-44d3-4a54-b4c4-2eb84dccf030"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:22.043020 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-61cf68b9-0774-412d-92d4-cbdc6017ff70 req-18d6faaf-6436-4d18-bd25-c479d845fe8b service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:22.045785 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-61cf68b9-0774-412d-92d4-cbdc6017ff70 req-18d6faaf-6436-4d18-bd25-c479d845fe8b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:22.046332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-61cf68b9-0774-412d-92d4-cbdc6017ff70 req-18d6faaf-6436-4d18-bd25-c479d845fe8b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:22.069667 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-61cf68b9-0774-412d-92d4-cbdc6017ff70 req-18d6faaf-6436-4d18-bd25-c479d845fe8b service nova] Creating event network-changed:64c55d0d-44d3-4a54-b4c4-2eb84dccf030 for instance d9d6b5c8-b9fb-4328-ad04-c2d8879f427c on n-h2-860863-1 Oct 10 18:57:22.077982 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-61cf68b9-0774-412d-92d4-cbdc6017ff70 req-18d6faaf-6436-4d18-bd25-c479d845fe8b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061273 Oct 10 18:57:22.079600 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1055/1890] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:22.088419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-08f4b861-6641-47c7-b2f9-f292a7a64695 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:22.089445 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-08f4b861-6641-47c7-b2f9-f292a7a64695 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:22.114247 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08f4b861-6641-47c7-b2f9-f292a7a64695 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:22.115671 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08f4b861-6641-47c7-b2f9-f292a7a64695 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:22.116460 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08f4b861-6641-47c7-b2f9-f292a7a64695 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:22.143258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08f4b861-6641-47c7-b2f9-f292a7a64695 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:22.145918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08f4b861-6641-47c7-b2f9-f292a7a64695 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:22.146788 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08f4b861-6641-47c7-b2f9-f292a7a64695 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:22.446819 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-57331646-d0ae-4d22-9269-00f48b7a6a52 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fcff3ee4700482faa4a53214db748aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107b5e9043cf4f4a94f9d6bce3e0c32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:22.480227 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-57331646-d0ae-4d22-9269-00f48b7a6a52 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 200 len: 1315 microversion: 2.1 time: 1.418299 Oct 10 18:57:22.489116 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 836/1891] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:21 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 1315 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:22.505604 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-08f4b861-6641-47c7-b2f9-f292a7a64695 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:22.523055 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-08f4b861-6641-47c7-b2f9-f292a7a64695 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1315 microversion: 2.1 time: 0.441414 Oct 10 18:57:22.529569 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1056/1892] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:22 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:22.534094 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-86dda013-ae2e-45b2-9810-5ab3eae8657b req-18773bb4-4c66-41b9-831f-4cb9248903fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8256637b-2667-49ec-9a24-a81063c7f99e", "tag": "f3464126-5ac2-4204-b63d-48a0e6feed21"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:22.540129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-09adc258-d883-400f-8c33-a1e44bf1f1cd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:22.553194 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-09adc258-d883-400f-8c33-a1e44bf1f1cd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:22.588691 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-86dda013-ae2e-45b2-9810-5ab3eae8657b req-18773bb4-4c66-41b9-831f-4cb9248903fa service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:22.588978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-09adc258-d883-400f-8c33-a1e44bf1f1cd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:22.592625 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-86dda013-ae2e-45b2-9810-5ab3eae8657b req-18773bb4-4c66-41b9-831f-4cb9248903fa service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:22.603440 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-86dda013-ae2e-45b2-9810-5ab3eae8657b req-18773bb4-4c66-41b9-831f-4cb9248903fa service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:22.603558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-09adc258-d883-400f-8c33-a1e44bf1f1cd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:22.603558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-09adc258-d883-400f-8c33-a1e44bf1f1cd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:22.605115 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-09adc258-d883-400f-8c33-a1e44bf1f1cd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:22.605928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-09adc258-d883-400f-8c33-a1e44bf1f1cd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:22.607673 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-09adc258-d883-400f-8c33-a1e44bf1f1cd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:22.651789 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-86dda013-ae2e-45b2-9810-5ab3eae8657b req-18773bb4-4c66-41b9-831f-4cb9248903fa service nova] Creating event network-changed:f3464126-5ac2-4204-b63d-48a0e6feed21 for instance 8256637b-2667-49ec-9a24-a81063c7f99e on n-h2-860863-1 Oct 10 18:57:22.659075 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-86dda013-ae2e-45b2-9810-5ab3eae8657b req-18773bb4-4c66-41b9-831f-4cb9248903fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166066 Oct 10 18:57:22.665244 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 837/1893] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:22.682978 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-510e820b-b92a-4dee-84b1-bfa362ee915a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:22.684883 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-510e820b-b92a-4dee-84b1-bfa362ee915a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:22.704058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-510e820b-b92a-4dee-84b1-bfa362ee915a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:22.706556 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-510e820b-b92a-4dee-84b1-bfa362ee915a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:22.707196 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-510e820b-b92a-4dee-84b1-bfa362ee915a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:22.708103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-510e820b-b92a-4dee-84b1-bfa362ee915a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:22.710696 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-510e820b-b92a-4dee-84b1-bfa362ee915a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:22.714150 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-510e820b-b92a-4dee-84b1-bfa362ee915a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:22.777539 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-09adc258-d883-400f-8c33-a1e44bf1f1cd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:22.789804 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-09adc258-d883-400f-8c33-a1e44bf1f1cd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:22.791307 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-09adc258-d883-400f-8c33-a1e44bf1f1cd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:22.813299 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-09adc258-d883-400f-8c33-a1e44bf1f1cd tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.279866 Oct 10 18:57:22.814226 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1057/1894] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:22 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:23.056364 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1029182971", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:23.147311 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] validate_networks() for None {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:57:23.314934 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-510e820b-b92a-4dee-84b1-bfa362ee915a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:23.328490 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-510e820b-b92a-4dee-84b1-bfa362ee915a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:23.332873 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-510e820b-b92a-4dee-84b1-bfa362ee915a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:23.334077 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-510e820b-b92a-4dee-84b1-bfa362ee915a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1845 microversion: 2.42 time: 0.667476 Oct 10 18:57:23.352928 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 838/1895] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:22 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1845 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:23.510586 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-89f37a23-36bf-41f8-8437-c029e8f9d268 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:23.511592 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-89f37a23-36bf-41f8-8437-c029e8f9d268 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:23.521898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-89f37a23-36bf-41f8-8437-c029e8f9d268 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:23.523771 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-89f37a23-36bf-41f8-8437-c029e8f9d268 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:23.524436 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-89f37a23-36bf-41f8-8437-c029e8f9d268 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:23.534886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-89f37a23-36bf-41f8-8437-c029e8f9d268 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:23.534886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-89f37a23-36bf-41f8-8437-c029e8f9d268 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:23.534886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-89f37a23-36bf-41f8-8437-c029e8f9d268 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:23.597455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:57:23.598100 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:57:23.598608 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:57:23.599296 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:57:23.599913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:57:23.619901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:23.625148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:23.625890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:23.627549 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:23.629102 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:23.631083 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:23.696952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Getting quotas for project b3e646a2c4854a3ca9fad749182efd62. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:57:23.714177 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Getting quotas for user 0795d65cfa274841a7d2c4c2fb90f13a and project b3e646a2c4854a3ca9fad749182efd62. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:57:23.731282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:57:23.741514 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:57:23.911595 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-26648419-8b59-4e89-9ff8-d09b2e518152 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063169 Oct 10 18:57:23.916024 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1058/1896] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:57:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 18:57:23.932229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fa19dc45-90c7-4aa0-8757-b8927ddd1b25 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:23.936554 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fa19dc45-90c7-4aa0-8757-b8927ddd1b25 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:23.969331 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa19dc45-90c7-4aa0-8757-b8927ddd1b25 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:23.969331 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa19dc45-90c7-4aa0-8757-b8927ddd1b25 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:23.969331 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa19dc45-90c7-4aa0-8757-b8927ddd1b25 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:23.969331 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa19dc45-90c7-4aa0-8757-b8927ddd1b25 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:23.969331 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa19dc45-90c7-4aa0-8757-b8927ddd1b25 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:23.974738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa19dc45-90c7-4aa0-8757-b8927ddd1b25 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:24.335190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fa19dc45-90c7-4aa0-8757-b8927ddd1b25 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:24.347774 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fa19dc45-90c7-4aa0-8757-b8927ddd1b25 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1315 microversion: 2.1 time: 0.429457 Oct 10 18:57:24.358470 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1059/1897] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:23 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:24.374210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6da1d616-a388-4eb7-9add-a53bb9ae8d1b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:24.374829 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6da1d616-a388-4eb7-9add-a53bb9ae8d1b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:24.397608 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6da1d616-a388-4eb7-9add-a53bb9ae8d1b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:24.398102 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6da1d616-a388-4eb7-9add-a53bb9ae8d1b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:24.404875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6da1d616-a388-4eb7-9add-a53bb9ae8d1b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:24.405726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6da1d616-a388-4eb7-9add-a53bb9ae8d1b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:24.409070 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6da1d616-a388-4eb7-9add-a53bb9ae8d1b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:24.409942 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6da1d616-a388-4eb7-9add-a53bb9ae8d1b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:24.527643 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6da1d616-a388-4eb7-9add-a53bb9ae8d1b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:24.558610 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-89f37a23-36bf-41f8-8437-c029e8f9d268 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fcff3ee4700482faa4a53214db748aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107b5e9043cf4f4a94f9d6bce3e0c32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:24.568361 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6da1d616-a388-4eb7-9add-a53bb9ae8d1b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:24.573645 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-89f37a23-36bf-41f8-8437-c029e8f9d268 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 200 len: 1315 microversion: 2.1 time: 1.064517 Oct 10 18:57:24.576819 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 839/1898] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:23 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 1315 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:57:24.590439 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b067dc6d-25ff-4af0-85cb-bc3b6962df20 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:24.597158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6da1d616-a388-4eb7-9add-a53bb9ae8d1b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:24.597766 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b067dc6d-25ff-4af0-85cb-bc3b6962df20 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:24.623480 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6da1d616-a388-4eb7-9add-a53bb9ae8d1b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.261765 Oct 10 18:57:24.628388 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1060/1899] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:24 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:24.637816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ba3f0906-383f-4781-9927-eaf9f65915ca tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:24.648798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ba3f0906-383f-4781-9927-eaf9f65915ca tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:24.682076 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba3f0906-383f-4781-9927-eaf9f65915ca tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:24.684018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba3f0906-383f-4781-9927-eaf9f65915ca tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:24.692774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba3f0906-383f-4781-9927-eaf9f65915ca tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:24.696803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba3f0906-383f-4781-9927-eaf9f65915ca tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:24.696803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba3f0906-383f-4781-9927-eaf9f65915ca tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:24.696803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba3f0906-383f-4781-9927-eaf9f65915ca tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:24.794088 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b067dc6d-25ff-4af0-85cb-bc3b6962df20 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:24.801887 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b067dc6d-25ff-4af0-85cb-bc3b6962df20 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1217 microversion: 2.1 time: 0.222876 Oct 10 18:57:24.804010 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 840/1900] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:24 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1217 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:24.822407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-34bda171-e802-4305-90ce-ccd23d09f30e req-efb62584-8231-4d79-9adb-40d11209ad5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "tag": "d3835300-20da-488f-97b2-b41044bdcd24"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:24.850714 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-34bda171-e802-4305-90ce-ccd23d09f30e req-efb62584-8231-4d79-9adb-40d11209ad5e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:24.854225 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-34bda171-e802-4305-90ce-ccd23d09f30e req-efb62584-8231-4d79-9adb-40d11209ad5e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:24.859269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-34bda171-e802-4305-90ce-ccd23d09f30e req-efb62584-8231-4d79-9adb-40d11209ad5e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:24.886378 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-34bda171-e802-4305-90ce-ccd23d09f30e req-efb62584-8231-4d79-9adb-40d11209ad5e service nova] Creating event network-changed:d3835300-20da-488f-97b2-b41044bdcd24 for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:57:24.899614 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-34bda171-e802-4305-90ce-ccd23d09f30e req-efb62584-8231-4d79-9adb-40d11209ad5e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087852 Oct 10 18:57:24.902628 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 841/1901] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:25.162985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ba3f0906-383f-4781-9927-eaf9f65915ca tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:25.197888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ba3f0906-383f-4781-9927-eaf9f65915ca tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:25.203962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ba3f0906-383f-4781-9927-eaf9f65915ca tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:25.208298 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ba3f0906-383f-4781-9927-eaf9f65915ca tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1866 microversion: 2.42 time: 0.578774 Oct 10 18:57:25.235398 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1061/1902] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:24 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1866 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:25.379962 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3db07be3-7be3-44a5-b2e8-501493336b09 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:25.380949 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3db07be3-7be3-44a5-b2e8-501493336b09 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:25.389197 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3db07be3-7be3-44a5-b2e8-501493336b09 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:25.390214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3db07be3-7be3-44a5-b2e8-501493336b09 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:25.391865 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3db07be3-7be3-44a5-b2e8-501493336b09 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:25.392937 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3db07be3-7be3-44a5-b2e8-501493336b09 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:25.399720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3db07be3-7be3-44a5-b2e8-501493336b09 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:25.400365 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3db07be3-7be3-44a5-b2e8-501493336b09 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:25.601681 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-79940210-2da2-4707-9561-db6f77956856 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:25.602389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-79940210-2da2-4707-9561-db6f77956856 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:25.614671 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79940210-2da2-4707-9561-db6f77956856 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:25.616986 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79940210-2da2-4707-9561-db6f77956856 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:25.617474 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79940210-2da2-4707-9561-db6f77956856 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:25.621227 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79940210-2da2-4707-9561-db6f77956856 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:25.621813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79940210-2da2-4707-9561-db6f77956856 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:25.622261 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79940210-2da2-4707-9561-db6f77956856 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:25.727909 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3db07be3-7be3-44a5-b2e8-501493336b09 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:25.761220 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3db07be3-7be3-44a5-b2e8-501493336b09 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1315 microversion: 2.1 time: 0.369648 Oct 10 18:57:25.766932 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 842/1903] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:25 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:25.774511 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7cc2c249-480f-4f8b-b3fc-5fd42e522716 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:25.775122 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7cc2c249-480f-4f8b-b3fc-5fd42e522716 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:25.811260 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7cc2c249-480f-4f8b-b3fc-5fd42e522716 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:25.812109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7cc2c249-480f-4f8b-b3fc-5fd42e522716 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:25.812847 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7cc2c249-480f-4f8b-b3fc-5fd42e522716 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:25.813825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7cc2c249-480f-4f8b-b3fc-5fd42e522716 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:25.814510 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7cc2c249-480f-4f8b-b3fc-5fd42e522716 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:25.817200 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7cc2c249-480f-4f8b-b3fc-5fd42e522716 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:25.836605 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:DELETE=2,nova_cell1:SELECT=98 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:25.998698 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7cc2c249-480f-4f8b-b3fc-5fd42e522716 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:26.014061 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7cc2c249-480f-4f8b-b3fc-5fd42e522716 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:26.015739 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-79940210-2da2-4707-9561-db6f77956856 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fcff3ee4700482faa4a53214db748aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107b5e9043cf4f4a94f9d6bce3e0c32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:26.016241 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7cc2c249-480f-4f8b-b3fc-5fd42e522716 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:26.023275 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7cc2c249-480f-4f8b-b3fc-5fd42e522716 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.260270 Oct 10 18:57:26.023915 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 843/1904] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:25 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:26.029985 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-79940210-2da2-4707-9561-db6f77956856 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 200 len: 1315 microversion: 2.1 time: 0.430922 Oct 10 18:57:26.032956 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1062/1905] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:25 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:57:26.072830 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6a916607-7eac-4c46-a125-40a15a784e29 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:26.077199 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6a916607-7eac-4c46-a125-40a15a784e29 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:26.090320 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a916607-7eac-4c46-a125-40a15a784e29 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:26.093127 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a916607-7eac-4c46-a125-40a15a784e29 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:26.093782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a916607-7eac-4c46-a125-40a15a784e29 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:26.105645 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a916607-7eac-4c46-a125-40a15a784e29 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:26.106519 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a916607-7eac-4c46-a125-40a15a784e29 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:26.107221 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a916607-7eac-4c46-a125-40a15a784e29 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:26.240478 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5108e623-8a66-49fa-bd17-69470544f940 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:26.241947 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5108e623-8a66-49fa-bd17-69470544f940 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:26.251378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5108e623-8a66-49fa-bd17-69470544f940 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:26.252444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5108e623-8a66-49fa-bd17-69470544f940 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:26.253874 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5108e623-8a66-49fa-bd17-69470544f940 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:26.255364 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5108e623-8a66-49fa-bd17-69470544f940 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:26.256048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5108e623-8a66-49fa-bd17-69470544f940 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:26.256804 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5108e623-8a66-49fa-bd17-69470544f940 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:26.260158 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6a916607-7eac-4c46-a125-40a15a784e29 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:26.274015 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6a916607-7eac-4c46-a125-40a15a784e29 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1221 microversion: 2.1 time: 0.216194 Oct 10 18:57:26.289563 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 844/1906] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:26 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1221 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:26.604290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5108e623-8a66-49fa-bd17-69470544f940 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:26.608235 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:26.620035 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5108e623-8a66-49fa-bd17-69470544f940 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:26.622710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5108e623-8a66-49fa-bd17-69470544f940 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:26.625974 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5108e623-8a66-49fa-bd17-69470544f940 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1866 microversion: 2.42 time: 0.390146 Oct 10 18:57:26.632635 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1063/1907] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:26 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1866 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:26.788313 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-64c0bca4-d130-4df7-98ac-428568727643 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:26.790779 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-64c0bca4-d130-4df7-98ac-428568727643 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:26.802726 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64c0bca4-d130-4df7-98ac-428568727643 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:26.803547 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64c0bca4-d130-4df7-98ac-428568727643 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:26.805322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64c0bca4-d130-4df7-98ac-428568727643 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:26.810589 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64c0bca4-d130-4df7-98ac-428568727643 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:26.811301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64c0bca4-d130-4df7-98ac-428568727643 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:26.815476 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64c0bca4-d130-4df7-98ac-428568727643 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:26.955704 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-374d7779-ebcf-40b3-8290-1e08aae1d195 req-9a732564-23c7-4b02-b7e4-f8114a4bdbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "tag": "b06ba07e-b1b2-4d01-8143-4688336bd7d5"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:26.979506 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-374d7779-ebcf-40b3-8290-1e08aae1d195 req-9a732564-23c7-4b02-b7e4-f8114a4bdbd9 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:26.983035 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-374d7779-ebcf-40b3-8290-1e08aae1d195 req-9a732564-23c7-4b02-b7e4-f8114a4bdbd9 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:26.983881 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-374d7779-ebcf-40b3-8290-1e08aae1d195 req-9a732564-23c7-4b02-b7e4-f8114a4bdbd9 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:27.016307 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-374d7779-ebcf-40b3-8290-1e08aae1d195 req-9a732564-23c7-4b02-b7e4-f8114a4bdbd9 service nova] Creating event network-changed:b06ba07e-b1b2-4d01-8143-4688336bd7d5 for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:57:27.031150 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-374d7779-ebcf-40b3-8290-1e08aae1d195 req-9a732564-23c7-4b02-b7e4-f8114a4bdbd9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078114 Oct 10 18:57:27.031602 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1064/1908] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:27.060640 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-87f7447a-0483-4d4c-9955-928e495c6d36 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:27.062182 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-87f7447a-0483-4d4c-9955-928e495c6d36 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:27.076872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-87f7447a-0483-4d4c-9955-928e495c6d36 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:27.078273 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-87f7447a-0483-4d4c-9955-928e495c6d36 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:27.080358 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-87f7447a-0483-4d4c-9955-928e495c6d36 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:27.081264 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-87f7447a-0483-4d4c-9955-928e495c6d36 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:27.083485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-87f7447a-0483-4d4c-9955-928e495c6d36 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:27.084058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-87f7447a-0483-4d4c-9955-928e495c6d36 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:27.417424 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-87f7447a-0483-4d4c-9955-928e495c6d36 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fcff3ee4700482faa4a53214db748aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107b5e9043cf4f4a94f9d6bce3e0c32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:27.431252 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-87f7447a-0483-4d4c-9955-928e495c6d36 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 200 len: 1315 microversion: 2.1 time: 0.375096 Oct 10 18:57:27.431878 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1065/1909] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:27 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:27.440377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-78bad00b-41eb-4925-9b01-0939a028fbee tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:27.443065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-78bad00b-41eb-4925-9b01-0939a028fbee tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:27.451387 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-64c0bca4-d130-4df7-98ac-428568727643 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:27.464846 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-78bad00b-41eb-4925-9b01-0939a028fbee tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:27.465367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-78bad00b-41eb-4925-9b01-0939a028fbee tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:27.465784 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-78bad00b-41eb-4925-9b01-0939a028fbee tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:27.466507 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-78bad00b-41eb-4925-9b01-0939a028fbee tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:27.466858 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-64c0bca4-d130-4df7-98ac-428568727643 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1315 microversion: 2.1 time: 0.683747 Oct 10 18:57:27.469240 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-78bad00b-41eb-4925-9b01-0939a028fbee tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:27.471580 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-78bad00b-41eb-4925-9b01-0939a028fbee tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:27.481746 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 845/1910] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:26 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:27.493350 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ee16e56a-887c-49b8-a026-5a75f83ed6d8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:27.496997 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ee16e56a-887c-49b8-a026-5a75f83ed6d8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:27.510101 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ee16e56a-887c-49b8-a026-5a75f83ed6d8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:27.510870 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ee16e56a-887c-49b8-a026-5a75f83ed6d8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:27.511467 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ee16e56a-887c-49b8-a026-5a75f83ed6d8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:27.514302 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ee16e56a-887c-49b8-a026-5a75f83ed6d8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:27.514977 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ee16e56a-887c-49b8-a026-5a75f83ed6d8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:27.515966 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ee16e56a-887c-49b8-a026-5a75f83ed6d8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:27.853145 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-78bad00b-41eb-4925-9b01-0939a028fbee tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:27.873781 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-78bad00b-41eb-4925-9b01-0939a028fbee tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:27.885924 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-78bad00b-41eb-4925-9b01-0939a028fbee tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:27.908611 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-78bad00b-41eb-4925-9b01-0939a028fbee tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.475195 Oct 10 18:57:27.909454 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1066/1911] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:27 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:27.928980 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-7309b361-df91-42b9-b6ca-4ef8ab0a8040 req-d1cb6d1f-ee55-419d-8096-d9d455fcb5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "tag": "e9beeca4-6e86-4e0e-8cdf-8cecd637d4b7"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:27.959574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-7309b361-df91-42b9-b6ca-4ef8ab0a8040 req-d1cb6d1f-ee55-419d-8096-d9d455fcb5c4 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:27.960065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-7309b361-df91-42b9-b6ca-4ef8ab0a8040 req-d1cb6d1f-ee55-419d-8096-d9d455fcb5c4 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:27.960501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-7309b361-df91-42b9-b6ca-4ef8ab0a8040 req-d1cb6d1f-ee55-419d-8096-d9d455fcb5c4 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:27.972888 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-7309b361-df91-42b9-b6ca-4ef8ab0a8040 req-d1cb6d1f-ee55-419d-8096-d9d455fcb5c4 service nova] Creating event network-changed:e9beeca4-6e86-4e0e-8cdf-8cecd637d4b7 for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:57:27.978974 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-7309b361-df91-42b9-b6ca-4ef8ab0a8040 req-d1cb6d1f-ee55-419d-8096-d9d455fcb5c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064706 Oct 10 18:57:27.980032 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1067/1912] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:27.986027 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-548af642-2fde-4426-97b0-fd407fce8bc1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:27.986960 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-548af642-2fde-4426-97b0-fd407fce8bc1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:27.995376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-548af642-2fde-4426-97b0-fd407fce8bc1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:27.997100 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-548af642-2fde-4426-97b0-fd407fce8bc1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:27.997757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-548af642-2fde-4426-97b0-fd407fce8bc1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:27.998941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-548af642-2fde-4426-97b0-fd407fce8bc1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:27.999648 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-548af642-2fde-4426-97b0-fd407fce8bc1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:28.000291 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-548af642-2fde-4426-97b0-fd407fce8bc1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:28.068209 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ee16e56a-887c-49b8-a026-5a75f83ed6d8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:28.081565 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ee16e56a-887c-49b8-a026-5a75f83ed6d8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1277 microversion: 2.1 time: 0.595484 Oct 10 18:57:28.082593 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 846/1913] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:27 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1277 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:28.326702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-548af642-2fde-4426-97b0-fd407fce8bc1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:28.332390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-0b6db0e3-2adf-42d6-a78c-1bdb061d7f31 req-cd963f70-d7fc-43ca-a666-d11545282934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d6b5c8-b9fb-4328-ad04-c2d8879f427c", "name": "network-vif-plugged", "status": "completed", "tag": "64c55d0d-44d3-4a54-b4c4-2eb84dccf030"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:28.366828 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-0b6db0e3-2adf-42d6-a78c-1bdb061d7f31 req-cd963f70-d7fc-43ca-a666-d11545282934 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:28.367362 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-0b6db0e3-2adf-42d6-a78c-1bdb061d7f31 req-cd963f70-d7fc-43ca-a666-d11545282934 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:28.367795 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-0b6db0e3-2adf-42d6-a78c-1bdb061d7f31 req-cd963f70-d7fc-43ca-a666-d11545282934 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:28.374328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-548af642-2fde-4426-97b0-fd407fce8bc1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:28.376018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-548af642-2fde-4426-97b0-fd407fce8bc1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:28.377262 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-548af642-2fde-4426-97b0-fd407fce8bc1 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1887 microversion: 2.42 time: 0.395611 Oct 10 18:57:28.382794 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1068/1914] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:27 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1887 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:28.408896 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-0b6db0e3-2adf-42d6-a78c-1bdb061d7f31 req-cd963f70-d7fc-43ca-a666-d11545282934 service nova] Creating event network-vif-plugged:64c55d0d-44d3-4a54-b4c4-2eb84dccf030 for instance d9d6b5c8-b9fb-4328-ad04-c2d8879f427c on n-h2-860863-1 Oct 10 18:57:28.421785 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-0b6db0e3-2adf-42d6-a78c-1bdb061d7f31 req-cd963f70-d7fc-43ca-a666-d11545282934 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092983 Oct 10 18:57:28.427712 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 847/1915] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:28.454961 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-79d12dc5-01e0-4e3c-a0ef-373ca6c1e09d tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:28.455880 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-79d12dc5-01e0-4e3c-a0ef-373ca6c1e09d tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:28.468691 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79d12dc5-01e0-4e3c-a0ef-373ca6c1e09d tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:28.469196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79d12dc5-01e0-4e3c-a0ef-373ca6c1e09d tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:28.469635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79d12dc5-01e0-4e3c-a0ef-373ca6c1e09d tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:28.473666 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79d12dc5-01e0-4e3c-a0ef-373ca6c1e09d tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:28.474154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79d12dc5-01e0-4e3c-a0ef-373ca6c1e09d tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:28.480132 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79d12dc5-01e0-4e3c-a0ef-373ca6c1e09d tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:28.495221 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0f69ec53-356a-4509-baac-a734e35d101e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:28.496251 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0f69ec53-356a-4509-baac-a734e35d101e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:28.516504 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f69ec53-356a-4509-baac-a734e35d101e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:28.517254 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f69ec53-356a-4509-baac-a734e35d101e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:28.518283 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f69ec53-356a-4509-baac-a734e35d101e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:28.521059 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f69ec53-356a-4509-baac-a734e35d101e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:28.526182 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f69ec53-356a-4509-baac-a734e35d101e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:28.527997 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f69ec53-356a-4509-baac-a734e35d101e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:29.244164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0f69ec53-356a-4509-baac-a734e35d101e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:29.255498 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0f69ec53-356a-4509-baac-a734e35d101e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1315 microversion: 2.1 time: 0.762071 Oct 10 18:57:29.256149 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 848/1916] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:28 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:29.297078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-81179ccb-0901-4131-8029-7d4aeec68d54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:29.300099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-81179ccb-0901-4131-8029-7d4aeec68d54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:29.307573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-81179ccb-0901-4131-8029-7d4aeec68d54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:29.308382 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-81179ccb-0901-4131-8029-7d4aeec68d54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:29.309117 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-81179ccb-0901-4131-8029-7d4aeec68d54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:29.310082 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-81179ccb-0901-4131-8029-7d4aeec68d54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:29.310707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-81179ccb-0901-4131-8029-7d4aeec68d54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:29.311439 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-81179ccb-0901-4131-8029-7d4aeec68d54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:29.492224 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-81179ccb-0901-4131-8029-7d4aeec68d54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:29.502450 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-81179ccb-0901-4131-8029-7d4aeec68d54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:29.504153 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-81179ccb-0901-4131-8029-7d4aeec68d54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:29.510162 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-81179ccb-0901-4131-8029-7d4aeec68d54 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.218784 Oct 10 18:57:29.511337 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 849/1917] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:29 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:29.516243 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d82df948-e02d-4994-b673-1db0a8456cb4 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:29.517160 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d82df948-e02d-4994-b673-1db0a8456cb4 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:29.523772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d82df948-e02d-4994-b673-1db0a8456cb4 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:29.524256 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d82df948-e02d-4994-b673-1db0a8456cb4 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:29.524734 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d82df948-e02d-4994-b673-1db0a8456cb4 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:29.525448 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d82df948-e02d-4994-b673-1db0a8456cb4 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:29.525923 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d82df948-e02d-4994-b673-1db0a8456cb4 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:29.526311 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d82df948-e02d-4994-b673-1db0a8456cb4 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:29.565232 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-79d12dc5-01e0-4e3c-a0ef-373ca6c1e09d tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fcff3ee4700482faa4a53214db748aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107b5e9043cf4f4a94f9d6bce3e0c32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:29.578094 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-79d12dc5-01e0-4e3c-a0ef-373ca6c1e09d tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 200 len: 1315 microversion: 2.1 time: 1.127271 Oct 10 18:57:29.603165 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1069/1918] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:28 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 1315 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:29.608395 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ea63858f-4177-4e83-8bca-188aa7a52267 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:29.609043 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ea63858f-4177-4e83-8bca-188aa7a52267 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:29.630857 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea63858f-4177-4e83-8bca-188aa7a52267 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:29.631943 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea63858f-4177-4e83-8bca-188aa7a52267 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:29.632434 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea63858f-4177-4e83-8bca-188aa7a52267 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:29.636856 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea63858f-4177-4e83-8bca-188aa7a52267 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:29.638210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea63858f-4177-4e83-8bca-188aa7a52267 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:29.638940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea63858f-4177-4e83-8bca-188aa7a52267 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:29.775140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d82df948-e02d-4994-b673-1db0a8456cb4 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:29.788087 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d82df948-e02d-4994-b673-1db0a8456cb4 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1275 microversion: 2.1 time: 0.275434 Oct 10 18:57:29.798252 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 850/1919] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:29 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1275 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:30.130480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ea63858f-4177-4e83-8bca-188aa7a52267 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:30.155353 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ea63858f-4177-4e83-8bca-188aa7a52267 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:30.156835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ea63858f-4177-4e83-8bca-188aa7a52267 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:30.158014 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ea63858f-4177-4e83-8bca-188aa7a52267 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1887 microversion: 2.42 time: 0.553756 Oct 10 18:57:30.158565 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1070/1920] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:29 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1887 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:30.282490 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-45e059f8-e4f3-459e-bceb-fda8dc4e54e1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:30.282490 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-45e059f8-e4f3-459e-bceb-fda8dc4e54e1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:30.293744 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45e059f8-e4f3-459e-bceb-fda8dc4e54e1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:30.294499 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45e059f8-e4f3-459e-bceb-fda8dc4e54e1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:30.296687 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45e059f8-e4f3-459e-bceb-fda8dc4e54e1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:30.298568 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45e059f8-e4f3-459e-bceb-fda8dc4e54e1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:30.299917 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45e059f8-e4f3-459e-bceb-fda8dc4e54e1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:30.305529 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45e059f8-e4f3-459e-bceb-fda8dc4e54e1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:30.463754 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-84777cd8-8bee-4dee-b29f-482289f4b39a req-8eb276c5-84e5-4e50-85f1-01fa627c1eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8256637b-2667-49ec-9a24-a81063c7f99e", "name": "network-vif-plugged", "status": "completed", "tag": "f3464126-5ac2-4204-b63d-48a0e6feed21"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:30.479359 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-84777cd8-8bee-4dee-b29f-482289f4b39a req-8eb276c5-84e5-4e50-85f1-01fa627c1eaa service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:30.479836 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-84777cd8-8bee-4dee-b29f-482289f4b39a req-8eb276c5-84e5-4e50-85f1-01fa627c1eaa service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:30.480261 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-84777cd8-8bee-4dee-b29f-482289f4b39a req-8eb276c5-84e5-4e50-85f1-01fa627c1eaa service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:30.508868 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-84777cd8-8bee-4dee-b29f-482289f4b39a req-8eb276c5-84e5-4e50-85f1-01fa627c1eaa service nova] Creating event network-vif-plugged:f3464126-5ac2-4204-b63d-48a0e6feed21 for instance 8256637b-2667-49ec-9a24-a81063c7f99e on n-h2-860863-1 Oct 10 18:57:30.522434 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-84777cd8-8bee-4dee-b29f-482289f4b39a req-8eb276c5-84e5-4e50-85f1-01fa627c1eaa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065181 Oct 10 18:57:30.524594 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1071/1921] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:57:30.543254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b12549c4-1969-4111-bf2c-ff7b3aa8af17 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:30.544340 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b12549c4-1969-4111-bf2c-ff7b3aa8af17 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:30.556224 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b12549c4-1969-4111-bf2c-ff7b3aa8af17 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:30.558731 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b12549c4-1969-4111-bf2c-ff7b3aa8af17 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:30.561102 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b12549c4-1969-4111-bf2c-ff7b3aa8af17 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:30.562136 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b12549c4-1969-4111-bf2c-ff7b3aa8af17 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:30.565116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b12549c4-1969-4111-bf2c-ff7b3aa8af17 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:30.578518 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b12549c4-1969-4111-bf2c-ff7b3aa8af17 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:30.710356 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-45e059f8-e4f3-459e-bceb-fda8dc4e54e1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:30.736673 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-45e059f8-e4f3-459e-bceb-fda8dc4e54e1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1315 microversion: 2.1 time: 0.459685 Oct 10 18:57:30.737281 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 851/1922] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:30 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:30.760809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9e89c93c-fc42-4589-bf7d-baaaf868e4f4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:30.761547 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9e89c93c-fc42-4589-bf7d-baaaf868e4f4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:30.782716 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e89c93c-fc42-4589-bf7d-baaaf868e4f4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:30.783249 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e89c93c-fc42-4589-bf7d-baaaf868e4f4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:30.783694 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e89c93c-fc42-4589-bf7d-baaaf868e4f4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:30.789483 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e89c93c-fc42-4589-bf7d-baaaf868e4f4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:30.791351 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e89c93c-fc42-4589-bf7d-baaaf868e4f4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:30.795017 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e89c93c-fc42-4589-bf7d-baaaf868e4f4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:30.951129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b12549c4-1969-4111-bf2c-ff7b3aa8af17 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:30.966979 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b12549c4-1969-4111-bf2c-ff7b3aa8af17 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:30.971501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b12549c4-1969-4111-bf2c-ff7b3aa8af17 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:31.005121 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b12549c4-1969-4111-bf2c-ff7b3aa8af17 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.451632 Oct 10 18:57:31.005121 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1072/1923] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:30 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:57:31.005121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8917cf2e-d19a-4560-a5c7-0227aff93cf3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:31.006328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8917cf2e-d19a-4560-a5c7-0227aff93cf3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:31.013884 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8917cf2e-d19a-4560-a5c7-0227aff93cf3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:31.014721 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8917cf2e-d19a-4560-a5c7-0227aff93cf3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:31.015343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8917cf2e-d19a-4560-a5c7-0227aff93cf3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:31.016234 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8917cf2e-d19a-4560-a5c7-0227aff93cf3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:31.016959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8917cf2e-d19a-4560-a5c7-0227aff93cf3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:31.017774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8917cf2e-d19a-4560-a5c7-0227aff93cf3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:31.119730 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9e89c93c-fc42-4589-bf7d-baaaf868e4f4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fcff3ee4700482faa4a53214db748aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107b5e9043cf4f4a94f9d6bce3e0c32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:31.130319 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9e89c93c-fc42-4589-bf7d-baaaf868e4f4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 200 len: 1503 microversion: 2.1 time: 0.389331 Oct 10 18:57:31.131195 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 852/1924] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:30 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 1503 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:31.137455 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-057e6013-3a45-4414-807f-d35cbe02ed9c req-43e9be77-b877-4986-8b25-6fa13f3b8d6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "tag": "99d576b1-bb4c-4046-a5bb-d295c4cf071a"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:31.158012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-057e6013-3a45-4414-807f-d35cbe02ed9c req-43e9be77-b877-4986-8b25-6fa13f3b8d6d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:31.164965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-057e6013-3a45-4414-807f-d35cbe02ed9c req-43e9be77-b877-4986-8b25-6fa13f3b8d6d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:31.164965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-057e6013-3a45-4414-807f-d35cbe02ed9c req-43e9be77-b877-4986-8b25-6fa13f3b8d6d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:31.165213 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8917cf2e-d19a-4560-a5c7-0227aff93cf3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:31.182267 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-057e6013-3a45-4414-807f-d35cbe02ed9c req-43e9be77-b877-4986-8b25-6fa13f3b8d6d service nova] Creating event network-changed:99d576b1-bb4c-4046-a5bb-d295c4cf071a for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:57:31.189718 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-057e6013-3a45-4414-807f-d35cbe02ed9c req-43e9be77-b877-4986-8b25-6fa13f3b8d6d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056925 Oct 10 18:57:31.190599 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 853/1925] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:31.191486 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8917cf2e-d19a-4560-a5c7-0227aff93cf3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1275 microversion: 2.1 time: 0.196600 Oct 10 18:57:31.192075 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1073/1926] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:30 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:31.197169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-569d9096-78d2-4f57-aebf-98cea21d78c4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:31.198294 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-569d9096-78d2-4f57-aebf-98cea21d78c4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:31.204577 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-55080d63-66f9-4b91-a2a3-180f7f883890 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:31.205948 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-569d9096-78d2-4f57-aebf-98cea21d78c4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:31.206627 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-569d9096-78d2-4f57-aebf-98cea21d78c4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:31.206848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-55080d63-66f9-4b91-a2a3-180f7f883890 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:31.207494 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-569d9096-78d2-4f57-aebf-98cea21d78c4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:31.208366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-569d9096-78d2-4f57-aebf-98cea21d78c4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:31.209682 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-569d9096-78d2-4f57-aebf-98cea21d78c4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:31.210751 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-569d9096-78d2-4f57-aebf-98cea21d78c4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:31.237444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55080d63-66f9-4b91-a2a3-180f7f883890 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:31.238178 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55080d63-66f9-4b91-a2a3-180f7f883890 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:31.238971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55080d63-66f9-4b91-a2a3-180f7f883890 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:31.239847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55080d63-66f9-4b91-a2a3-180f7f883890 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:31.241079 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55080d63-66f9-4b91-a2a3-180f7f883890 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:31.255252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55080d63-66f9-4b91-a2a3-180f7f883890 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:31.572774 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-569d9096-78d2-4f57-aebf-98cea21d78c4 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.380446 Oct 10 18:57:31.575335 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 854/1927] 10.222.0.43 () {58 vars in 1296 bytes} [Mon Oct 10 18:57:31 2022] DELETE /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c/os-server-password => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:57:31.592797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-103b5194-ecf4-44ca-8dea-20e5c3eb13cb tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:31.593323 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-103b5194-ecf4-44ca-8dea-20e5c3eb13cb tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:31.604043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-103b5194-ecf4-44ca-8dea-20e5c3eb13cb tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:31.604396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-103b5194-ecf4-44ca-8dea-20e5c3eb13cb tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:31.604941 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-103b5194-ecf4-44ca-8dea-20e5c3eb13cb tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:31.607441 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-103b5194-ecf4-44ca-8dea-20e5c3eb13cb tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:31.608993 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-103b5194-ecf4-44ca-8dea-20e5c3eb13cb tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:31.609456 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-103b5194-ecf4-44ca-8dea-20e5c3eb13cb tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:31.688304 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-103b5194-ecf4-44ca-8dea-20e5c3eb13cb tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.102823 Oct 10 18:57:31.689278 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 855/1928] 10.222.0.43 () {58 vars in 1293 bytes} [Mon Oct 10 18:57:31 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c/os-server-password => generated 16 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:57:31.699494 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b14892e7-2349-4946-8f06-b8ef811c22af tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:31.699998 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b14892e7-2349-4946-8f06-b8ef811c22af tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:31.709019 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b14892e7-2349-4946-8f06-b8ef811c22af tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:31.709506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b14892e7-2349-4946-8f06-b8ef811c22af tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:31.709935 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b14892e7-2349-4946-8f06-b8ef811c22af tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:31.710759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b14892e7-2349-4946-8f06-b8ef811c22af tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:31.711837 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b14892e7-2349-4946-8f06-b8ef811c22af tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:31.712301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b14892e7-2349-4946-8f06-b8ef811c22af tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:31.758958 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b14892e7-2349-4946-8f06-b8ef811c22af tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:57:32.105837 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:32.194471 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55080d63-66f9-4b91-a2a3-180f7f883890 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:32.231713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55080d63-66f9-4b91-a2a3-180f7f883890 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:32.233605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55080d63-66f9-4b91-a2a3-180f7f883890 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:32.235056 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-55080d63-66f9-4b91-a2a3-180f7f883890 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1887 microversion: 2.42 time: 1.041467 Oct 10 18:57:32.235939 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1074/1929] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:31 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1887 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:32.240318 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b14892e7-2349-4946-8f06-b8ef811c22af tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 204 len: 0 microversion: 2.1 time: 0.544997 Oct 10 18:57:32.241022 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 856/1930] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:57:31 2022] DELETE /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 18:57:32.243257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-64c402ac-0862-4acb-9a25-837a839dad5f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:32.246376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-64c402ac-0862-4acb-9a25-837a839dad5f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:32.246963 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-eb1c4dbc-33d1-49ee-a21f-1a4eee4d7891 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:32.247695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-eb1c4dbc-33d1-49ee-a21f-1a4eee4d7891 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:32.254386 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64c402ac-0862-4acb-9a25-837a839dad5f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:32.254890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64c402ac-0862-4acb-9a25-837a839dad5f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:32.255341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64c402ac-0862-4acb-9a25-837a839dad5f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:32.256248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64c402ac-0862-4acb-9a25-837a839dad5f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:32.256775 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64c402ac-0862-4acb-9a25-837a839dad5f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:32.257451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64c402ac-0862-4acb-9a25-837a839dad5f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:32.266346 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb1c4dbc-33d1-49ee-a21f-1a4eee4d7891 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:32.266844 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb1c4dbc-33d1-49ee-a21f-1a4eee4d7891 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:32.267297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb1c4dbc-33d1-49ee-a21f-1a4eee4d7891 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:32.268000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb1c4dbc-33d1-49ee-a21f-1a4eee4d7891 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:32.268459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb1c4dbc-33d1-49ee-a21f-1a4eee4d7891 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:32.278611 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb1c4dbc-33d1-49ee-a21f-1a4eee4d7891 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:32.444940 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-eb1c4dbc-33d1-49ee-a21f-1a4eee4d7891 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:32.454978 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-eb1c4dbc-33d1-49ee-a21f-1a4eee4d7891 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:32.456753 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-eb1c4dbc-33d1-49ee-a21f-1a4eee4d7891 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:32.467857 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-eb1c4dbc-33d1-49ee-a21f-1a4eee4d7891 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.225619 Oct 10 18:57:32.468380 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 857/1931] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:32 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:32.484688 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ff6cc97e-c376-47eb-b1f5-e6079273a600 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:32.485587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ff6cc97e-c376-47eb-b1f5-e6079273a600 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:32.494322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ff6cc97e-c376-47eb-b1f5-e6079273a600 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:32.494805 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ff6cc97e-c376-47eb-b1f5-e6079273a600 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:32.495240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ff6cc97e-c376-47eb-b1f5-e6079273a600 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:32.495957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ff6cc97e-c376-47eb-b1f5-e6079273a600 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:32.496415 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ff6cc97e-c376-47eb-b1f5-e6079273a600 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:32.503349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ff6cc97e-c376-47eb-b1f5-e6079273a600 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:32.547304 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:32.751688 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-64c402ac-0862-4acb-9a25-837a839dad5f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:32.765979 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-64c402ac-0862-4acb-9a25-837a839dad5f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1315 microversion: 2.1 time: 0.527836 Oct 10 18:57:32.766932 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1075/1932] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:32 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:32.776519 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-50c3af4f-95a9-4db2-b30c-b324cf9fbc78 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:32.778222 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-50c3af4f-95a9-4db2-b30c-b324cf9fbc78 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:32.801227 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ff6cc97e-c376-47eb-b1f5-e6079273a600 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:32.809169 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50c3af4f-95a9-4db2-b30c-b324cf9fbc78 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:32.810666 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50c3af4f-95a9-4db2-b30c-b324cf9fbc78 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:32.813020 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50c3af4f-95a9-4db2-b30c-b324cf9fbc78 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:32.814957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50c3af4f-95a9-4db2-b30c-b324cf9fbc78 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:32.815699 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50c3af4f-95a9-4db2-b30c-b324cf9fbc78 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:32.816160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50c3af4f-95a9-4db2-b30c-b324cf9fbc78 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:32.820342 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ff6cc97e-c376-47eb-b1f5-e6079273a600 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1317 microversion: 2.1 time: 0.350815 Oct 10 18:57:32.829223 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 858/1933] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:32 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:32.970323 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f736e6a5-aef2-4d8a-be9e-4d8478336264 tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] Action: 'create', calling method: .version_select at 0x7f31922d1af0>, body: {"pool": null} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:33.245700 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-50c3af4f-95a9-4db2-b30c-b324cf9fbc78 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fcff3ee4700482faa4a53214db748aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107b5e9043cf4f4a94f9d6bce3e0c32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:33.263845 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-50c3af4f-95a9-4db2-b30c-b324cf9fbc78 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 200 len: 1509 microversion: 2.1 time: 0.494763 Oct 10 18:57:33.264762 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1076/1934] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:32 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 1509 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:33.269579 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bc9eec96-7e92-4fe6-bbe5-d107e6682674 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:33.270418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bc9eec96-7e92-4fe6-bbe5-d107e6682674 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:33.288613 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc9eec96-7e92-4fe6-bbe5-d107e6682674 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:33.289861 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc9eec96-7e92-4fe6-bbe5-d107e6682674 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:33.290522 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc9eec96-7e92-4fe6-bbe5-d107e6682674 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:33.291442 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc9eec96-7e92-4fe6-bbe5-d107e6682674 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:33.292094 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc9eec96-7e92-4fe6-bbe5-d107e6682674 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:33.292761 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc9eec96-7e92-4fe6-bbe5-d107e6682674 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:33.636866 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bc9eec96-7e92-4fe6-bbe5-d107e6682674 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:33.660218 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bc9eec96-7e92-4fe6-bbe5-d107e6682674 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:33.661717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bc9eec96-7e92-4fe6-bbe5-d107e6682674 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:33.663025 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bc9eec96-7e92-4fe6-bbe5-d107e6682674 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1887 microversion: 2.42 time: 0.397084 Oct 10 18:57:33.663984 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1077/1935] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:33 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1887 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:33.669207 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1ca982b0-2a27-4e04-8011-3c466b17214d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:33.669814 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1ca982b0-2a27-4e04-8011-3c466b17214d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:33.685450 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:33.687424 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ca982b0-2a27-4e04-8011-3c466b17214d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:33.688242 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ca982b0-2a27-4e04-8011-3c466b17214d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:33.689303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ca982b0-2a27-4e04-8011-3c466b17214d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:33.690060 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ca982b0-2a27-4e04-8011-3c466b17214d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:33.690526 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ca982b0-2a27-4e04-8011-3c466b17214d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:33.690952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ca982b0-2a27-4e04-8011-3c466b17214d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:33.730935 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=6 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:33.822943 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1ca982b0-2a27-4e04-8011-3c466b17214d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:33.841882 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1ca982b0-2a27-4e04-8011-3c466b17214d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:33.843347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1ca982b0-2a27-4e04-8011-3c466b17214d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:33.851945 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1ca982b0-2a27-4e04-8011-3c466b17214d tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1560 microversion: 2.91 time: 0.186159 Oct 10 18:57:33.852686 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1078/1936] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:33 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:33.858224 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c344e262-6865-4f35-bb02-b2def08b7d18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:33.858848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c344e262-6865-4f35-bb02-b2def08b7d18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:33.867811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c344e262-6865-4f35-bb02-b2def08b7d18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:33.868468 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c344e262-6865-4f35-bb02-b2def08b7d18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:33.868946 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c344e262-6865-4f35-bb02-b2def08b7d18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:33.869862 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c344e262-6865-4f35-bb02-b2def08b7d18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:33.870540 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c344e262-6865-4f35-bb02-b2def08b7d18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:33.871159 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c344e262-6865-4f35-bb02-b2def08b7d18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:34.160825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c344e262-6865-4f35-bb02-b2def08b7d18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:34.174767 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c344e262-6865-4f35-bb02-b2def08b7d18 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1503 microversion: 2.1 time: 0.320763 Oct 10 18:57:34.175632 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1079/1937] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:33 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:34.188378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fc7cd645-a79c-40f7-b2f7-79f249acf780 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:34.192334 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fc7cd645-a79c-40f7-b2f7-79f249acf780 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:34.206254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fc7cd645-a79c-40f7-b2f7-79f249acf780 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:34.207907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fc7cd645-a79c-40f7-b2f7-79f249acf780 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:34.208361 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fc7cd645-a79c-40f7-b2f7-79f249acf780 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:34.209116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fc7cd645-a79c-40f7-b2f7-79f249acf780 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:34.209575 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fc7cd645-a79c-40f7-b2f7-79f249acf780 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:34.212370 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fc7cd645-a79c-40f7-b2f7-79f249acf780 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:34.566182 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fc7cd645-a79c-40f7-b2f7-79f249acf780 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:34.577788 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fc7cd645-a79c-40f7-b2f7-79f249acf780 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1317 microversion: 2.1 time: 0.398685 Oct 10 18:57:34.578707 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1080/1938] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:34 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:34.587575 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-8221214d-6ad9-464e-989a-f3d0680fba9f req-2bba2a7c-86a9-4096-a9c8-4422dfd63acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "tag": "973a75cc-00b3-43e5-a2d6-eaeb4c2f27ac"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:34.611434 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8221214d-6ad9-464e-989a-f3d0680fba9f req-2bba2a7c-86a9-4096-a9c8-4422dfd63acd service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:34.617081 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8221214d-6ad9-464e-989a-f3d0680fba9f req-2bba2a7c-86a9-4096-a9c8-4422dfd63acd service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:34.618096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8221214d-6ad9-464e-989a-f3d0680fba9f req-2bba2a7c-86a9-4096-a9c8-4422dfd63acd service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:34.639735 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-8221214d-6ad9-464e-989a-f3d0680fba9f req-2bba2a7c-86a9-4096-a9c8-4422dfd63acd service nova] Creating event network-changed:973a75cc-00b3-43e5-a2d6-eaeb4c2f27ac for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:57:34.644382 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-8221214d-6ad9-464e-989a-f3d0680fba9f req-2bba2a7c-86a9-4096-a9c8-4422dfd63acd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060845 Oct 10 18:57:34.645318 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1081/1939] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:34.662914 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-00912fbb-6ca8-4994-9a8a-e2d597054082 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:34.678332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00912fbb-6ca8-4994-9a8a-e2d597054082 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:34.678823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00912fbb-6ca8-4994-9a8a-e2d597054082 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:34.679257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00912fbb-6ca8-4994-9a8a-e2d597054082 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:34.780627 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-00912fbb-6ca8-4994-9a8a-e2d597054082 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Going to try to stop instance {{(pid=127288) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 18:57:34.798849 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:34.806907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:35.048096 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-00912fbb-6ca8-4994-9a8a-e2d597054082 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "POST /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e/action" status: 202 len: 0 microversion: 2.1 time: 0.400573 Oct 10 18:57:35.049372 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1082/1940] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:57:34 2022] POST /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:57:35.064596 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e8adcfa3-5e30-4bf3-9a2e-a529916739c3 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:35.068965 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e8adcfa3-5e30-4bf3-9a2e-a529916739c3 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:35.131079 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8adcfa3-5e30-4bf3-9a2e-a529916739c3 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:35.134559 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8adcfa3-5e30-4bf3-9a2e-a529916739c3 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:35.135009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8adcfa3-5e30-4bf3-9a2e-a529916739c3 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:35.145726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8adcfa3-5e30-4bf3-9a2e-a529916739c3 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:35.149030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8adcfa3-5e30-4bf3-9a2e-a529916739c3 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:35.149492 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8adcfa3-5e30-4bf3-9a2e-a529916739c3 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:35.562418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e8adcfa3-5e30-4bf3-9a2e-a529916739c3 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fcff3ee4700482faa4a53214db748aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107b5e9043cf4f4a94f9d6bce3e0c32f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:35.577909 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e8adcfa3-5e30-4bf3-9a2e-a529916739c3 tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 200 len: 1509 microversion: 2.1 time: 0.526736 Oct 10 18:57:35.580704 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1083/1941] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:35 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 1509 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:35.597642 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6d770cfa-bb80-4bae-802a-b6f1379f1d7d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:35.597642 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6d770cfa-bb80-4bae-802a-b6f1379f1d7d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:35.635312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d770cfa-bb80-4bae-802a-b6f1379f1d7d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:35.644587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d770cfa-bb80-4bae-802a-b6f1379f1d7d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:35.644587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d770cfa-bb80-4bae-802a-b6f1379f1d7d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:35.644587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d770cfa-bb80-4bae-802a-b6f1379f1d7d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:35.644587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d770cfa-bb80-4bae-802a-b6f1379f1d7d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:35.644587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d770cfa-bb80-4bae-802a-b6f1379f1d7d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:36.200373 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6d770cfa-bb80-4bae-802a-b6f1379f1d7d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:36.219825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6d770cfa-bb80-4bae-802a-b6f1379f1d7d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:36.223658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6d770cfa-bb80-4bae-802a-b6f1379f1d7d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:36.228041 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6d770cfa-bb80-4bae-802a-b6f1379f1d7d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1887 microversion: 2.42 time: 0.645856 Oct 10 18:57:36.228894 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1084/1942] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:35 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1887 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:36.236332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-aa233e77-15c5-41d2-bbd0-3d01f99c2fc6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:36.240383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-aa233e77-15c5-41d2-bbd0-3d01f99c2fc6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:36.277693 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-aa233e77-15c5-41d2-bbd0-3d01f99c2fc6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:36.278193 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-aa233e77-15c5-41d2-bbd0-3d01f99c2fc6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:36.278617 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-aa233e77-15c5-41d2-bbd0-3d01f99c2fc6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:36.286535 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-aa233e77-15c5-41d2-bbd0-3d01f99c2fc6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:36.287140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-aa233e77-15c5-41d2-bbd0-3d01f99c2fc6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:36.287615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-aa233e77-15c5-41d2-bbd0-3d01f99c2fc6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:36.587771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-aa233e77-15c5-41d2-bbd0-3d01f99c2fc6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:36.627135 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-aa233e77-15c5-41d2-bbd0-3d01f99c2fc6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:36.631306 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-aa233e77-15c5-41d2-bbd0-3d01f99c2fc6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:36.675031 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-aa233e77-15c5-41d2-bbd0-3d01f99c2fc6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.442253 Oct 10 18:57:36.676114 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1085/1943] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:36 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:36.684722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ad62037a-9fdc-4f7b-b500-85dd2fec7bf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:36.685878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ad62037a-9fdc-4f7b-b500-85dd2fec7bf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:36.720309 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ad62037a-9fdc-4f7b-b500-85dd2fec7bf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:36.722041 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ad62037a-9fdc-4f7b-b500-85dd2fec7bf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:36.722554 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ad62037a-9fdc-4f7b-b500-85dd2fec7bf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:36.724975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ad62037a-9fdc-4f7b-b500-85dd2fec7bf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:36.728990 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ad62037a-9fdc-4f7b-b500-85dd2fec7bf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:36.731772 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ad62037a-9fdc-4f7b-b500-85dd2fec7bf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:37.155348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ad62037a-9fdc-4f7b-b500-85dd2fec7bf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:37.171071 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ad62037a-9fdc-4f7b-b500-85dd2fec7bf0 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1513 microversion: 2.1 time: 0.493608 Oct 10 18:57:37.200583 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1086/1944] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:36 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1513 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:37.204029 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7a517cf8-7bbf-489c-bf1d-e4211ac40465 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:37.205767 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7a517cf8-7bbf-489c-bf1d-e4211ac40465 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:37.229493 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a517cf8-7bbf-489c-bf1d-e4211ac40465 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:37.235913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a517cf8-7bbf-489c-bf1d-e4211ac40465 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:37.236642 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a517cf8-7bbf-489c-bf1d-e4211ac40465 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:37.237579 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a517cf8-7bbf-489c-bf1d-e4211ac40465 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:37.238202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a517cf8-7bbf-489c-bf1d-e4211ac40465 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:37.243179 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a517cf8-7bbf-489c-bf1d-e4211ac40465 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:37.557282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7a517cf8-7bbf-489c-bf1d-e4211ac40465 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:37.562530 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7a517cf8-7bbf-489c-bf1d-e4211ac40465 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1317 microversion: 2.1 time: 0.369597 Oct 10 18:57:37.563831 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1087/1945] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:37 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:37.570034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-982fbf70-fac0-428a-81ca-288b0a485f54 req-90e742ed-0ce3-48e2-bf87-4d741ee92cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d6b5c8-b9fb-4328-ad04-c2d8879f427c", "name": "network-vif-deleted", "tag": "64c55d0d-44d3-4a54-b4c4-2eb84dccf030"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:37.591018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-982fbf70-fac0-428a-81ca-288b0a485f54 req-90e742ed-0ce3-48e2-bf87-4d741ee92cd3 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:37.593632 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-982fbf70-fac0-428a-81ca-288b0a485f54 req-90e742ed-0ce3-48e2-bf87-4d741ee92cd3 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:37.594200 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-982fbf70-fac0-428a-81ca-288b0a485f54 req-90e742ed-0ce3-48e2-bf87-4d741ee92cd3 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:37.616136 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-982fbf70-fac0-428a-81ca-288b0a485f54 req-90e742ed-0ce3-48e2-bf87-4d741ee92cd3 service nova] Creating event network-vif-deleted:64c55d0d-44d3-4a54-b4c4-2eb84dccf030 for instance d9d6b5c8-b9fb-4328-ad04-c2d8879f427c on n-h2-860863-1 Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-982fbf70-fac0-428a-81ca-288b0a485f54 req-90e742ed-0ce3-48e2-bf87-4d741ee92cd3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057148 Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1088/1946] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2a8f257a-8f30-459c-b1dd-68233ecce8df tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2a8f257a-8f30-459c-b1dd-68233ecce8df tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] [instance: d9d6b5c8-b9fb-4328-ad04-c2d8879f427c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a8f257a-8f30-459c-b1dd-68233ecce8df tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a8f257a-8f30-459c-b1dd-68233ecce8df tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a8f257a-8f30-459c-b1dd-68233ecce8df tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a8f257a-8f30-459c-b1dd-68233ecce8df tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a8f257a-8f30-459c-b1dd-68233ecce8df tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2a8f257a-8f30-459c-b1dd-68233ecce8df tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-2a8f257a-8f30-459c-b1dd-68233ecce8df tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] HTTP exception thrown: Instance d9d6b5c8-b9fb-4328-ad04-c2d8879f427c could not be found. Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2a8f257a-8f30-459c-b1dd-68233ecce8df tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Request method failure captured: Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c HTTP/1.1 Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGsERJs9s6ykPUBs_x_O7v-Ro1rNSZg2ZAAy7eTGxT8-yMVTMmikRfJce_oLgkrATwcsBMvsm25BBgOdicqp3opF6IxMcDFH_Rx4g7t5s1PELaI5mCbQ0CVpKzXwym2bWtgvAoy8DJCFW4j1vB3civOefic2qa7qqQ7JFSCPynGFSjg Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 107b5e9043cf4f4a94f9d6bce3e0c32f Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServerPasswordTestJSON-1639295564 Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:57:37.699722 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_107b5e9043cf4f4a94f9d6bce3e0c32f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/107b5e9043cf4f4a94f9d6bce3e0c32f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/107b5e9043cf4f4a94f9d6bce3e0c32f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/107b5e9043cf4f4a94f9d6bce3e0c32f"}]}] Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServerPasswordTestJSON-1639295564 Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 107b5e9043cf4f4a94f9d6bce3e0c32f Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1639295564 Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServerPasswordTestJSON-1639295564-project Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 9fcff3ee4700482faa4a53214db748aa Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServerPasswordTestJSON-1639295564-project Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance d9d6b5c8-b9fb-4328-ad04-c2d8879f427c could not be found. Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'd9d6b5c8-b9fb-4328-ad04-c2d8879f427c'} Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d6b5c8-b9fb-4328-ad04-c2d8879f427c could not be found. Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d6b5c8-b9fb-4328-ad04-c2d8879f427c could not be found. Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d6b5c8-b9fb-4328-ad04-c2d8879f427c could not be found. Oct 10 18:57:37.702841 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:37.709338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2a8f257a-8f30-459c-b1dd-68233ecce8df tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] Returning 404 to user: Instance d9d6b5c8-b9fb-4328-ad04-c2d8879f427c could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:57:37.709338 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2a8f257a-8f30-459c-b1dd-68233ecce8df tempest-ServerPasswordTestJSON-1639295564 tempest-ServerPasswordTestJSON-1639295564-project] 10.222.0.43 "GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c" status: 404 len: 111 microversion: 2.1 time: 0.045365 Oct 10 18:57:37.709338 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1089/1947] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:37 2022] GET /compute/v2.1/servers/d9d6b5c8-b9fb-4328-ad04-c2d8879f427c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:57:37.709338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-4a7527a3-35be-4a60-b292-2143501c33f8 req-16f81c69-ff1c-474c-92de-a32eab4b6cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23440a72-5db4-4da8-8af0-176166843949", "tag": "e6382291-a00e-49b0-905a-3ea8adf9eb83"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:37.709338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4a7527a3-35be-4a60-b292-2143501c33f8 req-16f81c69-ff1c-474c-92de-a32eab4b6cad service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:37.709338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4a7527a3-35be-4a60-b292-2143501c33f8 req-16f81c69-ff1c-474c-92de-a32eab4b6cad service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:37.710471 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4a7527a3-35be-4a60-b292-2143501c33f8 req-16f81c69-ff1c-474c-92de-a32eab4b6cad service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:37.758467 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-4a7527a3-35be-4a60-b292-2143501c33f8 req-16f81c69-ff1c-474c-92de-a32eab4b6cad service nova] Creating event network-changed:e6382291-a00e-49b0-905a-3ea8adf9eb83 for instance 23440a72-5db4-4da8-8af0-176166843949 on n-h1-860863-1 Oct 10 18:57:37.769739 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-4a7527a3-35be-4a60-b292-2143501c33f8 req-16f81c69-ff1c-474c-92de-a32eab4b6cad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089144 Oct 10 18:57:37.771229 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1090/1948] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:37.784332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-92264403-d972-465e-8e66-30364667bb32 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:37.787710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-92264403-d972-465e-8e66-30364667bb32 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:37.800716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:37.802523 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92264403-d972-465e-8e66-30364667bb32 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:37.803048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92264403-d972-465e-8e66-30364667bb32 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:37.803485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92264403-d972-465e-8e66-30364667bb32 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:37.811367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92264403-d972-465e-8e66-30364667bb32 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:37.812697 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92264403-d972-465e-8e66-30364667bb32 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:37.830915 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92264403-d972-465e-8e66-30364667bb32 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:37.905010 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f736e6a5-aef2-4d8a-be9e-4d8478336264 tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.007144 Oct 10 18:57:37.906848 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 859/1949] 10.222.0.43 () {60 vars in 1170 bytes} [Mon Oct 10 18:57:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:37.919210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-599775e0-9e08-4f71-911f-91fc94e13f10 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:37.920809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-599775e0-9e08-4f71-911f-91fc94e13f10 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:37.955242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-599775e0-9e08-4f71-911f-91fc94e13f10 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:37.958257 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-599775e0-9e08-4f71-911f-91fc94e13f10 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:37.960157 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-599775e0-9e08-4f71-911f-91fc94e13f10 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:37.962496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-599775e0-9e08-4f71-911f-91fc94e13f10 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:37.963332 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-599775e0-9e08-4f71-911f-91fc94e13f10 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:37.965818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-599775e0-9e08-4f71-911f-91fc94e13f10 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:38.216210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-599775e0-9e08-4f71-911f-91fc94e13f10 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:38.227883 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-599775e0-9e08-4f71-911f-91fc94e13f10 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:38.231424 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-599775e0-9e08-4f71-911f-91fc94e13f10 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:38.239394 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-599775e0-9e08-4f71-911f-91fc94e13f10 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.331303 Oct 10 18:57:38.253986 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 860/1950] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:37 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:38.269794 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f9ebab34-3b8a-4ac5-ad04-4db08ff0a180 tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] Calling method '.version_select at 0x7f31922d1310>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:38.701283 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f9ebab34-3b8a-4ac5-ad04-4db08ff0a180 tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/4188a41e-a42f-4187-9881-e57f97cad699" status: 200 len: 142 microversion: 2.1 time: 0.445255 Oct 10 18:57:38.701971 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 861/1951] 10.222.0.43 () {58 vars in 1260 bytes} [Mon Oct 10 18:57:38 2022] GET /compute/v2.1/os-floating-ips/4188a41e-a42f-4187-9881-e57f97cad699 => generated 142 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:38.706993 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-df393284-e6e9-4197-bad5-f0249ed8644a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:38.709943 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-df393284-e6e9-4197-bad5-f0249ed8644a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:38.740091 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-df393284-e6e9-4197-bad5-f0249ed8644a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:38.741904 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-df393284-e6e9-4197-bad5-f0249ed8644a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:38.741904 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-df393284-e6e9-4197-bad5-f0249ed8644a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:38.743969 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-df393284-e6e9-4197-bad5-f0249ed8644a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:38.744673 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-df393284-e6e9-4197-bad5-f0249ed8644a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:38.745297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-df393284-e6e9-4197-bad5-f0249ed8644a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:38.903242 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-92264403-d972-465e-8e66-30364667bb32 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:38.922986 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-92264403-d972-465e-8e66-30364667bb32 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:38.925820 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-92264403-d972-465e-8e66-30364667bb32 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:38.930578 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-92264403-d972-465e-8e66-30364667bb32 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1887 microversion: 2.42 time: 1.158108 Oct 10 18:57:38.949322 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1091/1952] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:37 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1887 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:38.968636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a640b986-3d2b-41d3-9998-ad840e9d8fb5 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:38.968636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a640b986-3d2b-41d3-9998-ad840e9d8fb5 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:38.975825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a640b986-3d2b-41d3-9998-ad840e9d8fb5 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:38.976796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a640b986-3d2b-41d3-9998-ad840e9d8fb5 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:38.977592 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a640b986-3d2b-41d3-9998-ad840e9d8fb5 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:38.978688 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a640b986-3d2b-41d3-9998-ad840e9d8fb5 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:38.979399 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a640b986-3d2b-41d3-9998-ad840e9d8fb5 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:38.980054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a640b986-3d2b-41d3-9998-ad840e9d8fb5 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:39.131042 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-df393284-e6e9-4197-bad5-f0249ed8644a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:39.140008 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-df393284-e6e9-4197-bad5-f0249ed8644a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1513 microversion: 2.1 time: 0.436687 Oct 10 18:57:39.163351 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 862/1953] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:38 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1513 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:39.167774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f06aaa7e-0f8a-472f-95cb-8f7e6232cf2d tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] Calling method '.version_select at 0x7f31922d1e50>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:39.259001 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a640b986-3d2b-41d3-9998-ad840e9d8fb5 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:39.267302 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a640b986-3d2b-41d3-9998-ad840e9d8fb5 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1317 microversion: 2.1 time: 0.305837 Oct 10 18:57:39.280514 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1092/1954] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:38 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:39.286043 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a2fe0d4f-5549-43cc-b02e-e2b28531c35b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:39.286840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a2fe0d4f-5549-43cc-b02e-e2b28531c35b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:39.302888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a2fe0d4f-5549-43cc-b02e-e2b28531c35b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:39.303974 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a2fe0d4f-5549-43cc-b02e-e2b28531c35b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:39.306327 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a2fe0d4f-5549-43cc-b02e-e2b28531c35b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:39.307296 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a2fe0d4f-5549-43cc-b02e-e2b28531c35b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:39.307927 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a2fe0d4f-5549-43cc-b02e-e2b28531c35b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:39.310392 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a2fe0d4f-5549-43cc-b02e-e2b28531c35b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:39.420783 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f06aaa7e-0f8a-472f-95cb-8f7e6232cf2d tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.257797 Oct 10 18:57:39.430171 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 863/1955] 10.222.0.43 () {58 vars in 1149 bytes} [Mon Oct 10 18:57:39 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:39.437301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0df17b65-b41a-4558-8888-d4592ebef965 tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] Calling method '.version_select at 0x7f31922f8160>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:39.472208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a2fe0d4f-5549-43cc-b02e-e2b28531c35b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:39.487720 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a2fe0d4f-5549-43cc-b02e-e2b28531c35b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:39.493281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a2fe0d4f-5549-43cc-b02e-e2b28531c35b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:39.508355 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a2fe0d4f-5549-43cc-b02e-e2b28531c35b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.226518 Oct 10 18:57:39.508977 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1093/1956] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:39 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:39.806332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-b03b1619-fda3-4c55-9438-512a18d46ea2 req-87814096-a9b9-43fc-a896-fd2f113dd3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "tag": "15af13d2-db21-43e2-bb38-312a65d341c0"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:39.822053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b03b1619-fda3-4c55-9438-512a18d46ea2 req-87814096-a9b9-43fc-a896-fd2f113dd3a8 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:39.822053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b03b1619-fda3-4c55-9438-512a18d46ea2 req-87814096-a9b9-43fc-a896-fd2f113dd3a8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:39.823086 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b03b1619-fda3-4c55-9438-512a18d46ea2 req-87814096-a9b9-43fc-a896-fd2f113dd3a8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:39.853745 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-b03b1619-fda3-4c55-9438-512a18d46ea2 req-87814096-a9b9-43fc-a896-fd2f113dd3a8 service nova] Creating event network-changed:15af13d2-db21-43e2-bb38-312a65d341c0 for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:57:39.868899 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-b03b1619-fda3-4c55-9438-512a18d46ea2 req-87814096-a9b9-43fc-a896-fd2f113dd3a8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066593 Oct 10 18:57:39.870511 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1094/1957] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:39.973594 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-684fce6c-3604-4af8-95fb-356126046754 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:39.975078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-684fce6c-3604-4af8-95fb-356126046754 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:39.984928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-684fce6c-3604-4af8-95fb-356126046754 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:39.994762 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-684fce6c-3604-4af8-95fb-356126046754 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:39.995600 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-684fce6c-3604-4af8-95fb-356126046754 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:39.996659 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-684fce6c-3604-4af8-95fb-356126046754 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:39.997418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-684fce6c-3604-4af8-95fb-356126046754 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:39.998096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-684fce6c-3604-4af8-95fb-356126046754 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:40.647793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-684fce6c-3604-4af8-95fb-356126046754 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:40.679086 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-684fce6c-3604-4af8-95fb-356126046754 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:40.684370 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-684fce6c-3604-4af8-95fb-356126046754 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:40.685963 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-684fce6c-3604-4af8-95fb-356126046754 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1887 microversion: 2.42 time: 0.717225 Oct 10 18:57:40.689025 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1095/1958] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:39 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1887 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:57:40.704797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c6df6fe0-ff1c-4ff0-aea7-c3708973404f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:40.704797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c6df6fe0-ff1c-4ff0-aea7-c3708973404f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:40.712552 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6df6fe0-ff1c-4ff0-aea7-c3708973404f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:40.716447 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6df6fe0-ff1c-4ff0-aea7-c3708973404f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:40.716447 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6df6fe0-ff1c-4ff0-aea7-c3708973404f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:40.717305 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6df6fe0-ff1c-4ff0-aea7-c3708973404f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:40.717835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6df6fe0-ff1c-4ff0-aea7-c3708973404f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:40.719293 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6df6fe0-ff1c-4ff0-aea7-c3708973404f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:40.963645 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0df17b65-b41a-4558-8888-d4592ebef965 tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/4188a41e-a42f-4187-9881-e57f97cad699" status: 202 len: 0 microversion: 2.1 time: 1.531327 Oct 10 18:57:40.971752 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 864/1959] 10.222.0.43 () {58 vars in 1263 bytes} [Mon Oct 10 18:57:39 2022] DELETE /compute/v2.1/os-floating-ips/4188a41e-a42f-4187-9881-e57f97cad699 => generated 0 bytes in 1534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:57:40.979650 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-784f19c5-7c14-4ff1-b9cc-71c0e5dd0387 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:40.983307 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-784f19c5-7c14-4ff1-b9cc-71c0e5dd0387 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:41.002525 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-784f19c5-7c14-4ff1-b9cc-71c0e5dd0387 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:41.006368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-784f19c5-7c14-4ff1-b9cc-71c0e5dd0387 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:41.006368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-784f19c5-7c14-4ff1-b9cc-71c0e5dd0387 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:41.006368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-784f19c5-7c14-4ff1-b9cc-71c0e5dd0387 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:41.006368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-784f19c5-7c14-4ff1-b9cc-71c0e5dd0387 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:41.007101 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-784f19c5-7c14-4ff1-b9cc-71c0e5dd0387 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:41.311099 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c6df6fe0-ff1c-4ff0-aea7-c3708973404f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:41.329341 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c6df6fe0-ff1c-4ff0-aea7-c3708973404f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1513 microversion: 2.1 time: 0.637334 Oct 10 18:57:41.356597 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1096/1960] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:40 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1513 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:41.366239 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-dcf6fa3c-6f6f-45da-82a6-111523bf1684 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:41.369753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-dcf6fa3c-6f6f-45da-82a6-111523bf1684 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:41.393346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dcf6fa3c-6f6f-45da-82a6-111523bf1684 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:41.398086 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dcf6fa3c-6f6f-45da-82a6-111523bf1684 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:41.399561 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dcf6fa3c-6f6f-45da-82a6-111523bf1684 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:41.400529 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dcf6fa3c-6f6f-45da-82a6-111523bf1684 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:41.418016 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dcf6fa3c-6f6f-45da-82a6-111523bf1684 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:41.421688 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dcf6fa3c-6f6f-45da-82a6-111523bf1684 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:41.447840 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-784f19c5-7c14-4ff1-b9cc-71c0e5dd0387 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:41.464383 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-784f19c5-7c14-4ff1-b9cc-71c0e5dd0387 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1317 microversion: 2.1 time: 0.497616 Oct 10 18:57:41.469088 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 865/1961] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:40 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:41.488678 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e89e6fb3-a9a7-4782-adf1-89919e52835c tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] Action: 'create', calling method: .version_select at 0x7f31922d1ca0>, body: {"pool": null} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:41.580640 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dcf6fa3c-6f6f-45da-82a6-111523bf1684 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:41.600366 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dcf6fa3c-6f6f-45da-82a6-111523bf1684 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:41.602040 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dcf6fa3c-6f6f-45da-82a6-111523bf1684 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:41.618812 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-dcf6fa3c-6f6f-45da-82a6-111523bf1684 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.257439 Oct 10 18:57:41.619422 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1097/1962] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:41 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:41.721844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-850ec70b-6f12-41f9-9a8f-9e63c2766318 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:41.722478 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-850ec70b-6f12-41f9-9a8f-9e63c2766318 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:41.746482 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-850ec70b-6f12-41f9-9a8f-9e63c2766318 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:41.747031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-850ec70b-6f12-41f9-9a8f-9e63c2766318 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:41.750205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-850ec70b-6f12-41f9-9a8f-9e63c2766318 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:41.751092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-850ec70b-6f12-41f9-9a8f-9e63c2766318 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:41.753703 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-850ec70b-6f12-41f9-9a8f-9e63c2766318 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:41.754182 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-850ec70b-6f12-41f9-9a8f-9e63c2766318 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:42.510283 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-850ec70b-6f12-41f9-9a8f-9e63c2766318 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:42.528836 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-850ec70b-6f12-41f9-9a8f-9e63c2766318 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:42.534229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-850ec70b-6f12-41f9-9a8f-9e63c2766318 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:42.538535 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-850ec70b-6f12-41f9-9a8f-9e63c2766318 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.822313 Oct 10 18:57:42.562818 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1098/1963] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:41 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:57:42.593971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-a93a7bf9-b7b3-45cc-99c1-df1244036270 req-ff0a37f5-750d-4f37-ba47-737585950f59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "tag": "0f2bd971-89f9-416b-bad4-152c02c746fb"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:42.628374 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-a93a7bf9-b7b3-45cc-99c1-df1244036270 req-ff0a37f5-750d-4f37-ba47-737585950f59 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:42.631433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-a93a7bf9-b7b3-45cc-99c1-df1244036270 req-ff0a37f5-750d-4f37-ba47-737585950f59 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:42.634501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-a93a7bf9-b7b3-45cc-99c1-df1244036270 req-ff0a37f5-750d-4f37-ba47-737585950f59 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:42.667694 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-a93a7bf9-b7b3-45cc-99c1-df1244036270 req-ff0a37f5-750d-4f37-ba47-737585950f59 service nova] Creating event network-changed:0f2bd971-89f9-416b-bad4-152c02c746fb for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:57:42.680043 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-a93a7bf9-b7b3-45cc-99c1-df1244036270 req-ff0a37f5-750d-4f37-ba47-737585950f59 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112189 Oct 10 18:57:42.682509 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1099/1964] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:42.697899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3253a607-2f31-4900-a9a3-f502db4d275e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:42.701304 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3253a607-2f31-4900-a9a3-f502db4d275e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:42.712243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3253a607-2f31-4900-a9a3-f502db4d275e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:42.713127 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3253a607-2f31-4900-a9a3-f502db4d275e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:42.716771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3253a607-2f31-4900-a9a3-f502db4d275e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:42.716771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3253a607-2f31-4900-a9a3-f502db4d275e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:42.716771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3253a607-2f31-4900-a9a3-f502db4d275e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:42.716771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3253a607-2f31-4900-a9a3-f502db4d275e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:43.189451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3253a607-2f31-4900-a9a3-f502db4d275e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:43.203804 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3253a607-2f31-4900-a9a3-f502db4d275e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1513 microversion: 2.1 time: 0.519649 Oct 10 18:57:43.216754 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1100/1965] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:42 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1513 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:43.216754 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-41bc7af4-ffd6-4a79-a2bd-61c63a76cc83 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:43.216754 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-41bc7af4-ffd6-4a79-a2bd-61c63a76cc83 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:43.240620 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41bc7af4-ffd6-4a79-a2bd-61c63a76cc83 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:43.241099 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41bc7af4-ffd6-4a79-a2bd-61c63a76cc83 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:43.243723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41bc7af4-ffd6-4a79-a2bd-61c63a76cc83 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:43.245254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41bc7af4-ffd6-4a79-a2bd-61c63a76cc83 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:43.253297 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41bc7af4-ffd6-4a79-a2bd-61c63a76cc83 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:43.255423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-41bc7af4-ffd6-4a79-a2bd-61c63a76cc83 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:43.748899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-41bc7af4-ffd6-4a79-a2bd-61c63a76cc83 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:43.748899 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-41bc7af4-ffd6-4a79-a2bd-61c63a76cc83 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1317 microversion: 2.1 time: 0.511094 Oct 10 18:57:43.748899 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1101/1966] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:43 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:43.748899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9fa5ad90-b3f1-422f-a2fb-9af124c4f7b1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:43.748899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9fa5ad90-b3f1-422f-a2fb-9af124c4f7b1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:43.748899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9fa5ad90-b3f1-422f-a2fb-9af124c4f7b1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:43.748899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9fa5ad90-b3f1-422f-a2fb-9af124c4f7b1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:43.748899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9fa5ad90-b3f1-422f-a2fb-9af124c4f7b1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:43.748899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9fa5ad90-b3f1-422f-a2fb-9af124c4f7b1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:43.748899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9fa5ad90-b3f1-422f-a2fb-9af124c4f7b1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:43.748899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9fa5ad90-b3f1-422f-a2fb-9af124c4f7b1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:43.761403 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:43.838990 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9fa5ad90-b3f1-422f-a2fb-9af124c4f7b1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:43.849690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9fa5ad90-b3f1-422f-a2fb-9af124c4f7b1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:43.851152 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9fa5ad90-b3f1-422f-a2fb-9af124c4f7b1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:43.865028 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9fa5ad90-b3f1-422f-a2fb-9af124c4f7b1 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.139796 Oct 10 18:57:43.865028 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1102/1967] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:43 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:43.872802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-56057e4d-ece0-4833-b62f-fbae9e98b480 req-4585772b-0bc5-4be1-9041-d088378e0607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23440a72-5db4-4da8-8af0-176166843949", "name": "network-vif-plugged", "status": "completed", "tag": "e6382291-a00e-49b0-905a-3ea8adf9eb83"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:43.877006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-56057e4d-ece0-4833-b62f-fbae9e98b480 req-4585772b-0bc5-4be1-9041-d088378e0607 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:43.877858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-56057e4d-ece0-4833-b62f-fbae9e98b480 req-4585772b-0bc5-4be1-9041-d088378e0607 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:43.877858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-56057e4d-ece0-4833-b62f-fbae9e98b480 req-4585772b-0bc5-4be1-9041-d088378e0607 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:43.893165 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-56057e4d-ece0-4833-b62f-fbae9e98b480 req-4585772b-0bc5-4be1-9041-d088378e0607 service nova] Creating event network-vif-plugged:e6382291-a00e-49b0-905a-3ea8adf9eb83 for instance 23440a72-5db4-4da8-8af0-176166843949 on n-h1-860863-1 Oct 10 18:57:43.905892 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-56057e4d-ece0-4833-b62f-fbae9e98b480 req-4585772b-0bc5-4be1-9041-d088378e0607 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042405 Oct 10 18:57:43.906783 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1103/1968] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:43.912047 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4b3a32dd-2582-4bf8-a31e-c15b1d10fc46 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:43.914952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4b3a32dd-2582-4bf8-a31e-c15b1d10fc46 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:43.921462 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b3a32dd-2582-4bf8-a31e-c15b1d10fc46 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:43.921959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b3a32dd-2582-4bf8-a31e-c15b1d10fc46 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:43.922368 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b3a32dd-2582-4bf8-a31e-c15b1d10fc46 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:43.923081 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b3a32dd-2582-4bf8-a31e-c15b1d10fc46 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:43.923534 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b3a32dd-2582-4bf8-a31e-c15b1d10fc46 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:43.923957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b3a32dd-2582-4bf8-a31e-c15b1d10fc46 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:44.004962 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4b3a32dd-2582-4bf8-a31e-c15b1d10fc46 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096986 Oct 10 18:57:44.006258 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1104/1969] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:57:43 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:44.012480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b7c33218-b99b-4896-b85a-e301a377a45b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:44.013382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b7c33218-b99b-4896-b85a-e301a377a45b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:44.020257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7c33218-b99b-4896-b85a-e301a377a45b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:44.021019 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7c33218-b99b-4896-b85a-e301a377a45b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:44.021642 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7c33218-b99b-4896-b85a-e301a377a45b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:44.022555 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7c33218-b99b-4896-b85a-e301a377a45b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:44.023281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7c33218-b99b-4896-b85a-e301a377a45b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:44.024077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7c33218-b99b-4896-b85a-e301a377a45b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:44.305324 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b7c33218-b99b-4896-b85a-e301a377a45b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:44.325978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b7c33218-b99b-4896-b85a-e301a377a45b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:44.327477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b7c33218-b99b-4896-b85a-e301a377a45b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:44.328744 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b7c33218-b99b-4896-b85a-e301a377a45b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.320857 Oct 10 18:57:44.345242 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1105/1970] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:44 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:44.363585 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f41a7eae-4eed-4723-8415-81044209fc24 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:44.364095 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f41a7eae-4eed-4723-8415-81044209fc24 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:44.371631 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f41a7eae-4eed-4723-8415-81044209fc24 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:44.372130 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f41a7eae-4eed-4723-8415-81044209fc24 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:44.372598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f41a7eae-4eed-4723-8415-81044209fc24 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:44.373312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f41a7eae-4eed-4723-8415-81044209fc24 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:44.373763 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f41a7eae-4eed-4723-8415-81044209fc24 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:44.374186 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f41a7eae-4eed-4723-8415-81044209fc24 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:44.533049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-f41a7eae-4eed-4723-8415-81044209fc24 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lazy-loading 'services' on Instance uuid 5ae3aec4-c476-4f1a-a702-2cd1548b0895 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:57:44.790182 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f41a7eae-4eed-4723-8415-81044209fc24 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895/os-volume_attachments/ca5e31ea-140c-45df-b6eb-ffd98d6f48cc" status: 202 len: 0 microversion: 2.1 time: 0.442959 Oct 10 18:57:44.791998 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1106/1971] 10.222.0.43 () {58 vars in 1416 bytes} [Mon Oct 10 18:57:44 2022] DELETE /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895/os-volume_attachments/ca5e31ea-140c-45df-b6eb-ffd98d6f48cc => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:57:44.808165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e8eccf7d-3970-487c-b866-385a044dd552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:44.815626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e8eccf7d-3970-487c-b866-385a044dd552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:44.838493 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8eccf7d-3970-487c-b866-385a044dd552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:44.844310 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8eccf7d-3970-487c-b866-385a044dd552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:44.844310 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8eccf7d-3970-487c-b866-385a044dd552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:44.845166 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8eccf7d-3970-487c-b866-385a044dd552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:44.847037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8eccf7d-3970-487c-b866-385a044dd552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:44.850046 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e8eccf7d-3970-487c-b866-385a044dd552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:44.904108 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e89e6fb3-a9a7-4782-adf1-89919e52835c tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.433192 Oct 10 18:57:44.904812 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 866/1972] 10.222.0.43 () {60 vars in 1170 bytes} [Mon Oct 10 18:57:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:44.917517 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-299465861", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4e9b6228-48e7-47ac-9317-a5a4457ef8ad"}], "block_device_mapping_v2": [{"uuid": "e5c32a1b-234e-4d0f-a57d-5b558bc514fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:45.073435 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] validate_networks() for [('4e9b6228-48e7-47ac-9317-a5a4457ef8ad', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:57:45.754041 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e8eccf7d-3970-487c-b866-385a044dd552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:45.765226 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e8eccf7d-3970-487c-b866-385a044dd552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1513 microversion: 2.1 time: 0.971625 Oct 10 18:57:45.782112 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1107/1973] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:44 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1513 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:45.795556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5aaff2bc-16cf-41e8-bc41-007902895a48 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:45.796228 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5aaff2bc-16cf-41e8-bc41-007902895a48 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:45.810748 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5aaff2bc-16cf-41e8-bc41-007902895a48 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:45.811541 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5aaff2bc-16cf-41e8-bc41-007902895a48 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:45.812159 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5aaff2bc-16cf-41e8-bc41-007902895a48 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:45.813502 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5aaff2bc-16cf-41e8-bc41-007902895a48 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:45.814197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5aaff2bc-16cf-41e8-bc41-007902895a48 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:45.814852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5aaff2bc-16cf-41e8-bc41-007902895a48 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:45.849436 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:57:45.849854 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:57:45.850659 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:57:45.852248 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:57:45.852248 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:57:45.862955 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:45.863440 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:45.863868 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:45.864603 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:45.865217 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:45.865453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:45.902141 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Getting quotas for project 8ca11fe18cc64adfbc06166601106c7c. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:57:45.917228 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Getting quotas for user 789ef7a66ff042b9abebe36823008f8f and project 8ca11fe18cc64adfbc06166601106c7c. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:57:46.011294 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:57:46.014483 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e5c32a1b-234e-4d0f-a57d-5b558bc514fb',volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:57:46.186477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5aaff2bc-16cf-41e8-bc41-007902895a48 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:46.195980 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5aaff2bc-16cf-41e8-bc41-007902895a48 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1467 microversion: 2.1 time: 0.411929 Oct 10 18:57:46.198172 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1108/1974] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:45 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1467 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:46.223095 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6e810151-01a5-4215-850a-fb2342071619 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:46.224021 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6e810151-01a5-4215-850a-fb2342071619 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:46.232476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e810151-01a5-4215-850a-fb2342071619 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:46.233994 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e810151-01a5-4215-850a-fb2342071619 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:46.234664 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e810151-01a5-4215-850a-fb2342071619 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:46.235589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e810151-01a5-4215-850a-fb2342071619 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:46.236323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e810151-01a5-4215-850a-fb2342071619 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:46.237197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6e810151-01a5-4215-850a-fb2342071619 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:46.371771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6e810151-01a5-4215-850a-fb2342071619 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:46.389116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6e810151-01a5-4215-850a-fb2342071619 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:46.392024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6e810151-01a5-4215-850a-fb2342071619 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:46.401611 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6e810151-01a5-4215-850a-fb2342071619 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.192981 Oct 10 18:57:46.403917 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1109/1975] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:46 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:46.417187 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-65373719-f050-4f9f-a0f6-e6662b926c01 tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] Calling method '.version_select at 0x7f318d5a7160>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:46.725211 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fadc3625-781a-4cd2-93c7-271dc5d65edc tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.819115 Oct 10 18:57:46.727340 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 867/1976] 10.222.0.43 () {62 vars in 1188 bytes} [Mon Oct 10 18:57:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 10 18:57:46.735007 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-22318770-1d27-44b3-8e73-aada7fc619ac tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:46.736965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-22318770-1d27-44b3-8e73-aada7fc619ac tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:46.745675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22318770-1d27-44b3-8e73-aada7fc619ac tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:46.747511 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22318770-1d27-44b3-8e73-aada7fc619ac tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:46.747511 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22318770-1d27-44b3-8e73-aada7fc619ac tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:46.748840 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22318770-1d27-44b3-8e73-aada7fc619ac tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:46.749539 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22318770-1d27-44b3-8e73-aada7fc619ac tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:46.750380 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22318770-1d27-44b3-8e73-aada7fc619ac tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:47.254068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-22318770-1d27-44b3-8e73-aada7fc619ac tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:47.267898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-22318770-1d27-44b3-8e73-aada7fc619ac tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:47.274091 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-22318770-1d27-44b3-8e73-aada7fc619ac tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:47.279049 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-22318770-1d27-44b3-8e73-aada7fc619ac tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.548728 Oct 10 18:57:47.286466 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 868/1977] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:46 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:47.292274 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-11e42233-5209-436d-9f87-e9af602b131b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-695107255", "metadata": {"image_type": "test"}}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:47.298963 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-11e42233-5209-436d-9f87-e9af602b131b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:47.311451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-11e42233-5209-436d-9f87-e9af602b131b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:47.312214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-11e42233-5209-436d-9f87-e9af602b131b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:47.317670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-11e42233-5209-436d-9f87-e9af602b131b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:47.325280 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-11e42233-5209-436d-9f87-e9af602b131b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:47.326041 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-11e42233-5209-436d-9f87-e9af602b131b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:47.326812 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-11e42233-5209-436d-9f87-e9af602b131b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:47.456875 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-11e42233-5209-436d-9f87-e9af602b131b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Getting quotas for project b3e646a2c4854a3ca9fad749182efd62. Resources: dict_keys(['metadata_items']) {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:57:47.479921 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-11e42233-5209-436d-9f87-e9af602b131b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Getting quotas for user 0795d65cfa274841a7d2c4c2fb90f13a and project b3e646a2c4854a3ca9fad749182efd62. Resources: dict_keys(['metadata_items']) {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:57:48.104619 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-11e42233-5209-436d-9f87-e9af602b131b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "POST /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949/action" status: 202 len: 0 microversion: 2.1 time: 0.816541 Oct 10 18:57:48.106623 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 869/1978] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:57:47 2022] POST /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 18:57:48.122434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b8ffa654-8715-4549-9301-6fc5f0cf7986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:48.123414 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b8ffa654-8715-4549-9301-6fc5f0cf7986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:48.140294 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8ffa654-8715-4549-9301-6fc5f0cf7986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:48.141004 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8ffa654-8715-4549-9301-6fc5f0cf7986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:48.141443 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8ffa654-8715-4549-9301-6fc5f0cf7986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:48.142212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8ffa654-8715-4549-9301-6fc5f0cf7986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:48.142608 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8ffa654-8715-4549-9301-6fc5f0cf7986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:48.143032 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8ffa654-8715-4549-9301-6fc5f0cf7986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:48.292634 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b8ffa654-8715-4549-9301-6fc5f0cf7986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:48.334124 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b8ffa654-8715-4549-9301-6fc5f0cf7986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:48.334124 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b8ffa654-8715-4549-9301-6fc5f0cf7986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:48.348434 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b8ffa654-8715-4549-9301-6fc5f0cf7986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1184 microversion: 2.25 time: 0.218615 Oct 10 18:57:48.351767 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 870/1979] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:48 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1184 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:48.384147 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-34937e55-81cb-4186-b03a-09b48f33c80a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:48.386382 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-34937e55-81cb-4186-b03a-09b48f33c80a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:48.709212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-34937e55-81cb-4186-b03a-09b48f33c80a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:48.709212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-34937e55-81cb-4186-b03a-09b48f33c80a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:48.709212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-34937e55-81cb-4186-b03a-09b48f33c80a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:48.709212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-34937e55-81cb-4186-b03a-09b48f33c80a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:48.709212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-34937e55-81cb-4186-b03a-09b48f33c80a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:48.709212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-34937e55-81cb-4186-b03a-09b48f33c80a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:48.709212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-34937e55-81cb-4186-b03a-09b48f33c80a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:48.709212 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-34937e55-81cb-4186-b03a-09b48f33c80a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1513 microversion: 2.1 time: 0.264117 Oct 10 18:57:48.709212 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 871/1980] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:48 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:48.709212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7a979c5e-45f6-4cfd-a1d4-2cf5e04fd17b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:48.709212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7a979c5e-45f6-4cfd-a1d4-2cf5e04fd17b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:48.709212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7a979c5e-45f6-4cfd-a1d4-2cf5e04fd17b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:48.711498 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7a979c5e-45f6-4cfd-a1d4-2cf5e04fd17b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:48.711498 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7a979c5e-45f6-4cfd-a1d4-2cf5e04fd17b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:48.711498 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7a979c5e-45f6-4cfd-a1d4-2cf5e04fd17b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:48.711498 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7a979c5e-45f6-4cfd-a1d4-2cf5e04fd17b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:48.711498 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7a979c5e-45f6-4cfd-a1d4-2cf5e04fd17b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:48.789445 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-65373719-f050-4f9f-a0f6-e6662b926c01 tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/a96f2463-3c78-4d32-9dcf-fdea8fbc3470" status: 202 len: 0 microversion: 2.1 time: 2.383505 Oct 10 18:57:48.790374 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1110/1981] 10.222.0.43 () {58 vars in 1263 bytes} [Mon Oct 10 18:57:46 2022] DELETE /compute/v2.1/os-floating-ips/a96f2463-3c78-4d32-9dcf-fdea8fbc3470 => generated 0 bytes in 2385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:57:48.795325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2f12ecf0-b25a-437d-8d18-8fedd9dc98cf tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f318d5a79d0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:48.806393 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7a979c5e-45f6-4cfd-a1d4-2cf5e04fd17b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:48.826213 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7a979c5e-45f6-4cfd-a1d4-2cf5e04fd17b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:48.827664 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7a979c5e-45f6-4cfd-a1d4-2cf5e04fd17b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:48.838600 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7a979c5e-45f6-4cfd-a1d4-2cf5e04fd17b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.199882 Oct 10 18:57:48.840999 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 872/1982] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:48 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:48.852020 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6f00fa76-219b-4958-a856-c397d2d1f5c2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:48.852894 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6f00fa76-219b-4958-a856-c397d2d1f5c2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:48.856074 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2f12ecf0-b25a-437d-8d18-8fedd9dc98cf tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 200 len: 1421 microversion: 2.1 time: 0.064522 Oct 10 18:57:48.865111 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f00fa76-219b-4958-a856-c397d2d1f5c2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:48.865413 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1111/1983] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:57:48 2022] GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 1421 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:48.866281 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f00fa76-219b-4958-a856-c397d2d1f5c2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:48.866728 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f00fa76-219b-4958-a856-c397d2d1f5c2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:48.867470 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f00fa76-219b-4958-a856-c397d2d1f5c2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:48.868105 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f00fa76-219b-4958-a856-c397d2d1f5c2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:48.868821 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f00fa76-219b-4958-a856-c397d2d1f5c2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:48.874869 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-28f98c22-cfee-473e-8566-5b830585b816 tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] Calling method '.version_select at 0x7f318d4feaf0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:48.932292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG neutronclient.v2_0.client [None req-28f98c22-cfee-473e-8566-5b830585b816 tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a96f2463-3c78-4d32-9dcf-fdea8fbc3470 could not be found", "detail": ""}} {{(pid=127288) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:57:48.933607 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-28f98c22-cfee-473e-8566-5b830585b816 tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] HTTP exception thrown: Floating IP not found for ID a96f2463-3c78-4d32-9dcf-fdea8fbc3470 Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-28f98c22-cfee-473e-8566-5b830585b816 tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] Request method failure captured: Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/os-floating-ips/a96f2463-3c78-4d32-9dcf-fdea8fbc3470 HTTP/1.1 Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGscVPCV9aIZpC_GVXvNr4UO_iiE5ZBIZ2WDTXBii96czXLyPXgGRggQpv5w9k_JcxGHQ2mQoF4DJe3JDYwfdSYwthC8bRGnWIWqoGor1ciG8lj6rtvtl_DFq7M0xS1v-hyXBXt9pAQu98TjbyRLQaOjgokusCUF0TiyV5N7Pm7m9gg Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 0a26b31bb101457eae2fda76531ea570 Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FloatingIPsTestJSON-1706790870 Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0a26b31bb101457eae2fda76531ea570", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0a26b31bb101457eae2fda76531ea570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0a26b31bb101457eae2fda76531ea570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0a26b31bb101457eae2fda76531ea570"}]}] Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FloatingIPsTestJSON-1706790870 Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 0a26b31bb101457eae2fda76531ea570 Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1706790870 Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FloatingIPsTestJSON-1706790870-project Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c673c71802b5467e8927cf00032454ba Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FloatingIPsTestJSON-1706790870-project Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: exception: Floating IP not found for ID a96f2463-3c78-4d32-9dcf-fdea8fbc3470 Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'a96f2463-3c78-4d32-9dcf-fdea8fbc3470'} Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a96f2463-3c78-4d32-9dcf-fdea8fbc3470 could not be found Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b723f1a-11b4-4c96-89ef-84ef84c97240'] Oct 10 18:57:48.944740 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a96f2463-3c78-4d32-9dcf-fdea8fbc3470. Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a96f2463-3c78-4d32-9dcf-fdea8fbc3470 Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a96f2463-3c78-4d32-9dcf-fdea8fbc3470 Oct 10 18:57:48.948266 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:48.952913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-28f98c22-cfee-473e-8566-5b830585b816 tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] Returning 404 to user: Floating IP not found for ID a96f2463-3c78-4d32-9dcf-fdea8fbc3470 {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:57:48.952913 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-28f98c22-cfee-473e-8566-5b830585b816 tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/a96f2463-3c78-4d32-9dcf-fdea8fbc3470" status: 404 len: 111 microversion: 2.1 time: 0.084085 Oct 10 18:57:48.956472 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1112/1984] 10.222.0.43 () {58 vars in 1260 bytes} [Mon Oct 10 18:57:48 2022] GET /compute/v2.1/os-floating-ips/a96f2463-3c78-4d32-9dcf-fdea8fbc3470 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:57:48.962307 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e22fd4f7-58c2-4d56-956d-4b80cb08c04e tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] Calling method '.version_select at 0x7f318e3295e0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:49.045148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG neutronclient.v2_0.client [None req-e22fd4f7-58c2-4d56-956d-4b80cb08c04e tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a96f2463-3c78-4d32-9dcf-fdea8fbc3470 could not be found", "detail": ""}} {{(pid=127288) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:57:49.047258 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-e22fd4f7-58c2-4d56-956d-4b80cb08c04e tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] HTTP exception thrown: Floating IP not found for ID a96f2463-3c78-4d32-9dcf-fdea8fbc3470 Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e22fd4f7-58c2-4d56-956d-4b80cb08c04e tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] Request method failure captured: Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/os-floating-ips/a96f2463-3c78-4d32-9dcf-fdea8fbc3470 HTTP/1.1 Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGscVPCV9aIZpC_GVXvNr4UO_iiE5ZBIZ2WDTXBii96czXLyPXgGRggQpv5w9k_JcxGHQ2mQoF4DJe3JDYwfdSYwthC8bRGnWIWqoGor1ciG8lj6rtvtl_DFq7M0xS1v-hyXBXt9pAQu98TjbyRLQaOjgokusCUF0TiyV5N7Pm7m9gg Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 0a26b31bb101457eae2fda76531ea570 Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FloatingIPsTestJSON-1706790870 Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0a26b31bb101457eae2fda76531ea570", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0a26b31bb101457eae2fda76531ea570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0a26b31bb101457eae2fda76531ea570"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0a26b31bb101457eae2fda76531ea570"}]}] Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FloatingIPsTestJSON-1706790870 Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 0a26b31bb101457eae2fda76531ea570 Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1706790870 Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FloatingIPsTestJSON-1706790870-project Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: c673c71802b5467e8927cf00032454ba Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FloatingIPsTestJSON-1706790870-project Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: exception: Floating IP not found for ID a96f2463-3c78-4d32-9dcf-fdea8fbc3470 Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'a96f2463-3c78-4d32-9dcf-fdea8fbc3470'} Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a96f2463-3c78-4d32-9dcf-fdea8fbc3470 could not be found Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96f21b51-a562-4c1b-86a6-7a1fadea2528'] Oct 10 18:57:49.049474 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a96f2463-3c78-4d32-9dcf-fdea8fbc3470. Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a96f2463-3c78-4d32-9dcf-fdea8fbc3470 Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a96f2463-3c78-4d32-9dcf-fdea8fbc3470 Oct 10 18:57:49.052390 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:57:49.056204 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e22fd4f7-58c2-4d56-956d-4b80cb08c04e tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] Returning 404 to user: Floating IP not found for ID a96f2463-3c78-4d32-9dcf-fdea8fbc3470 {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:57:49.057291 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e22fd4f7-58c2-4d56-956d-4b80cb08c04e tempest-FloatingIPsTestJSON-1706790870 tempest-FloatingIPsTestJSON-1706790870-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/a96f2463-3c78-4d32-9dcf-fdea8fbc3470" status: 404 len: 111 microversion: 2.1 time: 0.099450 Oct 10 18:57:49.058032 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1113/1985] 10.222.0.43 () {58 vars in 1263 bytes} [Mon Oct 10 18:57:48 2022] DELETE /compute/v2.1/os-floating-ips/a96f2463-3c78-4d32-9dcf-fdea8fbc3470 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:57:49.237744 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6f00fa76-219b-4958-a856-c397d2d1f5c2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:49.253293 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6f00fa76-219b-4958-a856-c397d2d1f5c2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:49.256623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6f00fa76-219b-4958-a856-c397d2d1f5c2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:49.258672 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6f00fa76-219b-4958-a856-c397d2d1f5c2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.413962 Oct 10 18:57:49.282162 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 873/1986] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:48 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:49.386184 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-24beb3a1-a623-4c75-9749-973714a6b0ac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:49.387217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-24beb3a1-a623-4c75-9749-973714a6b0ac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:49.403007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24beb3a1-a623-4c75-9749-973714a6b0ac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:49.403726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24beb3a1-a623-4c75-9749-973714a6b0ac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:49.404769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24beb3a1-a623-4c75-9749-973714a6b0ac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:49.405700 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24beb3a1-a623-4c75-9749-973714a6b0ac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:49.411338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24beb3a1-a623-4c75-9749-973714a6b0ac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:49.412042 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24beb3a1-a623-4c75-9749-973714a6b0ac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:49.653411 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ffe55c33-eca5-49da-aeb1-6786d31ee2e3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:49.654622 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ffe55c33-eca5-49da-aeb1-6786d31ee2e3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:49.693395 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffe55c33-eca5-49da-aeb1-6786d31ee2e3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:49.696066 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffe55c33-eca5-49da-aeb1-6786d31ee2e3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:49.696826 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffe55c33-eca5-49da-aeb1-6786d31ee2e3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:49.698137 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffe55c33-eca5-49da-aeb1-6786d31ee2e3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:49.698947 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffe55c33-eca5-49da-aeb1-6786d31ee2e3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:49.703405 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffe55c33-eca5-49da-aeb1-6786d31ee2e3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:49.743913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-24beb3a1-a623-4c75-9749-973714a6b0ac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:49.759054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-24beb3a1-a623-4c75-9749-973714a6b0ac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:49.760503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-24beb3a1-a623-4c75-9749-973714a6b0ac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:49.761894 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-24beb3a1-a623-4c75-9749-973714a6b0ac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1232 microversion: 2.25 time: 0.383657 Oct 10 18:57:49.765963 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1114/1987] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:49 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1232 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:49.872911 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-dcc7b193-f0a2-418e-8c91-52298eb1e001 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f318d56edc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:49.939782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ffe55c33-eca5-49da-aeb1-6786d31ee2e3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:49.949912 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ffe55c33-eca5-49da-aeb1-6786d31ee2e3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1513 microversion: 2.1 time: 0.304687 Oct 10 18:57:49.950544 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-dcc7b193-f0a2-418e-8c91-52298eb1e001 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 200 len: 1421 microversion: 2.1 time: 0.081261 Oct 10 18:57:49.951343 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1115/1988] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:57:49 2022] GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 1421 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:57:49.956658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8323a146-0fd1-4acf-862f-67821d76e95b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:49.957499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8323a146-0fd1-4acf-862f-67821d76e95b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:49.965026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8323a146-0fd1-4acf-862f-67821d76e95b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:49.965686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8323a146-0fd1-4acf-862f-67821d76e95b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:49.966319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8323a146-0fd1-4acf-862f-67821d76e95b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:49.966849 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 874/1989] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:49 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1513 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:49.967325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8323a146-0fd1-4acf-862f-67821d76e95b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:49.967900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8323a146-0fd1-4acf-862f-67821d76e95b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:49.968449 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8323a146-0fd1-4acf-862f-67821d76e95b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:50.086785 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8323a146-0fd1-4acf-862f-67821d76e95b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:50.099619 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8323a146-0fd1-4acf-862f-67821d76e95b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:50.103545 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8323a146-0fd1-4acf-862f-67821d76e95b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:50.111233 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8323a146-0fd1-4acf-862f-67821d76e95b tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.158637 Oct 10 18:57:50.114799 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1116/1990] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:49 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:50.291166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bc666159-3c7a-41f6-b866-c68a7b701d25 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:50.293387 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bc666159-3c7a-41f6-b866-c68a7b701d25 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:50.303185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc666159-3c7a-41f6-b866-c68a7b701d25 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:50.304015 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc666159-3c7a-41f6-b866-c68a7b701d25 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:50.308169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc666159-3c7a-41f6-b866-c68a7b701d25 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:50.309329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc666159-3c7a-41f6-b866-c68a7b701d25 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:50.310167 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc666159-3c7a-41f6-b866-c68a7b701d25 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:50.310860 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc666159-3c7a-41f6-b866-c68a7b701d25 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:50.706802 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bc666159-3c7a-41f6-b866-c68a7b701d25 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:50.719865 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bc666159-3c7a-41f6-b866-c68a7b701d25 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:50.721786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bc666159-3c7a-41f6-b866-c68a7b701d25 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:50.723335 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bc666159-3c7a-41f6-b866-c68a7b701d25 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.437142 Oct 10 18:57:50.724550 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 875/1991] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:50 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:50.793241 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ecedafdc-fce4-4707-9092-0c5e1ba0e3a9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:50.794725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ecedafdc-fce4-4707-9092-0c5e1ba0e3a9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:50.806435 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ecedafdc-fce4-4707-9092-0c5e1ba0e3a9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:50.810936 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ecedafdc-fce4-4707-9092-0c5e1ba0e3a9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:50.811599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ecedafdc-fce4-4707-9092-0c5e1ba0e3a9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:50.813247 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ecedafdc-fce4-4707-9092-0c5e1ba0e3a9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:50.813869 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ecedafdc-fce4-4707-9092-0c5e1ba0e3a9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:50.814452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ecedafdc-fce4-4707-9092-0c5e1ba0e3a9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:50.966862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0792b111-bd2c-486d-b210-d8b47ebb1af4 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f31922805e0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:51.048298 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ecedafdc-fce4-4707-9092-0c5e1ba0e3a9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:51.064529 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0792b111-bd2c-486d-b210-d8b47ebb1af4 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 200 len: 1421 microversion: 2.1 time: 0.101560 Oct 10 18:57:51.073105 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ecedafdc-fce4-4707-9092-0c5e1ba0e3a9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:51.073612 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 876/1992] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:57:50 2022] GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 1421 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:57:51.082805 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c2d407cb-78ca-45ce-8cce-f314ae8c6290 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:51.086600 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c2d407cb-78ca-45ce-8cce-f314ae8c6290 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:51.095303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ecedafdc-fce4-4707-9092-0c5e1ba0e3a9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:51.096462 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ecedafdc-fce4-4707-9092-0c5e1ba0e3a9 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1240 microversion: 2.25 time: 0.309567 Oct 10 18:57:51.099543 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1117/1993] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:50 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1240 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:51.106339 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c2d407cb-78ca-45ce-8cce-f314ae8c6290 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:51.106986 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c2d407cb-78ca-45ce-8cce-f314ae8c6290 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:51.107574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c2d407cb-78ca-45ce-8cce-f314ae8c6290 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:51.108457 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c2d407cb-78ca-45ce-8cce-f314ae8c6290 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:51.112705 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c2d407cb-78ca-45ce-8cce-f314ae8c6290 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:51.115626 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c2d407cb-78ca-45ce-8cce-f314ae8c6290 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:51.175631 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-929d012a-4e24-4195-8f16-d33be8bc6a24 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:51.189263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-929d012a-4e24-4195-8f16-d33be8bc6a24 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:51.209710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-929d012a-4e24-4195-8f16-d33be8bc6a24 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:51.210436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-929d012a-4e24-4195-8f16-d33be8bc6a24 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:51.212971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-929d012a-4e24-4195-8f16-d33be8bc6a24 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:51.214904 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-929d012a-4e24-4195-8f16-d33be8bc6a24 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:51.215534 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-929d012a-4e24-4195-8f16-d33be8bc6a24 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:51.221651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-929d012a-4e24-4195-8f16-d33be8bc6a24 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:51.447154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-929d012a-4e24-4195-8f16-d33be8bc6a24 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:51.463206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-929d012a-4e24-4195-8f16-d33be8bc6a24 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:51.471966 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-929d012a-4e24-4195-8f16-d33be8bc6a24 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:51.509696 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-929d012a-4e24-4195-8f16-d33be8bc6a24 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.337029 Oct 10 18:57:51.528205 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1118/1994] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:51 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:51.749103 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-293a7c48-176c-4f56-bd53-5fd12f406747 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:51.749726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-293a7c48-176c-4f56-bd53-5fd12f406747 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:51.769641 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-293a7c48-176c-4f56-bd53-5fd12f406747 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:51.770215 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-293a7c48-176c-4f56-bd53-5fd12f406747 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:51.770765 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-293a7c48-176c-4f56-bd53-5fd12f406747 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:51.776867 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-293a7c48-176c-4f56-bd53-5fd12f406747 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:51.777602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-293a7c48-176c-4f56-bd53-5fd12f406747 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:51.778189 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-293a7c48-176c-4f56-bd53-5fd12f406747 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:51.997144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c2d407cb-78ca-45ce-8cce-f314ae8c6290 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:52.005036 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c2d407cb-78ca-45ce-8cce-f314ae8c6290 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1513 microversion: 2.1 time: 0.930111 Oct 10 18:57:52.005622 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 877/1995] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:51 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1513 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:52.080700 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-64ea4fcc-0e7f-4dbb-9266-6414e00375ab tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f3192292280>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:52.203273 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-64ea4fcc-0e7f-4dbb-9266-6414e00375ab tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 200 len: 1421 microversion: 2.1 time: 0.126958 Oct 10 18:57:52.203867 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 878/1996] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:57:52 2022] GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 1421 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:52.218929 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-699685ba-927f-48f0-915f-347780090ffe tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:52.219774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-699685ba-927f-48f0-915f-347780090ffe tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:52.237161 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-699685ba-927f-48f0-915f-347780090ffe tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:52.238030 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-699685ba-927f-48f0-915f-347780090ffe tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:52.238616 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-699685ba-927f-48f0-915f-347780090ffe tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:52.239573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-699685ba-927f-48f0-915f-347780090ffe tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:52.243575 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-699685ba-927f-48f0-915f-347780090ffe tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:52.249982 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-699685ba-927f-48f0-915f-347780090ffe tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:52.473071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-293a7c48-176c-4f56-bd53-5fd12f406747 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:52.500186 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-293a7c48-176c-4f56-bd53-5fd12f406747 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:52.502104 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-293a7c48-176c-4f56-bd53-5fd12f406747 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:52.504188 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-293a7c48-176c-4f56-bd53-5fd12f406747 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.758916 Oct 10 18:57:52.510356 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1119/1997] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:51 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:57:52.542230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-466826d3-28bb-4d60-8c9f-1278472c2d29 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:52.543069 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-466826d3-28bb-4d60-8c9f-1278472c2d29 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:52.560429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-466826d3-28bb-4d60-8c9f-1278472c2d29 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:52.563709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-466826d3-28bb-4d60-8c9f-1278472c2d29 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:52.567631 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-466826d3-28bb-4d60-8c9f-1278472c2d29 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:52.568916 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-466826d3-28bb-4d60-8c9f-1278472c2d29 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:52.572098 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-466826d3-28bb-4d60-8c9f-1278472c2d29 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:52.580786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-466826d3-28bb-4d60-8c9f-1278472c2d29 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:52.863160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-466826d3-28bb-4d60-8c9f-1278472c2d29 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:52.880654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-466826d3-28bb-4d60-8c9f-1278472c2d29 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:52.887895 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-466826d3-28bb-4d60-8c9f-1278472c2d29 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:52.929143 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-466826d3-28bb-4d60-8c9f-1278472c2d29 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.390692 Oct 10 18:57:52.938603 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1120/1998] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:52 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:57:53.030297 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-090263cb-2e5a-4c1b-8207-aaf5b7e55eef tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:53.033682 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-090263cb-2e5a-4c1b-8207-aaf5b7e55eef tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:53.041822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-090263cb-2e5a-4c1b-8207-aaf5b7e55eef tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:53.046209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-090263cb-2e5a-4c1b-8207-aaf5b7e55eef tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:53.046845 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-090263cb-2e5a-4c1b-8207-aaf5b7e55eef tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:53.048034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-090263cb-2e5a-4c1b-8207-aaf5b7e55eef tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:53.048667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-090263cb-2e5a-4c1b-8207-aaf5b7e55eef tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:53.050932 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-090263cb-2e5a-4c1b-8207-aaf5b7e55eef tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:53.575817 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-699685ba-927f-48f0-915f-347780090ffe tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:53.590219 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-699685ba-927f-48f0-915f-347780090ffe tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:53.595660 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-699685ba-927f-48f0-915f-347780090ffe tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:53.598592 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-699685ba-927f-48f0-915f-347780090ffe tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1292 microversion: 2.25 time: 1.393453 Oct 10 18:57:53.599186 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 879/1999] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:52 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1292 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:53.618088 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8b62ed2d-e659-4252-b633-a4a2e53dd5d3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f31922809d0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:53.691428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-090263cb-2e5a-4c1b-8207-aaf5b7e55eef tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:53.712756 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-090263cb-2e5a-4c1b-8207-aaf5b7e55eef tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1513 microversion: 2.1 time: 0.689260 Oct 10 18:57:53.713368 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1121/2000] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:53 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1513 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:57:53.744477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1f394a08-4ab2-40e2-83f8-46ea19ef2c4d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:53.747900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1f394a08-4ab2-40e2-83f8-46ea19ef2c4d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:53.784319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f394a08-4ab2-40e2-83f8-46ea19ef2c4d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:53.784912 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f394a08-4ab2-40e2-83f8-46ea19ef2c4d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:53.786300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f394a08-4ab2-40e2-83f8-46ea19ef2c4d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:53.790054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f394a08-4ab2-40e2-83f8-46ea19ef2c4d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:53.799281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f394a08-4ab2-40e2-83f8-46ea19ef2c4d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:53.801043 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1f394a08-4ab2-40e2-83f8-46ea19ef2c4d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:54.281039 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1f394a08-4ab2-40e2-83f8-46ea19ef2c4d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:54.291241 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1f394a08-4ab2-40e2-83f8-46ea19ef2c4d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:54.307339 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1f394a08-4ab2-40e2-83f8-46ea19ef2c4d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:54.309650 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1f394a08-4ab2-40e2-83f8-46ea19ef2c4d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.579982 Oct 10 18:57:54.311795 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1122/2001] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:53 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:54.321547 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1b4e21f6-1ba7-4bdb-923f-8b8c6f06956c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:54.332830 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1b4e21f6-1ba7-4bdb-923f-8b8c6f06956c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:54.352143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b4e21f6-1ba7-4bdb-923f-8b8c6f06956c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:54.352143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b4e21f6-1ba7-4bdb-923f-8b8c6f06956c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:54.352143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b4e21f6-1ba7-4bdb-923f-8b8c6f06956c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:54.352143 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b4e21f6-1ba7-4bdb-923f-8b8c6f06956c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:54.352643 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b4e21f6-1ba7-4bdb-923f-8b8c6f06956c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:54.358788 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b4e21f6-1ba7-4bdb-923f-8b8c6f06956c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:54.556324 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1b4e21f6-1ba7-4bdb-923f-8b8c6f06956c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:54.575212 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:54.582112 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1b4e21f6-1ba7-4bdb-923f-8b8c6f06956c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:54.591110 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1b4e21f6-1ba7-4bdb-923f-8b8c6f06956c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:54.604762 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1b4e21f6-1ba7-4bdb-923f-8b8c6f06956c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.291759 Oct 10 18:57:54.617520 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1123/2002] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:54 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:54.634694 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0573e3a6-f2b9-4231-9012-d439cb769503 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:54.643740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0573e3a6-f2b9-4231-9012-d439cb769503 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:54.665402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0573e3a6-f2b9-4231-9012-d439cb769503 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:54.668776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0573e3a6-f2b9-4231-9012-d439cb769503 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:54.669356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0573e3a6-f2b9-4231-9012-d439cb769503 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:54.670160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0573e3a6-f2b9-4231-9012-d439cb769503 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:54.671436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0573e3a6-f2b9-4231-9012-d439cb769503 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:54.671436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0573e3a6-f2b9-4231-9012-d439cb769503 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:54.775662 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0573e3a6-f2b9-4231-9012-d439cb769503 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.156507 Oct 10 18:57:54.776903 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1124/2003] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:57:54 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895/os-volume_attachments => generated 25 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:57:54.781544 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4ae390c1-2d29-4780-8fab-76df6afb3100 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:54.791439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4ae390c1-2d29-4780-8fab-76df6afb3100 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:54.821305 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ae390c1-2d29-4780-8fab-76df6afb3100 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:54.821811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ae390c1-2d29-4780-8fab-76df6afb3100 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:54.826127 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ae390c1-2d29-4780-8fab-76df6afb3100 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:54.827250 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ae390c1-2d29-4780-8fab-76df6afb3100 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:54.829123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ae390c1-2d29-4780-8fab-76df6afb3100 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:54.829736 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ae390c1-2d29-4780-8fab-76df6afb3100 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:55.322384 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4ae390c1-2d29-4780-8fab-76df6afb3100 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:55.335214 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4ae390c1-2d29-4780-8fab-76df6afb3100 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:55.337275 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4ae390c1-2d29-4780-8fab-76df6afb3100 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:55.344356 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4ae390c1-2d29-4780-8fab-76df6afb3100 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1292 microversion: 2.25 time: 0.566543 Oct 10 18:57:55.344987 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1125/2004] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:54 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1292 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:55.356172 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-54e00d25-af66-4683-b6fa-fd39437afaf5 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:55.359366 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-54e00d25-af66-4683-b6fa-fd39437afaf5 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:55.371332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54e00d25-af66-4683-b6fa-fd39437afaf5 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:55.373017 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54e00d25-af66-4683-b6fa-fd39437afaf5 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:55.377600 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54e00d25-af66-4683-b6fa-fd39437afaf5 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:55.378433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54e00d25-af66-4683-b6fa-fd39437afaf5 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:55.378901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54e00d25-af66-4683-b6fa-fd39437afaf5 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:55.379333 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-54e00d25-af66-4683-b6fa-fd39437afaf5 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:55.687584 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-54e00d25-af66-4683-b6fa-fd39437afaf5 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:55.698645 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-54e00d25-af66-4683-b6fa-fd39437afaf5 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1513 microversion: 2.1 time: 0.351372 Oct 10 18:57:55.699261 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1126/2005] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:55 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1513 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:55.714963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-02842727-48ff-42d2-b425-7c52c68d0e36 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:55.733188 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-02842727-48ff-42d2-b425-7c52c68d0e36 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:55.753464 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-02842727-48ff-42d2-b425-7c52c68d0e36 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:55.756374 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-02842727-48ff-42d2-b425-7c52c68d0e36 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:55.757119 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-02842727-48ff-42d2-b425-7c52c68d0e36 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:55.759763 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-02842727-48ff-42d2-b425-7c52c68d0e36 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:55.761572 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-02842727-48ff-42d2-b425-7c52c68d0e36 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:55.763622 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-02842727-48ff-42d2-b425-7c52c68d0e36 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:55.876317 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-02842727-48ff-42d2-b425-7c52c68d0e36 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.173630 Oct 10 18:57:55.877198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:55.880264 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1127/2006] 10.222.0.43 () {58 vars in 1302 bytes} [Mon Oct 10 18:57:55 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895/os-volume_attachments => generated 25 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:57:55.897852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-039472a3-e1ca-401a-92ee-cbf3fc93478d req-5bda1764-90ac-47ea-9674-c0eb42f33d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23440a72-5db4-4da8-8af0-176166843949", "name": "network-vif-plugged", "status": "completed", "tag": "e6382291-a00e-49b0-905a-3ea8adf9eb83"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:55.925691 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=6 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:55.931515 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-039472a3-e1ca-401a-92ee-cbf3fc93478d req-5bda1764-90ac-47ea-9674-c0eb42f33d51 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:55.937900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-039472a3-e1ca-401a-92ee-cbf3fc93478d req-5bda1764-90ac-47ea-9674-c0eb42f33d51 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:55.937900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-039472a3-e1ca-401a-92ee-cbf3fc93478d req-5bda1764-90ac-47ea-9674-c0eb42f33d51 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:56.003349 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-039472a3-e1ca-401a-92ee-cbf3fc93478d req-5bda1764-90ac-47ea-9674-c0eb42f33d51 service nova] Creating event network-vif-plugged:e6382291-a00e-49b0-905a-3ea8adf9eb83 for instance 23440a72-5db4-4da8-8af0-176166843949 on n-h1-860863-1 Oct 10 18:57:56.024005 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-039472a3-e1ca-401a-92ee-cbf3fc93478d req-5bda1764-90ac-47ea-9674-c0eb42f33d51 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142157 Oct 10 18:57:56.025745 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1128/2007] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:56.044816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-008d7102-9aaf-4200-ab1a-87b1f16f0bfb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:56.045532 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-008d7102-9aaf-4200-ab1a-87b1f16f0bfb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:56.065888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-008d7102-9aaf-4200-ab1a-87b1f16f0bfb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:56.066378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-008d7102-9aaf-4200-ab1a-87b1f16f0bfb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:56.072464 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-008d7102-9aaf-4200-ab1a-87b1f16f0bfb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:56.077424 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-008d7102-9aaf-4200-ab1a-87b1f16f0bfb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:56.078947 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-008d7102-9aaf-4200-ab1a-87b1f16f0bfb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:56.081997 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-008d7102-9aaf-4200-ab1a-87b1f16f0bfb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:56.561292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-008d7102-9aaf-4200-ab1a-87b1f16f0bfb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:56.585420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-008d7102-9aaf-4200-ab1a-87b1f16f0bfb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:56.587350 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-008d7102-9aaf-4200-ab1a-87b1f16f0bfb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:56.601658 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-008d7102-9aaf-4200-ab1a-87b1f16f0bfb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.573025 Oct 10 18:57:56.608715 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1129/2008] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:56 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:56.613682 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7a6d8fe4-d4e5-464d-a0ff-8e2f24352043 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:56.630129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7a6d8fe4-d4e5-464d-a0ff-8e2f24352043 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:56.643025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a6d8fe4-d4e5-464d-a0ff-8e2f24352043 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:56.643510 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a6d8fe4-d4e5-464d-a0ff-8e2f24352043 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:56.649608 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a6d8fe4-d4e5-464d-a0ff-8e2f24352043 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:56.655475 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a6d8fe4-d4e5-464d-a0ff-8e2f24352043 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:56.656190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a6d8fe4-d4e5-464d-a0ff-8e2f24352043 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:56.656794 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a6d8fe4-d4e5-464d-a0ff-8e2f24352043 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:56.874426 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7a6d8fe4-d4e5-464d-a0ff-8e2f24352043 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:56.887671 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7a6d8fe4-d4e5-464d-a0ff-8e2f24352043 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:56.889141 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7a6d8fe4-d4e5-464d-a0ff-8e2f24352043 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:56.919091 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7a6d8fe4-d4e5-464d-a0ff-8e2f24352043 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.309052 Oct 10 18:57:56.922730 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1130/2009] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:56 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:56.931821 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c158d053-4cc8-4e1f-888f-bc928fb63621 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:56.937780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c158d053-4cc8-4e1f-888f-bc928fb63621 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:56.955859 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c158d053-4cc8-4e1f-888f-bc928fb63621 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:56.956696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c158d053-4cc8-4e1f-888f-bc928fb63621 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:56.958256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c158d053-4cc8-4e1f-888f-bc928fb63621 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:56.959279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c158d053-4cc8-4e1f-888f-bc928fb63621 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:56.961921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c158d053-4cc8-4e1f-888f-bc928fb63621 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:56.971322 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c158d053-4cc8-4e1f-888f-bc928fb63621 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:57.032257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c158d053-4cc8-4e1f-888f-bc928fb63621 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:57:57.431810 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c158d053-4cc8-4e1f-888f-bc928fb63621 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 204 len: 0 microversion: 2.1 time: 0.507623 Oct 10 18:57:57.433074 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1131/2010] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:57:56 2022] DELETE /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:57:57.443921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5b6db0fe-4aa6-41cb-9679-c390d3989441 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:57.444952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5b6db0fe-4aa6-41cb-9679-c390d3989441 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:57.476064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b6db0fe-4aa6-41cb-9679-c390d3989441 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:57.476064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b6db0fe-4aa6-41cb-9679-c390d3989441 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:57.476064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b6db0fe-4aa6-41cb-9679-c390d3989441 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:57.476064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b6db0fe-4aa6-41cb-9679-c390d3989441 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:57.476064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b6db0fe-4aa6-41cb-9679-c390d3989441 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:57.476064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5b6db0fe-4aa6-41cb-9679-c390d3989441 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:58.479705 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5b6db0fe-4aa6-41cb-9679-c390d3989441 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:58.496278 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5b6db0fe-4aa6-41cb-9679-c390d3989441 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:58.504570 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5b6db0fe-4aa6-41cb-9679-c390d3989441 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:58.517760 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5b6db0fe-4aa6-41cb-9679-c390d3989441 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1292 microversion: 2.25 time: 1.076588 Oct 10 18:57:58.519992 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1132/2011] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:57 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1292 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:57:58.539619 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6d43f9a4-f73c-40a9-8769-2b824d81009b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:58.561382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6d43f9a4-f73c-40a9-8769-2b824d81009b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:58.579728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d43f9a4-f73c-40a9-8769-2b824d81009b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:58.580597 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d43f9a4-f73c-40a9-8769-2b824d81009b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:58.581246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d43f9a4-f73c-40a9-8769-2b824d81009b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:58.582219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d43f9a4-f73c-40a9-8769-2b824d81009b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:58.582887 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d43f9a4-f73c-40a9-8769-2b824d81009b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:58.583623 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d43f9a4-f73c-40a9-8769-2b824d81009b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:58.989905 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6d43f9a4-f73c-40a9-8769-2b824d81009b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:59.004928 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6d43f9a4-f73c-40a9-8769-2b824d81009b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1513 microversion: 2.1 time: 0.481646 Oct 10 18:57:59.020568 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1133/2012] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:58 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1513 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:59.028243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-7d0f0cf8-b370-4443-978e-3534cebfc769 req-92182b7c-3b8c-4e80-9dca-c1c7c4683e55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce27ab7-7a56-4c87-95b1-5cf9afa20f24", "tag": "b1a81c55-5504-4e91-812f-a4ea821e79f4"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:57:59.039146 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:57:59.041924 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-7d0f0cf8-b370-4443-978e-3534cebfc769 req-92182b7c-3b8c-4e80-9dca-c1c7c4683e55 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:59.042177 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-7d0f0cf8-b370-4443-978e-3534cebfc769 req-92182b7c-3b8c-4e80-9dca-c1c7c4683e55 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:59.043571 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-7d0f0cf8-b370-4443-978e-3534cebfc769 req-92182b7c-3b8c-4e80-9dca-c1c7c4683e55 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:59.100778 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-7d0f0cf8-b370-4443-978e-3534cebfc769 req-92182b7c-3b8c-4e80-9dca-c1c7c4683e55 service nova] Creating event network-changed:b1a81c55-5504-4e91-812f-a4ea821e79f4 for instance fce27ab7-7a56-4c87-95b1-5cf9afa20f24 on n-h2-860863-1 Oct 10 18:57:59.100778 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-7d0f0cf8-b370-4443-978e-3534cebfc769 req-92182b7c-3b8c-4e80-9dca-c1c7c4683e55 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077213 Oct 10 18:57:59.104892 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1134/2013] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:57:59.130654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-acd1a9d3-909e-47a2-8afe-9e9f5319725d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:59.130654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-acd1a9d3-909e-47a2-8afe-9e9f5319725d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:59.135821 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acd1a9d3-909e-47a2-8afe-9e9f5319725d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:59.135821 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acd1a9d3-909e-47a2-8afe-9e9f5319725d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:59.135821 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acd1a9d3-909e-47a2-8afe-9e9f5319725d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:59.136660 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acd1a9d3-909e-47a2-8afe-9e9f5319725d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:59.136882 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acd1a9d3-909e-47a2-8afe-9e9f5319725d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:59.138254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acd1a9d3-909e-47a2-8afe-9e9f5319725d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:59.803256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-acd1a9d3-909e-47a2-8afe-9e9f5319725d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:57:59.814074 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-acd1a9d3-909e-47a2-8afe-9e9f5319725d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1681 microversion: 2.1 time: 0.707522 Oct 10 18:57:59.815143 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1135/2014] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:57:59 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1681 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:57:59.824800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c4c640e0-ca1c-4237-8a9d-bad26fca3990 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:57:59.826287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c4c640e0-ca1c-4237-8a9d-bad26fca3990 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:57:59.837494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4c640e0-ca1c-4237-8a9d-bad26fca3990 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:59.838283 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4c640e0-ca1c-4237-8a9d-bad26fca3990 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:59.838964 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4c640e0-ca1c-4237-8a9d-bad26fca3990 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:57:59.839998 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4c640e0-ca1c-4237-8a9d-bad26fca3990 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:57:59.840684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4c640e0-ca1c-4237-8a9d-bad26fca3990 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:57:59.841338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4c640e0-ca1c-4237-8a9d-bad26fca3990 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:00.694743 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c4c640e0-ca1c-4237-8a9d-bad26fca3990 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:00.752214 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c4c640e0-ca1c-4237-8a9d-bad26fca3990 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:00.755232 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c4c640e0-ca1c-4237-8a9d-bad26fca3990 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:00.759573 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c4c640e0-ca1c-4237-8a9d-bad26fca3990 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.943151 Oct 10 18:58:00.761597 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1136/2015] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:57:59 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:00.767378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b4f45217-0d97-46bd-be46-be47046116cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:00.768636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b4f45217-0d97-46bd-be46-be47046116cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:00.777363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4f45217-0d97-46bd-be46-be47046116cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:00.778205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4f45217-0d97-46bd-be46-be47046116cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:00.779158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4f45217-0d97-46bd-be46-be47046116cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:00.780120 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4f45217-0d97-46bd-be46-be47046116cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:00.781312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4f45217-0d97-46bd-be46-be47046116cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:00.781976 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b4f45217-0d97-46bd-be46-be47046116cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:00.960670 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b4f45217-0d97-46bd-be46-be47046116cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:00.983653 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b4f45217-0d97-46bd-be46-be47046116cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:00.986087 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b4f45217-0d97-46bd-be46-be47046116cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:01.000088 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b4f45217-0d97-46bd-be46-be47046116cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.237098 Oct 10 18:58:01.000704 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1137/2016] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:00 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:01.008414 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2d95db90-e402-4c2c-b611-1935a054e0b1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:01.009054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2d95db90-e402-4c2c-b611-1935a054e0b1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:01.017970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d95db90-e402-4c2c-b611-1935a054e0b1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:01.018465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d95db90-e402-4c2c-b611-1935a054e0b1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:01.018896 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d95db90-e402-4c2c-b611-1935a054e0b1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:01.039568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d95db90-e402-4c2c-b611-1935a054e0b1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:01.039568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d95db90-e402-4c2c-b611-1935a054e0b1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:01.039568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d95db90-e402-4c2c-b611-1935a054e0b1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:01.306319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2d95db90-e402-4c2c-b611-1935a054e0b1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:01.316857 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2d95db90-e402-4c2c-b611-1935a054e0b1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:01.319140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2d95db90-e402-4c2c-b611-1935a054e0b1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:01.320362 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2d95db90-e402-4c2c-b611-1935a054e0b1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1292 microversion: 2.25 time: 0.318514 Oct 10 18:58:01.336017 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1138/2017] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:01 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1292 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:01.336017 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-53c2ee6d-ad3e-4c6c-adc9-43c7b74fe270 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:01.336017 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-53c2ee6d-ad3e-4c6c-adc9-43c7b74fe270 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:01.336017 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53c2ee6d-ad3e-4c6c-adc9-43c7b74fe270 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:01.336017 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53c2ee6d-ad3e-4c6c-adc9-43c7b74fe270 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:01.336017 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53c2ee6d-ad3e-4c6c-adc9-43c7b74fe270 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:01.336017 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53c2ee6d-ad3e-4c6c-adc9-43c7b74fe270 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:01.336017 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53c2ee6d-ad3e-4c6c-adc9-43c7b74fe270 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:01.337709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53c2ee6d-ad3e-4c6c-adc9-43c7b74fe270 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:01.477771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-53c2ee6d-ad3e-4c6c-adc9-43c7b74fe270 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:01.490478 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-53c2ee6d-ad3e-4c6c-adc9-43c7b74fe270 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1513 microversion: 2.1 time: 0.167918 Oct 10 18:58:01.491073 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1139/2018] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:01 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:01.496099 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-59173ca8-3630-4987-98f3-c123e6d6cb2b tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:01.497645 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-59173ca8-3630-4987-98f3-c123e6d6cb2b tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:01.509890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59173ca8-3630-4987-98f3-c123e6d6cb2b tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:01.510603 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59173ca8-3630-4987-98f3-c123e6d6cb2b tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:01.511325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59173ca8-3630-4987-98f3-c123e6d6cb2b tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:01.512469 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59173ca8-3630-4987-98f3-c123e6d6cb2b tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:01.513633 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59173ca8-3630-4987-98f3-c123e6d6cb2b tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:01.514322 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59173ca8-3630-4987-98f3-c123e6d6cb2b tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:01.520018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:01.850963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-59173ca8-3630-4987-98f3-c123e6d6cb2b tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:01.861219 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-59173ca8-3630-4987-98f3-c123e6d6cb2b tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1613 microversion: 2.1 time: 0.369081 Oct 10 18:58:01.862028 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1140/2019] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:01 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1613 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:01.867259 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b22678cf-ba84-4bc7-b315-008286cad1eb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:01.875132 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b22678cf-ba84-4bc7-b315-008286cad1eb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:01.881888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b22678cf-ba84-4bc7-b315-008286cad1eb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:01.883148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b22678cf-ba84-4bc7-b315-008286cad1eb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:01.883725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b22678cf-ba84-4bc7-b315-008286cad1eb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:01.884618 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b22678cf-ba84-4bc7-b315-008286cad1eb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:01.885263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b22678cf-ba84-4bc7-b315-008286cad1eb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:01.885826 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b22678cf-ba84-4bc7-b315-008286cad1eb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:02.090101 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8b62ed2d-e659-4252-b633-a4a2e53dd5d3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 200 len: 1421 microversion: 2.1 time: 8.484038 Oct 10 18:58:02.091122 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 880/2020] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:57:53 2022] GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 1421 bytes in 8486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:02.106752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-df9dfffb-d425-42a5-978a-a0a4f9b65538 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:02.111847 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-df9dfffb-d425-42a5-978a-a0a4f9b65538 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:02.128629 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-df9dfffb-d425-42a5-978a-a0a4f9b65538 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:02.133705 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-df9dfffb-d425-42a5-978a-a0a4f9b65538 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:02.134125 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-df9dfffb-d425-42a5-978a-a0a4f9b65538 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:02.135037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-df9dfffb-d425-42a5-978a-a0a4f9b65538 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:02.135516 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-df9dfffb-d425-42a5-978a-a0a4f9b65538 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:02.135946 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-df9dfffb-d425-42a5-978a-a0a4f9b65538 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:02.345988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-df9dfffb-d425-42a5-978a-a0a4f9b65538 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:02.352986 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:02.355697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-df9dfffb-d425-42a5-978a-a0a4f9b65538 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:02.367636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-df9dfffb-d425-42a5-978a-a0a4f9b65538 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:02.377816 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-df9dfffb-d425-42a5-978a-a0a4f9b65538 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1555 microversion: 2.91 time: 0.285332 Oct 10 18:58:02.378414 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 881/2021] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:02 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1555 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:02.386868 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b4c92741-7bbd-4433-9dff-574dd647561d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:02.390843 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b4c92741-7bbd-4433-9dff-574dd647561d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:02.402336 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4c92741-7bbd-4433-9dff-574dd647561d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:02.403775 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4c92741-7bbd-4433-9dff-574dd647561d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:02.405179 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4c92741-7bbd-4433-9dff-574dd647561d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:02.406373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4c92741-7bbd-4433-9dff-574dd647561d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:02.407676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4c92741-7bbd-4433-9dff-574dd647561d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:02.409082 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4c92741-7bbd-4433-9dff-574dd647561d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:02.611763 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b22678cf-ba84-4bc7-b315-008286cad1eb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:02.644719 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b22678cf-ba84-4bc7-b315-008286cad1eb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:02.652738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b22678cf-ba84-4bc7-b315-008286cad1eb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:02.655516 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b22678cf-ba84-4bc7-b315-008286cad1eb tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.790991 Oct 10 18:58:02.658383 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1141/2022] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:01 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:02.671357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bc8d74d8-f803-4198-bb53-791503e01546 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:02.674600 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bc8d74d8-f803-4198-bb53-791503e01546 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:02.689426 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc8d74d8-f803-4198-bb53-791503e01546 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:02.691540 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc8d74d8-f803-4198-bb53-791503e01546 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:02.692616 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc8d74d8-f803-4198-bb53-791503e01546 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:02.694822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc8d74d8-f803-4198-bb53-791503e01546 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:02.697450 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc8d74d8-f803-4198-bb53-791503e01546 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:02.699151 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bc8d74d8-f803-4198-bb53-791503e01546 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:02.703901 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b4c92741-7bbd-4433-9dff-574dd647561d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:02.714567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b4c92741-7bbd-4433-9dff-574dd647561d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:02.736674 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b4c92741-7bbd-4433-9dff-574dd647561d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:02.739860 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b4c92741-7bbd-4433-9dff-574dd647561d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1292 microversion: 2.25 time: 0.359124 Oct 10 18:58:02.740644 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 882/2023] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:02 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1292 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:02.770695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-590c4170-e4be-4da4-9ea9-e7f93c1f02c4 req-95cd9f45-cd35-4982-aa81-570556a55338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae3aec4-c476-4f1a-a702-2cd1548b0895", "name": "network-vif-deleted", "tag": "aee6febe-6708-48e6-afe9-c2adf2fe85c3"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:02.789213 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-590c4170-e4be-4da4-9ea9-e7f93c1f02c4 req-95cd9f45-cd35-4982-aa81-570556a55338 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:02.793963 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-590c4170-e4be-4da4-9ea9-e7f93c1f02c4 req-95cd9f45-cd35-4982-aa81-570556a55338 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:02.793963 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-590c4170-e4be-4da4-9ea9-e7f93c1f02c4 req-95cd9f45-cd35-4982-aa81-570556a55338 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:02.804386 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-590c4170-e4be-4da4-9ea9-e7f93c1f02c4 req-95cd9f45-cd35-4982-aa81-570556a55338 service nova] Creating event network-vif-deleted:aee6febe-6708-48e6-afe9-c2adf2fe85c3 for instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 on n-h1-860863-1 Oct 10 18:58:02.812828 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-590c4170-e4be-4da4-9ea9-e7f93c1f02c4 req-95cd9f45-cd35-4982-aa81-570556a55338 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071083 Oct 10 18:58:02.814051 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 883/2024] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:02.891934 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-eccbab6c-6ee2-4284-a29c-21c41849fba4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:02.892810 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-eccbab6c-6ee2-4284-a29c-21c41849fba4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:02.907189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eccbab6c-6ee2-4284-a29c-21c41849fba4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:02.912000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eccbab6c-6ee2-4284-a29c-21c41849fba4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:02.912641 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eccbab6c-6ee2-4284-a29c-21c41849fba4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:02.913612 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eccbab6c-6ee2-4284-a29c-21c41849fba4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:02.914716 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eccbab6c-6ee2-4284-a29c-21c41849fba4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:02.919576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eccbab6c-6ee2-4284-a29c-21c41849fba4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:03.091733 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-eccbab6c-6ee2-4284-a29c-21c41849fba4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:03.105210 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-eccbab6c-6ee2-4284-a29c-21c41849fba4 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1326 microversion: 2.1 time: 0.216963 Oct 10 18:58:03.121574 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 884/2025] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:02 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1326 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:03.129297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8c3bcd7c-98cc-441b-b3f0-b7dd22b82d3e tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f31922f8160>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:03.229165 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8c3bcd7c-98cc-441b-b3f0-b7dd22b82d3e tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 200 len: 1421 microversion: 2.1 time: 0.101501 Oct 10 18:58:03.237185 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 885/2026] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:03 2022] GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 1421 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:03.270487 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bc8d74d8-f803-4198-bb53-791503e01546 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:03.280881 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bc8d74d8-f803-4198-bb53-791503e01546 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1513 microversion: 2.1 time: 0.621123 Oct 10 18:58:03.286703 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1142/2027] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:02 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1513 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:03.427720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a682db05-85aa-4097-9440-f701c79e2b33 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:03.428345 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a682db05-85aa-4097-9440-f701c79e2b33 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:03.452348 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a682db05-85aa-4097-9440-f701c79e2b33 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:03.457515 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a682db05-85aa-4097-9440-f701c79e2b33 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:03.463998 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a682db05-85aa-4097-9440-f701c79e2b33 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:03.467939 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a682db05-85aa-4097-9440-f701c79e2b33 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:03.469050 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a682db05-85aa-4097-9440-f701c79e2b33 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:03.471000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a682db05-85aa-4097-9440-f701c79e2b33 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:03.596334 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a682db05-85aa-4097-9440-f701c79e2b33 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:03.606995 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a682db05-85aa-4097-9440-f701c79e2b33 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:03.609724 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a682db05-85aa-4097-9440-f701c79e2b33 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:03.618021 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a682db05-85aa-4097-9440-f701c79e2b33 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1537 microversion: 2.91 time: 0.210347 Oct 10 18:58:03.618913 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 886/2028] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:03 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1537 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:03.688462 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9d4f4e9a-4e56-4b18-b0cc-017ef15159a8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:03.689647 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9d4f4e9a-4e56-4b18-b0cc-017ef15159a8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:03.703959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d4f4e9a-4e56-4b18-b0cc-017ef15159a8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:03.706044 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d4f4e9a-4e56-4b18-b0cc-017ef15159a8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:03.725892 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d4f4e9a-4e56-4b18-b0cc-017ef15159a8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:03.731244 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d4f4e9a-4e56-4b18-b0cc-017ef15159a8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:03.734654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d4f4e9a-4e56-4b18-b0cc-017ef15159a8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:03.736439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d4f4e9a-4e56-4b18-b0cc-017ef15159a8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:03.770158 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0ac8c392-d4c7-4fb7-af62-9210285b0a1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:03.770956 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0ac8c392-d4c7-4fb7-af62-9210285b0a1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:03.780905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ac8c392-d4c7-4fb7-af62-9210285b0a1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:03.782487 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ac8c392-d4c7-4fb7-af62-9210285b0a1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:03.787408 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ac8c392-d4c7-4fb7-af62-9210285b0a1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:03.789024 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ac8c392-d4c7-4fb7-af62-9210285b0a1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:03.789667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ac8c392-d4c7-4fb7-af62-9210285b0a1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:03.790144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0ac8c392-d4c7-4fb7-af62-9210285b0a1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:04.154774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0ac8c392-d4c7-4fb7-af62-9210285b0a1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:04.173945 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0ac8c392-d4c7-4fb7-af62-9210285b0a1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:04.175670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0ac8c392-d4c7-4fb7-af62-9210285b0a1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:04.177304 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0ac8c392-d4c7-4fb7-af62-9210285b0a1f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1292 microversion: 2.25 time: 0.411174 Oct 10 18:58:04.188572 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 887/2029] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:03 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1292 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:04.188572 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b10dd334-b52a-47b7-9cea-b1b8bccad08a tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:04.188572 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b10dd334-b52a-47b7-9cea-b1b8bccad08a tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:04.199931 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:04.202051 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b10dd334-b52a-47b7-9cea-b1b8bccad08a tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:04.202640 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b10dd334-b52a-47b7-9cea-b1b8bccad08a tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:04.203287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b10dd334-b52a-47b7-9cea-b1b8bccad08a tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:04.204967 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b10dd334-b52a-47b7-9cea-b1b8bccad08a tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:04.205451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b10dd334-b52a-47b7-9cea-b1b8bccad08a tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:04.205899 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b10dd334-b52a-47b7-9cea-b1b8bccad08a tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:04.233928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9d4f4e9a-4e56-4b18-b0cc-017ef15159a8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:04.258379 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9d4f4e9a-4e56-4b18-b0cc-017ef15159a8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:04.262012 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9d4f4e9a-4e56-4b18-b0cc-017ef15159a8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:04.268209 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9d4f4e9a-4e56-4b18-b0cc-017ef15159a8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.584421 Oct 10 18:58:04.270102 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1143/2030] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:03 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:04.288390 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9ac25564-d55e-47d1-8d7b-c9cbb7094226 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f318d4e44c0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:04.308818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b10dd334-b52a-47b7-9cea-b1b8bccad08a tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:04.309502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b10dd334-b52a-47b7-9cea-b1b8bccad08a tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:04.310120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b10dd334-b52a-47b7-9cea-b1b8bccad08a tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:04.310856 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-b10dd334-b52a-47b7-9cea-b1b8bccad08a tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lazy-loading 'fault' on Instance uuid 5ae3aec4-c476-4f1a-a702-2cd1548b0895 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:58:04.367310 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b10dd334-b52a-47b7-9cea-b1b8bccad08a tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:04.394366 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b10dd334-b52a-47b7-9cea-b1b8bccad08a tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1331 microversion: 2.1 time: 0.202151 Oct 10 18:58:04.394366 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 888/2031] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:04 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1331 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:04.412490 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9ac25564-d55e-47d1-8d7b-c9cbb7094226 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 200 len: 1421 microversion: 2.1 time: 0.140520 Oct 10 18:58:04.413157 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a495ce0c-ce94-494d-a7d3-da6d045093ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:04.417380 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a495ce0c-ce94-494d-a7d3-da6d045093ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:04.428005 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1144/2032] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:04 2022] GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 1421 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:04.440305 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a495ce0c-ce94-494d-a7d3-da6d045093ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:04.440899 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a495ce0c-ce94-494d-a7d3-da6d045093ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:04.441409 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a495ce0c-ce94-494d-a7d3-da6d045093ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:04.442142 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a495ce0c-ce94-494d-a7d3-da6d045093ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:04.442589 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a495ce0c-ce94-494d-a7d3-da6d045093ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:04.443019 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a495ce0c-ce94-494d-a7d3-da6d045093ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:04.648928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f3ceb44e-9d0a-4f7e-aac6-9c89915160e9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:04.649765 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f3ceb44e-9d0a-4f7e-aac6-9c89915160e9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:04.666668 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3ceb44e-9d0a-4f7e-aac6-9c89915160e9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:04.669033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3ceb44e-9d0a-4f7e-aac6-9c89915160e9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:04.669033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3ceb44e-9d0a-4f7e-aac6-9c89915160e9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:04.669033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3ceb44e-9d0a-4f7e-aac6-9c89915160e9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:04.669033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3ceb44e-9d0a-4f7e-aac6-9c89915160e9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:04.669827 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f3ceb44e-9d0a-4f7e-aac6-9c89915160e9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:04.719354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a495ce0c-ce94-494d-a7d3-da6d045093ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:04.733498 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a495ce0c-ce94-494d-a7d3-da6d045093ce tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1513 microversion: 2.1 time: 0.340885 Oct 10 18:58:04.735633 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 889/2033] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:04 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1513 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:04.829929 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f3ceb44e-9d0a-4f7e-aac6-9c89915160e9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:04.841108 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f3ceb44e-9d0a-4f7e-aac6-9c89915160e9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:04.845755 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f3ceb44e-9d0a-4f7e-aac6-9c89915160e9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:04.856319 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f3ceb44e-9d0a-4f7e-aac6-9c89915160e9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1537 microversion: 2.91 time: 0.212048 Oct 10 18:58:04.872977 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1145/2034] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:04 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1537 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:58:05.207451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d86215be-80ca-4f62-8a48-d796017b909e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:05.208061 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d86215be-80ca-4f62-8a48-d796017b909e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:05.217367 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d86215be-80ca-4f62-8a48-d796017b909e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:05.218584 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d86215be-80ca-4f62-8a48-d796017b909e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:05.219061 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d86215be-80ca-4f62-8a48-d796017b909e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:05.219814 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d86215be-80ca-4f62-8a48-d796017b909e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:05.220278 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d86215be-80ca-4f62-8a48-d796017b909e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:05.220801 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d86215be-80ca-4f62-8a48-d796017b909e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:05.295922 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d8cbea3f-6768-46aa-a14d-7bfac1cb7b22 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:05.296962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d8cbea3f-6768-46aa-a14d-7bfac1cb7b22 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:05.304907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8cbea3f-6768-46aa-a14d-7bfac1cb7b22 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:05.306625 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8cbea3f-6768-46aa-a14d-7bfac1cb7b22 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:05.307926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8cbea3f-6768-46aa-a14d-7bfac1cb7b22 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:05.309197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8cbea3f-6768-46aa-a14d-7bfac1cb7b22 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:05.309870 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8cbea3f-6768-46aa-a14d-7bfac1cb7b22 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:05.310494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d8cbea3f-6768-46aa-a14d-7bfac1cb7b22 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:05.392495 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d86215be-80ca-4f62-8a48-d796017b909e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:05.402878 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d86215be-80ca-4f62-8a48-d796017b909e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:05.404786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d86215be-80ca-4f62-8a48-d796017b909e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:05.406004 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d86215be-80ca-4f62-8a48-d796017b909e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1280 microversion: 2.25 time: 0.202426 Oct 10 18:58:05.422055 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 890/2035] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:05 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1280 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:05.428707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2fb6c4de-71a7-45e8-9480-3e161ea2793c tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:05.430039 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2fb6c4de-71a7-45e8-9480-3e161ea2793c tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:05.447234 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6c4de-71a7-45e8-9480-3e161ea2793c tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:05.447724 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6c4de-71a7-45e8-9480-3e161ea2793c tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:05.449685 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6c4de-71a7-45e8-9480-3e161ea2793c tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:05.453043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6c4de-71a7-45e8-9480-3e161ea2793c tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:05.456619 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6c4de-71a7-45e8-9480-3e161ea2793c tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:05.457300 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6c4de-71a7-45e8-9480-3e161ea2793c tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:05.534035 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6c4de-71a7-45e8-9480-3e161ea2793c tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:05.534536 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6c4de-71a7-45e8-9480-3e161ea2793c tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:05.534979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2fb6c4de-71a7-45e8-9480-3e161ea2793c tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:05.535717 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-2fb6c4de-71a7-45e8-9480-3e161ea2793c tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lazy-loading 'fault' on Instance uuid 5ae3aec4-c476-4f1a-a702-2cd1548b0895 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:58:05.592765 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2fb6c4de-71a7-45e8-9480-3e161ea2793c tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29c40dde2f644d6fbb0b4d8c77dfb4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0646e6fd1a4e188bd1bf139a8ef575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:05.601483 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2fb6c4de-71a7-45e8-9480-3e161ea2793c tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 200 len: 1331 microversion: 2.1 time: 0.177722 Oct 10 18:58:05.614525 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 891/2036] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:05 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 1331 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:05.620401 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2b60ec34-039a-410d-81d4-1c6e4c2dba3c tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f31922929d0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:05.975351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d8cbea3f-6768-46aa-a14d-7bfac1cb7b22 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:05.986916 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d8cbea3f-6768-46aa-a14d-7bfac1cb7b22 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:05.988731 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d8cbea3f-6768-46aa-a14d-7bfac1cb7b22 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:05.989898 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d8cbea3f-6768-46aa-a14d-7bfac1cb7b22 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.697911 Oct 10 18:58:05.990797 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1146/2037] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:05 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:06.005221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-953fd7e8-a1f8-446a-bf6a-26ed6383c1dc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:06.008773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-953fd7e8-a1f8-446a-bf6a-26ed6383c1dc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:06.018417 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-953fd7e8-a1f8-446a-bf6a-26ed6383c1dc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:06.018911 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-953fd7e8-a1f8-446a-bf6a-26ed6383c1dc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:06.019431 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-953fd7e8-a1f8-446a-bf6a-26ed6383c1dc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:06.020305 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-953fd7e8-a1f8-446a-bf6a-26ed6383c1dc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:06.020879 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-953fd7e8-a1f8-446a-bf6a-26ed6383c1dc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:06.021561 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-953fd7e8-a1f8-446a-bf6a-26ed6383c1dc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:06.194348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-953fd7e8-a1f8-446a-bf6a-26ed6383c1dc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:06.204953 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-953fd7e8-a1f8-446a-bf6a-26ed6383c1dc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1490 microversion: 2.1 time: 0.212494 Oct 10 18:58:06.206000 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1147/2038] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:05 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1490 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:06.212522 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0f27dea0-ecfd-4b4f-90b4-0ecbe2dd83fe tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:06.213282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0f27dea0-ecfd-4b4f-90b4-0ecbe2dd83fe tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:06.220354 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f27dea0-ecfd-4b4f-90b4-0ecbe2dd83fe tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:06.220963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f27dea0-ecfd-4b4f-90b4-0ecbe2dd83fe tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:06.221471 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f27dea0-ecfd-4b4f-90b4-0ecbe2dd83fe tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:06.222479 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f27dea0-ecfd-4b4f-90b4-0ecbe2dd83fe tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:06.223024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f27dea0-ecfd-4b4f-90b4-0ecbe2dd83fe tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:06.223590 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f27dea0-ecfd-4b4f-90b4-0ecbe2dd83fe tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:06.315861 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0f27dea0-ecfd-4b4f-90b4-0ecbe2dd83fe tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:06.326365 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0f27dea0-ecfd-4b4f-90b4-0ecbe2dd83fe tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:06.328034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0f27dea0-ecfd-4b4f-90b4-0ecbe2dd83fe tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:06.334298 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0f27dea0-ecfd-4b4f-90b4-0ecbe2dd83fe tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1537 microversion: 2.91 time: 0.126858 Oct 10 18:58:06.335014 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1148/2039] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:06 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1537 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:06.743308 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2b60ec34-039a-410d-81d4-1c6e4c2dba3c tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 200 len: 1421 microversion: 2.1 time: 1.127350 Oct 10 18:58:06.751787 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 892/2040] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:05 2022] GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 1421 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:06.767250 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cc017e4e-15f3-4e8a-8ce6-4515368c384b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:06.767828 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cc017e4e-15f3-4e8a-8ce6-4515368c384b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:06.778595 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc017e4e-15f3-4e8a-8ce6-4515368c384b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:06.779360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc017e4e-15f3-4e8a-8ce6-4515368c384b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:06.779990 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc017e4e-15f3-4e8a-8ce6-4515368c384b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:06.780996 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc017e4e-15f3-4e8a-8ce6-4515368c384b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:06.781645 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc017e4e-15f3-4e8a-8ce6-4515368c384b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:06.782278 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc017e4e-15f3-4e8a-8ce6-4515368c384b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:06.790635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ee22e2c8-44d7-4f4a-9f3b-f39f210cd50e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:06.791228 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ee22e2c8-44d7-4f4a-9f3b-f39f210cd50e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:06.798181 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee22e2c8-44d7-4f4a-9f3b-f39f210cd50e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:06.798737 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee22e2c8-44d7-4f4a-9f3b-f39f210cd50e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:06.799495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee22e2c8-44d7-4f4a-9f3b-f39f210cd50e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:06.800392 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee22e2c8-44d7-4f4a-9f3b-f39f210cd50e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:06.800953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee22e2c8-44d7-4f4a-9f3b-f39f210cd50e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:06.801574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ee22e2c8-44d7-4f4a-9f3b-f39f210cd50e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:06.834951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ee22e2c8-44d7-4f4a-9f3b-f39f210cd50e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:58:06.942442 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cc017e4e-15f3-4e8a-8ce6-4515368c384b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:06.954472 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cc017e4e-15f3-4e8a-8ce6-4515368c384b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:06.956316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cc017e4e-15f3-4e8a-8ce6-4515368c384b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:06.957508 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cc017e4e-15f3-4e8a-8ce6-4515368c384b tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1280 microversion: 2.25 time: 0.204552 Oct 10 18:58:06.958280 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 893/2041] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:06 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1280 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:06.963573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cf75bbbf-07a4-48ca-9111-ecf9f97d5034 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:06.964488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cf75bbbf-07a4-48ca-9111-ecf9f97d5034 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:06.984310 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf75bbbf-07a4-48ca-9111-ecf9f97d5034 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:06.984869 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf75bbbf-07a4-48ca-9111-ecf9f97d5034 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:06.985312 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf75bbbf-07a4-48ca-9111-ecf9f97d5034 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:06.986043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf75bbbf-07a4-48ca-9111-ecf9f97d5034 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:06.986502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf75bbbf-07a4-48ca-9111-ecf9f97d5034 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:06.987003 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf75bbbf-07a4-48ca-9111-ecf9f97d5034 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:07.006513 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-cf75bbbf-07a4-48ca-9111-ecf9f97d5034 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] HTTP exception thrown: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cf75bbbf-07a4-48ca-9111-ecf9f97d5034 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Request method failure captured: Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 HTTP/1.1 Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGp-SHupOQm8vMwU7lD4CtXv2zlfeLyqxnFBRXOzv1psmCQVYx_ERyxHcGz8q8EyjbnqptYJ9aDqBYo2__SnvQn1ypIjiEf4DZmKHFDOcAL8874LY6E8Iu-gG7i1iK78n692e3r254u4SgCsLgKrnnXdGh_0u3T_osy4Fy4B7aMF6wk Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 1d0646e6fd1a4e188bd1bf139a8ef575 Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1464284874 Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1d0646e6fd1a4e188bd1bf139a8ef575", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1d0646e6fd1a4e188bd1bf139a8ef575"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0646e6fd1a4e188bd1bf139a8ef575"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0646e6fd1a4e188bd1bf139a8ef575"}]}] Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1464284874 Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 1d0646e6fd1a4e188bd1bf139a8ef575 Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1464284874 Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AttachSCSIVolumeTestJSON-1464284874-project Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 29c40dde2f644d6fbb0b4d8c77dfb4f3 Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1464284874-project Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '5ae3aec4-c476-4f1a-a702-2cd1548b0895'} Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:07.008293 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:07.016223 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:07.016223 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:07.016223 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:07.016223 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:07.016223 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:07.016223 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:07.016223 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:07.016223 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cf75bbbf-07a4-48ca-9111-ecf9f97d5034 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Returning 404 to user: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:07.016223 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cf75bbbf-07a4-48ca-9111-ecf9f97d5034 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 404 len: 111 microversion: 2.1 time: 0.050142 Oct 10 18:58:07.016223 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 894/2042] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:06 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:07.022066 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-71cc7250-5798-4d4f-b6c7-bbf915ede7d1 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Calling method '.version_select at 0x7f3192292280>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:07.081414 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-71cc7250-5798-4d4f-b6c7-bbf915ede7d1 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "GET /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459" status: 200 len: 637 microversion: 2.1 time: 0.069992 Oct 10 18:58:07.082558 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 895/2043] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:07 2022] GET /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459 => generated 637 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:07.087734 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6769e184-6c2d-48f5-b186-a15cc6f6da4b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:07.092339 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6769e184-6c2d-48f5-b186-a15cc6f6da4b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:07.103394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6769e184-6c2d-48f5-b186-a15cc6f6da4b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:07.108299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6769e184-6c2d-48f5-b186-a15cc6f6da4b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:07.108299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6769e184-6c2d-48f5-b186-a15cc6f6da4b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:07.108299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6769e184-6c2d-48f5-b186-a15cc6f6da4b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:07.108299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6769e184-6c2d-48f5-b186-a15cc6f6da4b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:07.108299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6769e184-6c2d-48f5-b186-a15cc6f6da4b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:07.246340 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ee22e2c8-44d7-4f4a-9f3b-f39f210cd50e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 204 len: 0 microversion: 2.1 time: 0.909521 Oct 10 18:58:07.303758 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1149/2044] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:58:06 2022] DELETE /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 0 bytes in 911 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:58:07.303758 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-724d5e20-3d1b-473c-a7f1-4cbf0c730917 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '.version_select at 0x7f318d681c10>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:07.337632 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6769e184-6c2d-48f5-b186-a15cc6f6da4b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:07.347198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6769e184-6c2d-48f5-b186-a15cc6f6da4b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:07.348692 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6769e184-6c2d-48f5-b186-a15cc6f6da4b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:07.349875 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6769e184-6c2d-48f5-b186-a15cc6f6da4b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.266225 Oct 10 18:58:07.350432 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 896/2045] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:07 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:07.355574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-56ed5eee-b7a3-4ee7-a819-6d36114e6b57 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Action: 'update_all', calling method: .version_select at 0x7f31923625e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:07.403440 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-56ed5eee-b7a3-4ee7-a819-6d36114e6b57 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:58:07.408072 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-56ed5eee-b7a3-4ee7-a819-6d36114e6b57 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for user 79446f26d8134b3d941a10368a579419 and project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:58:07.992577 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-724d5e20-3d1b-473c-a7f1-4cbf0c730917 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300263267" status: 202 len: 0 microversion: 2.1 time: 0.743931 Oct 10 18:58:07.993158 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1150/2046] 10.222.0.43 () {58 vars in 1221 bytes} [Mon Oct 10 18:58:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300263267 => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:58:08.007246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-34a48f80-7510-44b2-b9fe-3db242fe5b27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:08.007246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-34a48f80-7510-44b2-b9fe-3db242fe5b27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:08.007246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34a48f80-7510-44b2-b9fe-3db242fe5b27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:08.007246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34a48f80-7510-44b2-b9fe-3db242fe5b27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:08.007246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34a48f80-7510-44b2-b9fe-3db242fe5b27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:08.007246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34a48f80-7510-44b2-b9fe-3db242fe5b27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:08.008386 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34a48f80-7510-44b2-b9fe-3db242fe5b27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:08.008726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-34a48f80-7510-44b2-b9fe-3db242fe5b27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:08.106560 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-56ed5eee-b7a3-4ee7-a819-6d36114e6b57 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata" status: 200 len: 61 microversion: 2.1 time: 0.755020 Oct 10 18:58:08.107148 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 897/2047] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:58:07 2022] PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata => generated 61 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:58:08.118386 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a246c241-b7f4-4eec-bb42-77093f7e19b2 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:08.124361 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a246c241-b7f4-4eec-bb42-77093f7e19b2 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:08.134622 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a246c241-b7f4-4eec-bb42-77093f7e19b2 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:08.135352 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a246c241-b7f4-4eec-bb42-77093f7e19b2 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:08.136046 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a246c241-b7f4-4eec-bb42-77093f7e19b2 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:08.137073 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a246c241-b7f4-4eec-bb42-77093f7e19b2 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:08.137746 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a246c241-b7f4-4eec-bb42-77093f7e19b2 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:08.138378 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a246c241-b7f4-4eec-bb42-77093f7e19b2 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:08.234586 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a246c241-b7f4-4eec-bb42-77093f7e19b2 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:08.235365 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-34a48f80-7510-44b2-b9fe-3db242fe5b27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:08.244690 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-34a48f80-7510-44b2-b9fe-3db242fe5b27 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1496 microversion: 2.1 time: 0.250382 Oct 10 18:58:08.260866 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a246c241-b7f4-4eec-bb42-77093f7e19b2 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:08.262312 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1151/2048] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:07 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1496 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:08.262788 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a246c241-b7f4-4eec-bb42-77093f7e19b2 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:08.268024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0a3fc57f-83db-4135-bcc1-e4f77592adb9 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f318d582dc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:08.271690 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a246c241-b7f4-4eec-bb42-77093f7e19b2 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1480 microversion: 2.91 time: 0.158677 Oct 10 18:58:08.272371 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 898/2049] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:08 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1480 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:08.289427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0c191176-4748-4944-abb8-e1cbcaa6ddf3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:08.290022 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0c191176-4748-4944-abb8-e1cbcaa6ddf3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:08.302707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c191176-4748-4944-abb8-e1cbcaa6ddf3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:08.303194 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c191176-4748-4944-abb8-e1cbcaa6ddf3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:08.303621 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c191176-4748-4944-abb8-e1cbcaa6ddf3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:08.305018 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c191176-4748-4944-abb8-e1cbcaa6ddf3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:08.305470 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c191176-4748-4944-abb8-e1cbcaa6ddf3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:08.305903 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c191176-4748-4944-abb8-e1cbcaa6ddf3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:08.368662 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0a3fc57f-83db-4135-bcc1-e4f77592adb9 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 200 len: 1421 microversion: 2.1 time: 0.104543 Oct 10 18:58:08.369264 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1152/2050] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:08 2022] GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 1421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:08.378294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-06682204-0697-4e91-8678-854bfdceadca tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Calling method '.version_select at 0x7f318e933c10>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:08.532557 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0c191176-4748-4944-abb8-e1cbcaa6ddf3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:08.568961 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0c191176-4748-4944-abb8-e1cbcaa6ddf3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:08.572432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0c191176-4748-4944-abb8-e1cbcaa6ddf3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:08.573701 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0c191176-4748-4944-abb8-e1cbcaa6ddf3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1280 microversion: 2.25 time: 0.299374 Oct 10 18:58:08.588559 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 899/2051] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:08 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1280 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:08.588559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f519aa55-c16f-4906-a7d0-0fd66835d92e tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-860863-1"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:08.588559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f519aa55-c16f-4906-a7d0-0fd66835d92e tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:08.588559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f519aa55-c16f-4906-a7d0-0fd66835d92e tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:08.590059 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f519aa55-c16f-4906-a7d0-0fd66835d92e tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:08.590059 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f519aa55-c16f-4906-a7d0-0fd66835d92e tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:08.590059 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f519aa55-c16f-4906-a7d0-0fd66835d92e tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:08.590363 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f519aa55-c16f-4906-a7d0-0fd66835d92e tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:08.590941 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f519aa55-c16f-4906-a7d0-0fd66835d92e tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:08.684486 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f519aa55-c16f-4906-a7d0-0fd66835d92e tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-860863-1". {{(pid=127289) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 10 18:58:08.996578 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-06682204-0697-4e91-8678-854bfdceadca tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "DELETE /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.626251 Oct 10 18:58:08.997504 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1153/2052] 10.222.0.43 () {58 vars in 1296 bytes} [Mon Oct 10 18:58:08 2022] DELETE /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata/os_version => generated 0 bytes in 628 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:58:09.003024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d0e16b4b-396c-45b3-80ed-794d9c26cb9d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:09.003836 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d0e16b4b-396c-45b3-80ed-794d9c26cb9d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:09.022596 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0e16b4b-396c-45b3-80ed-794d9c26cb9d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:09.024771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0e16b4b-396c-45b3-80ed-794d9c26cb9d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:09.026345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0e16b4b-396c-45b3-80ed-794d9c26cb9d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:09.028342 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0e16b4b-396c-45b3-80ed-794d9c26cb9d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:09.030745 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0e16b4b-396c-45b3-80ed-794d9c26cb9d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:09.031290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d0e16b4b-396c-45b3-80ed-794d9c26cb9d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:09.051433 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f519aa55-c16f-4906-a7d0-0fd66835d92e tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63/action" status: 202 len: 0 microversion: 2.91 time: 0.471308 Oct 10 18:58:09.054484 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 900/2053] 10.222.0.43 () {62 vars in 1319 bytes} [Mon Oct 10 18:58:08 2022] POST /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:58:09.072201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ffe48dd1-4ec4-4efb-8a19-701bd27af3d2 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Calling method '.version_select at 0x7f3192362670>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:09.151237 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ffe48dd1-4ec4-4efb-8a19-701bd27af3d2 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "GET /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata" status: 200 len: 37 microversion: 2.1 time: 0.095250 Oct 10 18:58:09.152263 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 901/2054] 10.222.0.43 () {58 vars in 1260 bytes} [Mon Oct 10 18:58:09 2022] GET /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata => generated 37 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:58:09.162812 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cbff942c-2445-4e40-9de7-6492eabae53c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:09.165594 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cbff942c-2445-4e40-9de7-6492eabae53c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:09.174955 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cbff942c-2445-4e40-9de7-6492eabae53c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:09.176504 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cbff942c-2445-4e40-9de7-6492eabae53c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:09.177330 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cbff942c-2445-4e40-9de7-6492eabae53c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:09.178334 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cbff942c-2445-4e40-9de7-6492eabae53c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:09.179354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cbff942c-2445-4e40-9de7-6492eabae53c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:09.180023 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cbff942c-2445-4e40-9de7-6492eabae53c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:09.354617 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cbff942c-2445-4e40-9de7-6492eabae53c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:09.360091 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:09.370203 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cbff942c-2445-4e40-9de7-6492eabae53c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:09.373462 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cbff942c-2445-4e40-9de7-6492eabae53c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:09.387485 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cbff942c-2445-4e40-9de7-6492eabae53c tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1488 microversion: 2.91 time: 0.233438 Oct 10 18:58:09.389075 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 902/2055] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:09 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1488 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:09.405430 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9400a1a9-ebbb-4c20-88a0-79a0e2ef2717 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Action: 'update_all', calling method: .version_select at 0x7f3192280af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:09.483587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d0e16b4b-396c-45b3-80ed-794d9c26cb9d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:09.494206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d0e16b4b-396c-45b3-80ed-794d9c26cb9d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:09.495872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d0e16b4b-396c-45b3-80ed-794d9c26cb9d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:09.497664 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d0e16b4b-396c-45b3-80ed-794d9c26cb9d tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.498780 Oct 10 18:58:09.498989 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1154/2056] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:08 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:09.504897 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f52e09a3-806c-4c94-88ac-26f323e01a5d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:09.505791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f52e09a3-806c-4c94-88ac-26f323e01a5d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:09.514698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f52e09a3-806c-4c94-88ac-26f323e01a5d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:09.515533 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f52e09a3-806c-4c94-88ac-26f323e01a5d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:09.516123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f52e09a3-806c-4c94-88ac-26f323e01a5d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:09.517124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f52e09a3-806c-4c94-88ac-26f323e01a5d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:09.517888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f52e09a3-806c-4c94-88ac-26f323e01a5d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:09.518633 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f52e09a3-806c-4c94-88ac-26f323e01a5d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:09.527135 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-9400a1a9-ebbb-4c20-88a0-79a0e2ef2717 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:58:09.535117 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-9400a1a9-ebbb-4c20-88a0-79a0e2ef2717 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for user 79446f26d8134b3d941a10368a579419 and project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:58:09.809163 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f52e09a3-806c-4c94-88ac-26f323e01a5d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:09.822675 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f52e09a3-806c-4c94-88ac-26f323e01a5d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 200 len: 1496 microversion: 2.1 time: 0.322019 Oct 10 18:58:09.824525 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1155/2057] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:09 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 1496 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:09.830601 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3df3affb-ad4c-498e-bc22-243a039a0b38 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f318d4b5f70>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:12.266285 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3df3affb-ad4c-498e-bc22-243a039a0b38 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 200 len: 1421 microversion: 2.1 time: 2.440337 Oct 10 18:58:12.268581 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1156/2058] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:09 2022] GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 1421 bytes in 2443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:12.281265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-84a167d7-1ff7-4e98-9c11-8c4a825adbfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:12.282876 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-84a167d7-1ff7-4e98-9c11-8c4a825adbfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:12.296934 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84a167d7-1ff7-4e98-9c11-8c4a825adbfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:12.297606 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84a167d7-1ff7-4e98-9c11-8c4a825adbfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:12.298203 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84a167d7-1ff7-4e98-9c11-8c4a825adbfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:12.298935 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84a167d7-1ff7-4e98-9c11-8c4a825adbfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:12.299533 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84a167d7-1ff7-4e98-9c11-8c4a825adbfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:12.300103 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-84a167d7-1ff7-4e98-9c11-8c4a825adbfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:12.324389 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9400a1a9-ebbb-4c20-88a0-79a0e2ef2717 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata" status: 200 len: 61 microversion: 2.1 time: 2.932207 Oct 10 18:58:12.325142 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 903/2059] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:58:09 2022] PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata => generated 61 bytes in 2934 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:58:12.337161 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-9926e2af-c11a-4cb2-a007-4b50c279bda6 req-9c474ec4-d42d-455f-a304-a3c2bed5af0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8256637b-2667-49ec-9a24-a81063c7f99e", "name": "network-vif-deleted", "tag": "f3464126-5ac2-4204-b63d-48a0e6feed21"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:12.349887 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-9926e2af-c11a-4cb2-a007-4b50c279bda6 req-9c474ec4-d42d-455f-a304-a3c2bed5af0a service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:12.353771 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-9926e2af-c11a-4cb2-a007-4b50c279bda6 req-9c474ec4-d42d-455f-a304-a3c2bed5af0a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:12.354689 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-9926e2af-c11a-4cb2-a007-4b50c279bda6 req-9c474ec4-d42d-455f-a304-a3c2bed5af0a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:12.372033 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-9926e2af-c11a-4cb2-a007-4b50c279bda6 req-9c474ec4-d42d-455f-a304-a3c2bed5af0a service nova] Creating event network-vif-deleted:f3464126-5ac2-4204-b63d-48a0e6feed21 for instance 8256637b-2667-49ec-9a24-a81063c7f99e on n-h2-860863-1 Oct 10 18:58:12.384338 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-9926e2af-c11a-4cb2-a007-4b50c279bda6 req-9c474ec4-d42d-455f-a304-a3c2bed5af0a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048257 Oct 10 18:58:12.388708 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 904/2060] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:12.395565 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7dd6a16c-433b-4ad4-a4ed-4ad29e1620c8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:12.396991 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7dd6a16c-433b-4ad4-a4ed-4ad29e1620c8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:12.406464 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7dd6a16c-433b-4ad4-a4ed-4ad29e1620c8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:12.408665 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7dd6a16c-433b-4ad4-a4ed-4ad29e1620c8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:12.410149 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7dd6a16c-433b-4ad4-a4ed-4ad29e1620c8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:12.411349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7dd6a16c-433b-4ad4-a4ed-4ad29e1620c8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:12.411954 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7dd6a16c-433b-4ad4-a4ed-4ad29e1620c8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:12.412563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7dd6a16c-433b-4ad4-a4ed-4ad29e1620c8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:12.530037 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7dd6a16c-433b-4ad4-a4ed-4ad29e1620c8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:12.543348 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7dd6a16c-433b-4ad4-a4ed-4ad29e1620c8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:12.547264 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7dd6a16c-433b-4ad4-a4ed-4ad29e1620c8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:12.563792 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7dd6a16c-433b-4ad4-a4ed-4ad29e1620c8 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.173312 Oct 10 18:58:12.566832 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 905/2061] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:12 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:12.574573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4de4e7ab-1d8e-4285-833d-258f59e4501b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:12.577155 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4de4e7ab-1d8e-4285-833d-258f59e4501b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:12.584454 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4de4e7ab-1d8e-4285-833d-258f59e4501b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:12.585280 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4de4e7ab-1d8e-4285-833d-258f59e4501b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:12.586039 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4de4e7ab-1d8e-4285-833d-258f59e4501b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:12.586933 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4de4e7ab-1d8e-4285-833d-258f59e4501b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:12.587556 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4de4e7ab-1d8e-4285-833d-258f59e4501b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:12.588145 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4de4e7ab-1d8e-4285-833d-258f59e4501b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:12.607277 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-84a167d7-1ff7-4e98-9c11-8c4a825adbfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:12.641976 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-84a167d7-1ff7-4e98-9c11-8c4a825adbfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:12.646030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-84a167d7-1ff7-4e98-9c11-8c4a825adbfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:12.651741 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-84a167d7-1ff7-4e98-9c11-8c4a825adbfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1280 microversion: 2.25 time: 0.381919 Oct 10 18:58:12.652512 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1157/2062] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:12 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1280 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:12.669613 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-39e800fc-6438-4dd5-9f68-8593d4613672 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:12.670242 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-39e800fc-6438-4dd5-9f68-8593d4613672 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:12.682755 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39e800fc-6438-4dd5-9f68-8593d4613672 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:12.684087 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39e800fc-6438-4dd5-9f68-8593d4613672 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:12.684087 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39e800fc-6438-4dd5-9f68-8593d4613672 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:12.684379 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39e800fc-6438-4dd5-9f68-8593d4613672 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:12.684865 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39e800fc-6438-4dd5-9f68-8593d4613672 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:12.685463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-39e800fc-6438-4dd5-9f68-8593d4613672 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:12.720596 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-39e800fc-6438-4dd5-9f68-8593d4613672 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-39e800fc-6438-4dd5-9f68-8593d4613672 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e HTTP/1.1 Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '8256637b-2667-49ec-9a24-a81063c7f99e'} Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:12.726272 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:12.732239 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:12.732239 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:12.732239 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:12.732239 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:12.732239 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:12.732239 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:12.732239 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:12.734407 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-39e800fc-6438-4dd5-9f68-8593d4613672 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:12.735742 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-39e800fc-6438-4dd5-9f68-8593d4613672 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 404 len: 111 microversion: 2.1 time: 0.070327 Oct 10 18:58:12.736803 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1158/2063] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:12 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:12.753108 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ce54ec15-c789-40e2-abb1-e49ccc57718a tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Calling method '.version_select at 0x7f318d5a7040>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:12.802505 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ce54ec15-c789-40e2-abb1-e49ccc57718a tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "GET /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.063988 Oct 10 18:58:12.803070 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1159/2064] 10.222.0.43 () {58 vars in 1290 bytes} [Mon Oct 10 18:58:12 2022] GET /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata/os_distro => generated 33 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:58:12.814767 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d8e51179-bbfb-4550-9927-07ff95744d04 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Action: 'update_all', calling method: .version_select at 0x7f318d582280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:12.874886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-d8e51179-bbfb-4550-9927-07ff95744d04 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:58:12.880225 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-d8e51179-bbfb-4550-9927-07ff95744d04 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for user 79446f26d8134b3d941a10368a579419 and project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:58:12.919243 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4de4e7ab-1d8e-4285-833d-258f59e4501b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:12.929924 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4de4e7ab-1d8e-4285-833d-258f59e4501b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:12.931396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4de4e7ab-1d8e-4285-833d-258f59e4501b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:12.932588 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4de4e7ab-1d8e-4285-833d-258f59e4501b tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.363234 Oct 10 18:58:12.933330 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 906/2065] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:12 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:12.937988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1017941050", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "737898c7-94e7-46dc-b9d9-724fb5cc9d52"}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:13.037735 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] validate_networks() for [('737898c7-94e7-46dc-b9d9-724fb5cc9d52', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:58:13.122973 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d8e51179-bbfb-4550-9927-07ff95744d04 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata" status: 200 len: 61 microversion: 2.1 time: 0.312041 Oct 10 18:58:13.123573 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1160/2066] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:58:12 2022] PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata => generated 61 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:58:13.132952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a31a8f7d-5b7f-4808-a34d-623da7c70b43 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Calling method '.version_select at 0x7f318d669280>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:13.221339 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a31a8f7d-5b7f-4808-a34d-623da7c70b43 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "GET /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata" status: 200 len: 61 microversion: 2.1 time: 0.092064 Oct 10 18:58:13.224227 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1161/2067] 10.222.0.43 () {58 vars in 1260 bytes} [Mon Oct 10 18:58:13 2022] GET /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata => generated 61 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 18:58:13.242450 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-66a13bd3-86e9-403c-979f-6e79047c900c tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Action: 'update_all', calling method: .version_select at 0x7f318d4b50d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:13.336360 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-66a13bd3-86e9-403c-979f-6e79047c900c tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:58:13.346429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-66a13bd3-86e9-403c-979f-6e79047c900c tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for user 79446f26d8134b3d941a10368a579419 and project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:58:14.128983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:58:14.130991 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:58:14.131651 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:58:14.133301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:58:14.133942 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:58:14.153265 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:14.154002 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:14.154744 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:14.155551 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:14.156095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:14.156632 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:14.185874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Getting quotas for project c5d5fb01be0c409d98c222551a2c0e2e. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:58:14.209679 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Getting quotas for user afedfd9cc5b241ad97e27f6e911244a1 and project c5d5fb01be0c409d98c222551a2c0e2e. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:58:14.272084 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:58:14.279639 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:58:14.511953 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8a390587-4b07-446c-9a9e-203b99bae7c2 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.577183 Oct 10 18:58:14.512765 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 907/2068] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:58:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:58:14.523946 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-38c3859d-db07-4d17-ad29-6b03a47d84bd tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f3192362700>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:15.472725 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-66a13bd3-86e9-403c-979f-6e79047c900c tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata" status: 200 len: 61 microversion: 2.1 time: 2.240202 Oct 10 18:58:15.475524 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1162/2069] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:58:13 2022] PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata => generated 61 bytes in 2242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:58:15.483005 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ea230b34-c168-4834-8353-65d3d1917078 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:15.483821 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ea230b34-c168-4834-8353-65d3d1917078 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:15.503025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea230b34-c168-4834-8353-65d3d1917078 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:15.503532 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea230b34-c168-4834-8353-65d3d1917078 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:15.503976 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea230b34-c168-4834-8353-65d3d1917078 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:15.506082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea230b34-c168-4834-8353-65d3d1917078 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:15.509896 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea230b34-c168-4834-8353-65d3d1917078 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:15.509896 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ea230b34-c168-4834-8353-65d3d1917078 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:15.622236 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-38c3859d-db07-4d17-ad29-6b03a47d84bd tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 200 len: 1430 microversion: 2.1 time: 1.101671 Oct 10 18:58:15.623914 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 908/2070] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:14 2022] GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 1430 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:15.630580 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f463f2cf-bdbb-478c-b141-b0a6fd12a987 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:15.631426 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f463f2cf-bdbb-478c-b141-b0a6fd12a987 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:15.646692 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f463f2cf-bdbb-478c-b141-b0a6fd12a987 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:15.647426 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f463f2cf-bdbb-478c-b141-b0a6fd12a987 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:15.647940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ea230b34-c168-4834-8353-65d3d1917078 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:15.648231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f463f2cf-bdbb-478c-b141-b0a6fd12a987 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:15.649151 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f463f2cf-bdbb-478c-b141-b0a6fd12a987 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:15.649952 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f463f2cf-bdbb-478c-b141-b0a6fd12a987 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:15.650530 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f463f2cf-bdbb-478c-b141-b0a6fd12a987 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:15.659505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ea230b34-c168-4834-8353-65d3d1917078 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:15.663190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ea230b34-c168-4834-8353-65d3d1917078 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:15.672453 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ea230b34-c168-4834-8353-65d3d1917078 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.193436 Oct 10 18:58:15.673425 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1163/2071] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:15 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:15.696380 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3c3e450a-65ea-4554-a15f-67eaf9bc9791 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:15.705210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3c3e450a-65ea-4554-a15f-67eaf9bc9791 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:15.718893 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c3e450a-65ea-4554-a15f-67eaf9bc9791 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:15.722827 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c3e450a-65ea-4554-a15f-67eaf9bc9791 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:15.723765 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c3e450a-65ea-4554-a15f-67eaf9bc9791 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:15.726485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c3e450a-65ea-4554-a15f-67eaf9bc9791 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:15.727855 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c3e450a-65ea-4554-a15f-67eaf9bc9791 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:15.733340 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3c3e450a-65ea-4554-a15f-67eaf9bc9791 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:15.906210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f463f2cf-bdbb-478c-b141-b0a6fd12a987 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:15.963386 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f463f2cf-bdbb-478c-b141-b0a6fd12a987 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:15.966488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f463f2cf-bdbb-478c-b141-b0a6fd12a987 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:15.978418 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f463f2cf-bdbb-478c-b141-b0a6fd12a987 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1280 microversion: 2.25 time: 0.342645 Oct 10 18:58:16.003493 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 909/2072] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:15 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1280 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:16.022654 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4ff17c7b-afe1-40b3-af99-0b05158a690b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:16.031565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3c3e450a-65ea-4554-a15f-67eaf9bc9791 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:16.033945 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4ff17c7b-afe1-40b3-af99-0b05158a690b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:16.041382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:16.046056 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3c3e450a-65ea-4554-a15f-67eaf9bc9791 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:16.051822 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ff17c7b-afe1-40b3-af99-0b05158a690b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:16.053547 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ff17c7b-afe1-40b3-af99-0b05158a690b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:16.059359 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ff17c7b-afe1-40b3-af99-0b05158a690b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:16.061375 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ff17c7b-afe1-40b3-af99-0b05158a690b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:16.064581 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ff17c7b-afe1-40b3-af99-0b05158a690b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:16.064702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3c3e450a-65ea-4554-a15f-67eaf9bc9791 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:16.064830 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4ff17c7b-afe1-40b3-af99-0b05158a690b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:16.064921 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3c3e450a-65ea-4554-a15f-67eaf9bc9791 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.389507 Oct 10 18:58:16.089435 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1164/2073] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:15 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:16.099259 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e5ec0420-8043-4d47-b3f0-9510583eabc9 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Action: 'update_all', calling method: .version_select at 0x7f318d5a7f70>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:16.184195 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4ff17c7b-afe1-40b3-af99-0b05158a690b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:16.189717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-e5ec0420-8043-4d47-b3f0-9510583eabc9 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:58:16.198248 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4ff17c7b-afe1-40b3-af99-0b05158a690b tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1219 microversion: 2.1 time: 0.189563 Oct 10 18:58:16.199263 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 910/2074] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:16 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1219 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:16.211758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e37eab37-1521-4aae-9612-9f4107ac4d48 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f319225aca0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:16.244334 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-e5ec0420-8043-4d47-b3f0-9510583eabc9 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for user 79446f26d8134b3d941a10368a579419 and project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:58:16.319289 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e37eab37-1521-4aae-9612-9f4107ac4d48 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 200 len: 1430 microversion: 2.1 time: 0.116275 Oct 10 18:58:16.321917 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 911/2075] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:16 2022] GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 1430 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:16.328327 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-f14cbcae-fabc-4c7a-aa90-ba71d3a3916c req-4cea6fda-edcb-4ab1-b721-25f4bc719026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce27ab7-7a56-4c87-95b1-5cf9afa20f24", "name": "network-vif-plugged", "status": "completed", "tag": "b1a81c55-5504-4e91-812f-a4ea821e79f4"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:16.343146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f14cbcae-fabc-4c7a-aa90-ba71d3a3916c req-4cea6fda-edcb-4ab1-b721-25f4bc719026 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:16.343529 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f14cbcae-fabc-4c7a-aa90-ba71d3a3916c req-4cea6fda-edcb-4ab1-b721-25f4bc719026 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:16.344488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f14cbcae-fabc-4c7a-aa90-ba71d3a3916c req-4cea6fda-edcb-4ab1-b721-25f4bc719026 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:16.371281 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-f14cbcae-fabc-4c7a-aa90-ba71d3a3916c req-4cea6fda-edcb-4ab1-b721-25f4bc719026 service nova] Creating event network-vif-plugged:b1a81c55-5504-4e91-812f-a4ea821e79f4 for instance fce27ab7-7a56-4c87-95b1-5cf9afa20f24 on n-h2-860863-1 Oct 10 18:58:16.383411 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-f14cbcae-fabc-4c7a-aa90-ba71d3a3916c req-4cea6fda-edcb-4ab1-b721-25f4bc719026 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058841 Oct 10 18:58:16.388243 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 912/2076] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:16.401485 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e45fdc3a-2c7d-4b45-8f3c-66ad12edda3b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:16.402574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e45fdc3a-2c7d-4b45-8f3c-66ad12edda3b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:16.420669 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e45fdc3a-2c7d-4b45-8f3c-66ad12edda3b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:16.422653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e45fdc3a-2c7d-4b45-8f3c-66ad12edda3b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:16.423119 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e45fdc3a-2c7d-4b45-8f3c-66ad12edda3b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:16.423858 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e45fdc3a-2c7d-4b45-8f3c-66ad12edda3b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:16.424527 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e45fdc3a-2c7d-4b45-8f3c-66ad12edda3b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:16.438160 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e45fdc3a-2c7d-4b45-8f3c-66ad12edda3b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:16.705154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e45fdc3a-2c7d-4b45-8f3c-66ad12edda3b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:16.718933 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e45fdc3a-2c7d-4b45-8f3c-66ad12edda3b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1467 microversion: 2.1 time: 0.329330 Oct 10 18:58:16.719757 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 913/2077] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:16 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1467 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:16.728949 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a9fc9430-bec8-4647-98b4-19e1efa111cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:16.729872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a9fc9430-bec8-4647-98b4-19e1efa111cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:16.750354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9fc9430-bec8-4647-98b4-19e1efa111cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:16.750953 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9fc9430-bec8-4647-98b4-19e1efa111cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:16.751466 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9fc9430-bec8-4647-98b4-19e1efa111cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:16.752270 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9fc9430-bec8-4647-98b4-19e1efa111cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:16.752812 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9fc9430-bec8-4647-98b4-19e1efa111cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:16.753442 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9fc9430-bec8-4647-98b4-19e1efa111cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:16.887305 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a9fc9430-bec8-4647-98b4-19e1efa111cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:16.912774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a9fc9430-bec8-4647-98b4-19e1efa111cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:16.916301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a9fc9430-bec8-4647-98b4-19e1efa111cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:16.928889 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a9fc9430-bec8-4647-98b4-19e1efa111cf tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.206833 Oct 10 18:58:16.931359 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 914/2078] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:16 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:16.976525 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-35f377b8-808c-46f9-9a1b-d23bd8695ee3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f3192362550>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:17.023645 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e5ec0420-8043-4d47-b3f0-9510583eabc9 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata" status: 200 len: 64 microversion: 2.1 time: 0.932973 Oct 10 18:58:17.025156 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1165/2079] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:58:16 2022] PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata => generated 64 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:58:17.032172 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-42c027a1-c643-4566-bc95-91d433888e43 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:17.036509 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-42c027a1-c643-4566-bc95-91d433888e43 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:17.049476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42c027a1-c643-4566-bc95-91d433888e43 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:17.052366 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42c027a1-c643-4566-bc95-91d433888e43 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:17.056480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42c027a1-c643-4566-bc95-91d433888e43 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:17.057358 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42c027a1-c643-4566-bc95-91d433888e43 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:17.057847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42c027a1-c643-4566-bc95-91d433888e43 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:17.062888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42c027a1-c643-4566-bc95-91d433888e43 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:17.099239 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-35f377b8-808c-46f9-9a1b-d23bd8695ee3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/b0a280ee-26ee-4c9a-8155-4326e368ccc9" status: 200 len: 784 microversion: 2.1 time: 0.164849 Oct 10 18:58:17.100126 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 915/2080] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:16 2022] GET /compute/v2.1/images/b0a280ee-26ee-4c9a-8155-4326e368ccc9 => generated 784 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:17.104943 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ba16d837-82e1-4c0d-89f2-e1dbad6c8d21 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Calling method '.version_select at 0x7f31922804c0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:17.184556 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ba16d837-82e1-4c0d-89f2-e1dbad6c8d21 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "GET /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata" status: 200 len: 64 microversion: 2.1 time: 0.083123 Oct 10 18:58:17.185645 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 916/2081] 10.222.0.43 () {58 vars in 1260 bytes} [Mon Oct 10 18:58:17 2022] GET /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata => generated 64 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:58:17.193475 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-59b58122-fee5-4e6f-8298-3bc319a1cfe3 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:17.197851 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-59b58122-fee5-4e6f-8298-3bc319a1cfe3 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:17.211658 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-59b58122-fee5-4e6f-8298-3bc319a1cfe3 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:17.215337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-59b58122-fee5-4e6f-8298-3bc319a1cfe3 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:17.216316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-59b58122-fee5-4e6f-8298-3bc319a1cfe3 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:17.218727 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-59b58122-fee5-4e6f-8298-3bc319a1cfe3 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:17.219760 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-59b58122-fee5-4e6f-8298-3bc319a1cfe3 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:17.221107 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-59b58122-fee5-4e6f-8298-3bc319a1cfe3 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:17.321915 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-42c027a1-c643-4566-bc95-91d433888e43 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:17.331950 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-42c027a1-c643-4566-bc95-91d433888e43 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:17.334086 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-42c027a1-c643-4566-bc95-91d433888e43 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:17.335364 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-42c027a1-c643-4566-bc95-91d433888e43 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1280 microversion: 2.25 time: 0.308952 Oct 10 18:58:17.345187 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1166/2082] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:17 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1280 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:17.345187 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-03aca285-0cfa-482f-a3e7-f0229e19bc25 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:17.354491 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-03aca285-0cfa-482f-a3e7-f0229e19bc25 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011896 Oct 10 18:58:17.358466 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1167/2083] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 18:58:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:17.363642 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7ac3ad82-c61f-467c-88e6-ab9b98ad30b0 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Action: 'update_all', calling method: .version_select at 0x7f318d5821f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:17.439737 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-7ac3ad82-c61f-467c-88e6-ab9b98ad30b0 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:58:17.445236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-7ac3ad82-c61f-467c-88e6-ab9b98ad30b0 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for user 79446f26d8134b3d941a10368a579419 and project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:58:17.575186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-59b58122-fee5-4e6f-8298-3bc319a1cfe3 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:17.588452 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-59b58122-fee5-4e6f-8298-3bc319a1cfe3 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:17.590430 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-59b58122-fee5-4e6f-8298-3bc319a1cfe3 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:17.591629 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-59b58122-fee5-4e6f-8298-3bc319a1cfe3 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.404785 Oct 10 18:58:17.592188 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 917/2084] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:17 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:17.604966 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ffc36bf3-5533-47c4-86a6-35ce39c9e912 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:17.613509 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ffc36bf3-5533-47c4-86a6-35ce39c9e912 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:17.621156 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffc36bf3-5533-47c4-86a6-35ce39c9e912 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:17.621659 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffc36bf3-5533-47c4-86a6-35ce39c9e912 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:17.622099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffc36bf3-5533-47c4-86a6-35ce39c9e912 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:17.623088 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffc36bf3-5533-47c4-86a6-35ce39c9e912 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:17.623553 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffc36bf3-5533-47c4-86a6-35ce39c9e912 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:17.623978 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ffc36bf3-5533-47c4-86a6-35ce39c9e912 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:17.744791 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ffc36bf3-5533-47c4-86a6-35ce39c9e912 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:17.761630 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ffc36bf3-5533-47c4-86a6-35ce39c9e912 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1267 microversion: 2.1 time: 0.164605 Oct 10 18:58:17.776992 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 918/2085] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:17 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:17.776992 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b8510578-3808-4ef3-8bcb-a0bdc5f2a389 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f31922d10d0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:20.155173 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b8510578-3808-4ef3-8bcb-a0bdc5f2a389 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "DELETE /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 204 len: 0 microversion: 2.1 time: 2.391539 Oct 10 18:58:20.164589 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 919/2086] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:17 2022] DELETE /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 0 bytes in 2394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:58:20.169836 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1df4d615-4bc1-497e-a4be-f92a5d9e5e86 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:20.170549 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1df4d615-4bc1-497e-a4be-f92a5d9e5e86 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:20.176928 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1df4d615-4bc1-497e-a4be-f92a5d9e5e86 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.177648 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1df4d615-4bc1-497e-a4be-f92a5d9e5e86 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.178286 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1df4d615-4bc1-497e-a4be-f92a5d9e5e86 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:20.179273 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1df4d615-4bc1-497e-a4be-f92a5d9e5e86 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.179930 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1df4d615-4bc1-497e-a4be-f92a5d9e5e86 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.180379 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1df4d615-4bc1-497e-a4be-f92a5d9e5e86 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:20.191007 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7ac3ad82-c61f-467c-88e6-ab9b98ad30b0 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata" status: 200 len: 61 microversion: 2.1 time: 2.831345 Oct 10 18:58:20.192227 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1168/2087] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:58:17 2022] PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata => generated 61 bytes in 2833 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:58:20.197564 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8ecf1199-c9d4-46d8-8d2b-a9e09db0d577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:20.198172 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8ecf1199-c9d4-46d8-8d2b-a9e09db0d577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:20.218026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ecf1199-c9d4-46d8-8d2b-a9e09db0d577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.219718 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ecf1199-c9d4-46d8-8d2b-a9e09db0d577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.220149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ecf1199-c9d4-46d8-8d2b-a9e09db0d577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:20.223018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ecf1199-c9d4-46d8-8d2b-a9e09db0d577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.223667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ecf1199-c9d4-46d8-8d2b-a9e09db0d577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.227480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ecf1199-c9d4-46d8-8d2b-a9e09db0d577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:20.233016 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-1df4d615-4bc1-497e-a4be-f92a5d9e5e86 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] HTTP exception thrown: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1df4d615-4bc1-497e-a4be-f92a5d9e5e86 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Request method failure captured: Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 HTTP/1.1 Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGp-SHupOQm8vMwU7lD4CtXv2zlfeLyqxnFBRXOzv1psmCQVYx_ERyxHcGz8q8EyjbnqptYJ9aDqBYo2__SnvQn1ypIjiEf4DZmKHFDOcAL8874LY6E8Iu-gG7i1iK78n692e3r254u4SgCsLgKrnnXdGh_0u3T_osy4Fy4B7aMF6wk Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 1d0646e6fd1a4e188bd1bf139a8ef575 Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1464284874 Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1d0646e6fd1a4e188bd1bf139a8ef575", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1d0646e6fd1a4e188bd1bf139a8ef575"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0646e6fd1a4e188bd1bf139a8ef575"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0646e6fd1a4e188bd1bf139a8ef575"}]}] Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1464284874 Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 1d0646e6fd1a4e188bd1bf139a8ef575 Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1464284874 Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AttachSCSIVolumeTestJSON-1464284874-project Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 29c40dde2f644d6fbb0b4d8c77dfb4f3 Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1464284874-project Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '5ae3aec4-c476-4f1a-a702-2cd1548b0895'} Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:20.234945 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:20.238972 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:20.238972 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.238972 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:20.238972 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.238972 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:20.238972 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:20.238972 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:20.238972 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:20.238972 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:20.238972 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:20.238972 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.241251 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1df4d615-4bc1-497e-a4be-f92a5d9e5e86 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Returning 404 to user: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:20.244436 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1df4d615-4bc1-497e-a4be-f92a5d9e5e86 tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 404 len: 111 microversion: 2.1 time: 0.077653 Oct 10 18:58:20.247499 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 920/2088] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:58:20 2022] DELETE /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:20.272013 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-65494900-96be-435d-b86d-7118dda05c60 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:20.277472 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-65494900-96be-435d-b86d-7118dda05c60 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:20.284262 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-65494900-96be-435d-b86d-7118dda05c60 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.285916 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-65494900-96be-435d-b86d-7118dda05c60 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.285916 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-65494900-96be-435d-b86d-7118dda05c60 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:20.297274 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-65494900-96be-435d-b86d-7118dda05c60 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.298914 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-65494900-96be-435d-b86d-7118dda05c60 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.299983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-65494900-96be-435d-b86d-7118dda05c60 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:20.347077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8ecf1199-c9d4-46d8-8d2b-a9e09db0d577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:20.358048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8ecf1199-c9d4-46d8-8d2b-a9e09db0d577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:20.363412 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8ecf1199-c9d4-46d8-8d2b-a9e09db0d577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:20.374353 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:20.375966 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8ecf1199-c9d4-46d8-8d2b-a9e09db0d577 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.182248 Oct 10 18:58:20.376567 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1169/2089] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:20 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:20.405302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-99502999-e8e3-404a-aab4-2366daf2b213 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:20.407202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-99502999-e8e3-404a-aab4-2366daf2b213 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:20.422923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-99502999-e8e3-404a-aab4-2366daf2b213 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.423674 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-99502999-e8e3-404a-aab4-2366daf2b213 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.424113 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-99502999-e8e3-404a-aab4-2366daf2b213 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:20.424884 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-99502999-e8e3-404a-aab4-2366daf2b213 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.425511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-99502999-e8e3-404a-aab4-2366daf2b213 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.425933 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-99502999-e8e3-404a-aab4-2366daf2b213 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:20.528667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-65494900-96be-435d-b86d-7118dda05c60 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:20.539656 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-65494900-96be-435d-b86d-7118dda05c60 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:20.541571 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-65494900-96be-435d-b86d-7118dda05c60 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:20.543049 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-65494900-96be-435d-b86d-7118dda05c60 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1280 microversion: 2.25 time: 0.294206 Oct 10 18:58:20.545326 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 921/2090] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:20 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1280 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:20.551827 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-896bace7-2e85-4812-bb76-fd8b47146450 req-5ac558ba-0f13-4a2a-80a8-61a76d7082ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-plugged", "status": "completed", "tag": "15af13d2-db21-43e2-bb38-312a65d341c0"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:20.563519 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-896bace7-2e85-4812-bb76-fd8b47146450 req-5ac558ba-0f13-4a2a-80a8-61a76d7082ce service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.565013 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-896bace7-2e85-4812-bb76-fd8b47146450 req-5ac558ba-0f13-4a2a-80a8-61a76d7082ce service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.566151 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-896bace7-2e85-4812-bb76-fd8b47146450 req-5ac558ba-0f13-4a2a-80a8-61a76d7082ce service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:20.584848 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-896bace7-2e85-4812-bb76-fd8b47146450 req-5ac558ba-0f13-4a2a-80a8-61a76d7082ce service nova] Creating event network-vif-plugged:15af13d2-db21-43e2-bb38-312a65d341c0 for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:58:20.592294 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-896bace7-2e85-4812-bb76-fd8b47146450 req-5ac558ba-0f13-4a2a-80a8-61a76d7082ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044980 Oct 10 18:58:20.593784 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 922/2091] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:20.599772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4f49f3c2-ff4e-4f0f-a3e0-96d1addb282f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:20.600920 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4f49f3c2-ff4e-4f0f-a3e0-96d1addb282f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:20.621675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f49f3c2-ff4e-4f0f-a3e0-96d1addb282f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.624511 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f49f3c2-ff4e-4f0f-a3e0-96d1addb282f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.625301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f49f3c2-ff4e-4f0f-a3e0-96d1addb282f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:20.626943 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f49f3c2-ff4e-4f0f-a3e0-96d1addb282f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.627468 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f49f3c2-ff4e-4f0f-a3e0-96d1addb282f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.629236 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f49f3c2-ff4e-4f0f-a3e0-96d1addb282f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:20.724231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-99502999-e8e3-404a-aab4-2366daf2b213 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:20.725422 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4f49f3c2-ff4e-4f0f-a3e0-96d1addb282f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:20.734850 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4f49f3c2-ff4e-4f0f-a3e0-96d1addb282f tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1267 microversion: 2.1 time: 0.139763 Oct 10 18:58:20.735424 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 923/2092] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:20 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:20.735729 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-99502999-e8e3-404a-aab4-2366daf2b213 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:20.744983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6314d380-e701-49bc-8893-b03384f863de tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f319225d1f0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:20.750527 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-99502999-e8e3-404a-aab4-2366daf2b213 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:20.752060 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-99502999-e8e3-404a-aab4-2366daf2b213 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.371187 Oct 10 18:58:20.759871 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1170/2093] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:20 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:20.759871 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ff50e8dd-a907-45a5-b481-436d595b73d8 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Action: 'update', calling method: .version_select at 0x7f31921b8040>, body: {"meta": {"os_version": "alt"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:20.774948 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-6314d380-e701-49bc-8893-b03384f863de tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] HTTP exception thrown: Image not found. Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6314d380-e701-49bc-8893-b03384f863de tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Request method failure captured: Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e HTTP/1.1 Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGsSZQioYSvjPK1VpA0NBeJQl85F8GbMbN1hjzUTkdAA9j-2MHujTKMXqYC-OIyFpTwQ4Qaido255aMzv2tSKv9GZ-O7w9xIPLIb1-78dS3Cw_Hbee046cvq3dXsnahsU1X9OVuPH2cq6laAfGnOhVdzRolLqju3-a3NiC6Z2qudGAA Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: b3e646a2c4854a3ca9fad749182efd62 Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ImagesOneServerTestJSON-372030980 Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b3e646a2c4854a3ca9fad749182efd62", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b3e646a2c4854a3ca9fad749182efd62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b3e646a2c4854a3ca9fad749182efd62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b3e646a2c4854a3ca9fad749182efd62"}]}] Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ImagesOneServerTestJSON-372030980 Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: b3e646a2c4854a3ca9fad749182efd62 Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-372030980 Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ImagesOneServerTestJSON-372030980-project Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 0795d65cfa274841a7d2c4c2fb90f13a Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ImagesOneServerTestJSON-372030980-project Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: method: Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: exception: Image not found. Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e'} Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 10 18:58:20.777269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e could not be found. Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6314d380-e701-49bc-8893-b03384f863de tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Returning 404 to user: Image not found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6314d380-e701-49bc-8893-b03384f863de tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 404 len: 62 microversion: 2.1 time: 0.041904 Oct 10 18:58:20.785368 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 924/2094] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:20 2022] GET /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:58:20.793446 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-381d0cea-d18c-443a-b058-cb30394fc30d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:20.794210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-381d0cea-d18c-443a-b058-cb30394fc30d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] [instance: 5ae3aec4-c476-4f1a-a702-2cd1548b0895] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:20.802301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-381d0cea-d18c-443a-b058-cb30394fc30d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.802867 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-381d0cea-d18c-443a-b058-cb30394fc30d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.804616 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-381d0cea-d18c-443a-b058-cb30394fc30d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:20.805336 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-381d0cea-d18c-443a-b058-cb30394fc30d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.805790 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-381d0cea-d18c-443a-b058-cb30394fc30d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.806211 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-381d0cea-d18c-443a-b058-cb30394fc30d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:20.824386 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-381d0cea-d18c-443a-b058-cb30394fc30d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] HTTP exception thrown: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-381d0cea-d18c-443a-b058-cb30394fc30d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Request method failure captured: Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 HTTP/1.1 Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGp-SHupOQm8vMwU7lD4CtXv2zlfeLyqxnFBRXOzv1psmCQVYx_ERyxHcGz8q8EyjbnqptYJ9aDqBYo2__SnvQn1ypIjiEf4DZmKHFDOcAL8874LY6E8Iu-gG7i1iK78n692e3r254u4SgCsLgKrnnXdGh_0u3T_osy4Fy4B7aMF6wk Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 1d0646e6fd1a4e188bd1bf139a8ef575 Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1464284874 Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1d0646e6fd1a4e188bd1bf139a8ef575", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1d0646e6fd1a4e188bd1bf139a8ef575"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0646e6fd1a4e188bd1bf139a8ef575"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0646e6fd1a4e188bd1bf139a8ef575"}]}] Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1464284874 Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 1d0646e6fd1a4e188bd1bf139a8ef575 Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1464284874 Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-AttachSCSIVolumeTestJSON-1464284874-project Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 29c40dde2f644d6fbb0b4d8c77dfb4f3 Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1464284874-project Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '5ae3aec4-c476-4f1a-a702-2cd1548b0895'} Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:20.826192 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.829913 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:20.829913 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:20.829913 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:20.829913 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:20.829913 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:20.829913 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. Oct 10 18:58:20.829913 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:20.837857 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-381d0cea-d18c-443a-b058-cb30394fc30d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] Returning 404 to user: Instance 5ae3aec4-c476-4f1a-a702-2cd1548b0895 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:20.838908 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-381d0cea-d18c-443a-b058-cb30394fc30d tempest-AttachSCSIVolumeTestJSON-1464284874 tempest-AttachSCSIVolumeTestJSON-1464284874-project] 10.222.0.43 "GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895" status: 404 len: 111 microversion: 2.1 time: 0.052393 Oct 10 18:58:20.839516 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 925/2095] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:20 2022] GET /compute/v2.1/servers/5ae3aec4-c476-4f1a-a702-2cd1548b0895 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:20.876219 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7d8d0a75-f8cd-486a-bea4-c1252533adc8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-221464149"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:20.879031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-ff50e8dd-a907-45a5-b481-436d595b73d8 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:58:20.881660 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7d8d0a75-f8cd-486a-bea4-c1252533adc8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:20.892109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-ff50e8dd-a907-45a5-b481-436d595b73d8 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for user 79446f26d8134b3d941a10368a579419 and project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:58:20.894855 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:20.897781 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7d8d0a75-f8cd-486a-bea4-c1252533adc8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.900734 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7d8d0a75-f8cd-486a-bea4-c1252533adc8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.902539 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7d8d0a75-f8cd-486a-bea4-c1252533adc8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:20.903526 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7d8d0a75-f8cd-486a-bea4-c1252533adc8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:20.906573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7d8d0a75-f8cd-486a-bea4-c1252533adc8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:20.907257 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7d8d0a75-f8cd-486a-bea4-c1252533adc8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:21.478692 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7d8d0a75-f8cd-486a-bea4-c1252533adc8 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "POST /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949/action" status: 202 len: 0 microversion: 2.1 time: 0.630925 Oct 10 18:58:21.487466 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 926/2096] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:58:20 2022] POST /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949/action => generated 0 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 18:58:21.497996 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5ebbbe59-0ddb-404f-9a4c-c5fd60b1886a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:21.500053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5ebbbe59-0ddb-404f-9a4c-c5fd60b1886a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:21.513365 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5ebbbe59-0ddb-404f-9a4c-c5fd60b1886a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:21.514116 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5ebbbe59-0ddb-404f-9a4c-c5fd60b1886a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:21.515113 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5ebbbe59-0ddb-404f-9a4c-c5fd60b1886a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:21.516052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5ebbbe59-0ddb-404f-9a4c-c5fd60b1886a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:21.516939 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5ebbbe59-0ddb-404f-9a4c-c5fd60b1886a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:21.517602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5ebbbe59-0ddb-404f-9a4c-c5fd60b1886a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:21.708421 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ff50e8dd-a907-45a5-b481-436d595b73d8 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.954001 Oct 10 18:58:21.709349 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1171/2097] 10.222.0.43 () {60 vars in 1313 bytes} [Mon Oct 10 18:58:20 2022] PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata/os_version => generated 31 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:58:21.718113 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-327bf49e-4d9e-4a81-aeb3-fd585aeb69aa tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f31921b8dc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:21.809241 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-327bf49e-4d9e-4a81-aeb3-fd585aeb69aa tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.098727 Oct 10 18:58:21.810735 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1172/2098] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:21 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:21.820431 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-187f5b7d-8865-400a-aa42-ff0ba05cce10 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:21.823150 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-187f5b7d-8865-400a-aa42-ff0ba05cce10 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:21.851933 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-187f5b7d-8865-400a-aa42-ff0ba05cce10 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:21.852709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-187f5b7d-8865-400a-aa42-ff0ba05cce10 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:21.853629 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-187f5b7d-8865-400a-aa42-ff0ba05cce10 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:21.858404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-187f5b7d-8865-400a-aa42-ff0ba05cce10 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:21.859072 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-187f5b7d-8865-400a-aa42-ff0ba05cce10 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:21.859724 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-187f5b7d-8865-400a-aa42-ff0ba05cce10 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:22.227545 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-187f5b7d-8865-400a-aa42-ff0ba05cce10 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:22.240738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-187f5b7d-8865-400a-aa42-ff0ba05cce10 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:22.243952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-187f5b7d-8865-400a-aa42-ff0ba05cce10 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:22.248103 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-187f5b7d-8865-400a-aa42-ff0ba05cce10 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1475 microversion: 2.25 time: 0.435762 Oct 10 18:58:22.248833 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1173/2099] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:21 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1475 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:22.261475 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5ebbbe59-0ddb-404f-9a4c-c5fd60b1886a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:22.273039 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5ebbbe59-0ddb-404f-9a4c-c5fd60b1886a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:22.274852 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5ebbbe59-0ddb-404f-9a4c-c5fd60b1886a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:22.277043 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ebe9c45a-c77c-472c-baf9-e0ae335279cf tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Calling method '.version_select at 0x7f31921b8160>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:22.281970 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5ebbbe59-0ddb-404f-9a4c-c5fd60b1886a tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.792755 Oct 10 18:58:22.283127 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 927/2100] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:21 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:22.290109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c7a45fd2-ee5e-497a-afa5-a33696f686a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:22.291092 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c7a45fd2-ee5e-497a-afa5-a33696f686a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:22.310247 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c7a45fd2-ee5e-497a-afa5-a33696f686a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:22.311823 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c7a45fd2-ee5e-497a-afa5-a33696f686a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:22.312905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c7a45fd2-ee5e-497a-afa5-a33696f686a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:22.314351 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c7a45fd2-ee5e-497a-afa5-a33696f686a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:22.315025 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c7a45fd2-ee5e-497a-afa5-a33696f686a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:22.315691 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c7a45fd2-ee5e-497a-afa5-a33696f686a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:22.406280 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ebe9c45a-c77c-472c-baf9-e0ae335279cf tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "GET /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata" status: 200 len: 58 microversion: 2.1 time: 0.138313 Oct 10 18:58:22.407150 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1174/2101] 10.222.0.43 () {58 vars in 1260 bytes} [Mon Oct 10 18:58:22 2022] GET /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata => generated 58 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:58:22.412963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-78f3aae9-be24-4869-acc9-4106fef624b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:22.419443 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-78f3aae9-be24-4869-acc9-4106fef624b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:22.442459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-78f3aae9-be24-4869-acc9-4106fef624b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:22.446507 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-78f3aae9-be24-4869-acc9-4106fef624b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:22.447217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-78f3aae9-be24-4869-acc9-4106fef624b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:22.449277 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-78f3aae9-be24-4869-acc9-4106fef624b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:22.450915 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-78f3aae9-be24-4869-acc9-4106fef624b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:22.453848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-78f3aae9-be24-4869-acc9-4106fef624b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:22.459885 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c7a45fd2-ee5e-497a-afa5-a33696f686a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:22.474307 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c7a45fd2-ee5e-497a-afa5-a33696f686a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1267 microversion: 2.1 time: 0.189777 Oct 10 18:58:22.476155 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 928/2102] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:22 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:22.817539 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-78f3aae9-be24-4869-acc9-4106fef624b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:22.836205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-78f3aae9-be24-4869-acc9-4106fef624b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:22.842770 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-78f3aae9-be24-4869-acc9-4106fef624b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:22.847618 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-78f3aae9-be24-4869-acc9-4106fef624b5 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.438651 Oct 10 18:58:22.848991 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1175/2103] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:22 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:22.857246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1d2d2bbf-60b4-4e78-9333-e86b79a6509c tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Action: 'update_all', calling method: .version_select at 0x7f318d49f790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:22.875189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3914e860-31dc-42a2-9409-24d06f4dadf5 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:22.876049 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3914e860-31dc-42a2-9409-24d06f4dadf5 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:22.886254 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3914e860-31dc-42a2-9409-24d06f4dadf5 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:22.886896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3914e860-31dc-42a2-9409-24d06f4dadf5 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:22.887481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3914e860-31dc-42a2-9409-24d06f4dadf5 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:22.888675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3914e860-31dc-42a2-9409-24d06f4dadf5 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:22.889205 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3914e860-31dc-42a2-9409-24d06f4dadf5 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:22.889752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3914e860-31dc-42a2-9409-24d06f4dadf5 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:22.895414 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:22.956996 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-1d2d2bbf-60b4-4e78-9333-e86b79a6509c tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:58:22.956996 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-1d2d2bbf-60b4-4e78-9333-e86b79a6509c tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for user 79446f26d8134b3d941a10368a579419 and project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:58:23.275648 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-3914e860-31dc-42a2-9409-24d06f4dadf5 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid fce27ab7-7a56-4c87-95b1-5cf9afa20f24 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:58:23.323826 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3914e860-31dc-42a2-9409-24d06f4dadf5 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1967 microversion: 2.25 time: 0.846239 Oct 10 18:58:23.324799 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 929/2104] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:22 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1967 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:23.345681 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-7a63c9bb-4e13-49a5-8fbf-4fc9684c8422 req-0c017af3-5dea-4531-9610-6cf09ae346ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-plugged", "status": "completed", "tag": "b06ba07e-b1b2-4d01-8143-4688336bd7d5"}, {"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-plugged", "status": "completed", "tag": "0f2bd971-89f9-416b-bad4-152c02c746fb"}, {"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-plugged", "status": "completed", "tag": "d3835300-20da-488f-97b2-b41044bdcd24"}, {"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-plugged", "status": "completed", "tag": "e9beeca4-6e86-4e0e-8cdf-8cecd637d4b7"}, {"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-plugged", "status": "completed", "tag": "973a75cc-00b3-43e5-a2d6-eaeb4c2f27ac"}, {"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-plugged", "status": "completed", "tag": "99d576b1-bb4c-4046-a5bb-d295c4cf071a"}, {"server_uuid": "23440a72-5db4-4da8-8af0-176166843949", "name": "network-vif-unplugged", "status": "completed", "tag": "e6382291-a00e-49b0-905a-3ea8adf9eb83"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:23.371141 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7a63c9bb-4e13-49a5-8fbf-4fc9684c8422 req-0c017af3-5dea-4531-9610-6cf09ae346ec service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:23.371687 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7a63c9bb-4e13-49a5-8fbf-4fc9684c8422 req-0c017af3-5dea-4531-9610-6cf09ae346ec service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:23.372132 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7a63c9bb-4e13-49a5-8fbf-4fc9684c8422 req-0c017af3-5dea-4531-9610-6cf09ae346ec service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:23.408751 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-7a63c9bb-4e13-49a5-8fbf-4fc9684c8422 req-0c017af3-5dea-4531-9610-6cf09ae346ec service nova] Creating event network-vif-plugged:b06ba07e-b1b2-4d01-8143-4688336bd7d5 for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:58:23.409458 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-7a63c9bb-4e13-49a5-8fbf-4fc9684c8422 req-0c017af3-5dea-4531-9610-6cf09ae346ec service nova] Creating event network-vif-plugged:0f2bd971-89f9-416b-bad4-152c02c746fb for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:58:23.410240 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-7a63c9bb-4e13-49a5-8fbf-4fc9684c8422 req-0c017af3-5dea-4531-9610-6cf09ae346ec service nova] Creating event network-vif-plugged:d3835300-20da-488f-97b2-b41044bdcd24 for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:58:23.411109 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-7a63c9bb-4e13-49a5-8fbf-4fc9684c8422 req-0c017af3-5dea-4531-9610-6cf09ae346ec service nova] Creating event network-vif-plugged:e9beeca4-6e86-4e0e-8cdf-8cecd637d4b7 for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:58:23.412963 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-7a63c9bb-4e13-49a5-8fbf-4fc9684c8422 req-0c017af3-5dea-4531-9610-6cf09ae346ec service nova] Creating event network-vif-plugged:973a75cc-00b3-43e5-a2d6-eaeb4c2f27ac for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:58:23.414278 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-7a63c9bb-4e13-49a5-8fbf-4fc9684c8422 req-0c017af3-5dea-4531-9610-6cf09ae346ec service nova] Creating event network-vif-plugged:99d576b1-bb4c-4046-a5bb-d295c4cf071a for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:58:23.415450 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-7a63c9bb-4e13-49a5-8fbf-4fc9684c8422 req-0c017af3-5dea-4531-9610-6cf09ae346ec service nova] Creating event network-vif-unplugged:e6382291-a00e-49b0-905a-3ea8adf9eb83 for instance 23440a72-5db4-4da8-8af0-176166843949 on n-h1-860863-1 Oct 10 18:58:23.449918 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-7a63c9bb-4e13-49a5-8fbf-4fc9684c8422 req-0c017af3-5dea-4531-9610-6cf09ae346ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1211 microversion: 2.1 time: 0.122838 Oct 10 18:58:23.451419 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 930/2105] 10.222.0.43 () {64 vars in 1318 bytes} [Mon Oct 10 18:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 1211 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:23.463926 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-93db65dc-31a5-4773-83a9-890cc07e152b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f31922ab280>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:23.742863 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1d2d2bbf-60b4-4e78-9333-e86b79a6509c tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata" status: 200 len: 61 microversion: 2.1 time: 0.892531 Oct 10 18:58:23.743786 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1176/2106] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:58:22 2022] PUT /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata => generated 61 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:58:23.749456 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e2681d83-5db4-41f4-99de-b418a8674f66 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:23.751663 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e2681d83-5db4-41f4-99de-b418a8674f66 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:23.758379 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-93db65dc-31a5-4773-83a9-890cc07e152b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.303959 Oct 10 18:58:23.758975 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 931/2107] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:23 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:23.765991 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2681d83-5db4-41f4-99de-b418a8674f66 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:23.772478 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2681d83-5db4-41f4-99de-b418a8674f66 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:23.773518 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2681d83-5db4-41f4-99de-b418a8674f66 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:23.774501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2681d83-5db4-41f4-99de-b418a8674f66 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:23.775161 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2681d83-5db4-41f4-99de-b418a8674f66 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:23.775297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-012b7199-155f-4cfb-9914-bac9b192e313 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:23.775952 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-012b7199-155f-4cfb-9914-bac9b192e313 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:23.777355 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2681d83-5db4-41f4-99de-b418a8674f66 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:23.803443 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-012b7199-155f-4cfb-9914-bac9b192e313 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:23.807372 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-012b7199-155f-4cfb-9914-bac9b192e313 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:23.807863 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-012b7199-155f-4cfb-9914-bac9b192e313 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:23.810851 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-012b7199-155f-4cfb-9914-bac9b192e313 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:23.813164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-012b7199-155f-4cfb-9914-bac9b192e313 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:23.814271 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-012b7199-155f-4cfb-9914-bac9b192e313 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:23.937575 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e2681d83-5db4-41f4-99de-b418a8674f66 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:23.961430 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e2681d83-5db4-41f4-99de-b418a8674f66 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:23.963521 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e2681d83-5db4-41f4-99de-b418a8674f66 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:23.983243 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e2681d83-5db4-41f4-99de-b418a8674f66 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.238046 Oct 10 18:58:24.002459 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1177/2108] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:23 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:24.012139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b5811bc5-8a69-4940-8e6f-55894c25b5b3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:24.012802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b5811bc5-8a69-4940-8e6f-55894c25b5b3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:24.024121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5811bc5-8a69-4940-8e6f-55894c25b5b3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:24.024121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5811bc5-8a69-4940-8e6f-55894c25b5b3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:24.024121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5811bc5-8a69-4940-8e6f-55894c25b5b3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:24.024121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5811bc5-8a69-4940-8e6f-55894c25b5b3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:24.024121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5811bc5-8a69-4940-8e6f-55894c25b5b3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:24.024121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b5811bc5-8a69-4940-8e6f-55894c25b5b3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:24.170104 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:24.239058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b5811bc5-8a69-4940-8e6f-55894c25b5b3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:24.252466 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=14 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:24.265538 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b5811bc5-8a69-4940-8e6f-55894c25b5b3 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1285 microversion: 2.1 time: 0.261868 Oct 10 18:58:24.266584 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1178/2109] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:24 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1285 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:24.272489 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6fe0721e-ebf5-4345-ab23-59cef10a5d1e tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Action: 'create', calling method: .version_select at 0x7f318d669e50>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:24.284748 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-012b7199-155f-4cfb-9914-bac9b192e313 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid fce27ab7-7a56-4c87-95b1-5cf9afa20f24 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:58:24.329631 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-012b7199-155f-4cfb-9914-bac9b192e313 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1967 microversion: 2.25 time: 0.569570 Oct 10 18:58:24.344718 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 932/2110] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:23 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1967 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:24.359816 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4a228d41-30f0-4b24-b09d-5b9fb0fe73a6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:24.360750 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4a228d41-30f0-4b24-b09d-5b9fb0fe73a6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:24.368809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a228d41-30f0-4b24-b09d-5b9fb0fe73a6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:24.369518 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a228d41-30f0-4b24-b09d-5b9fb0fe73a6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:24.370119 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a228d41-30f0-4b24-b09d-5b9fb0fe73a6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:24.371276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a228d41-30f0-4b24-b09d-5b9fb0fe73a6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:24.371947 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a228d41-30f0-4b24-b09d-5b9fb0fe73a6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:24.372587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a228d41-30f0-4b24-b09d-5b9fb0fe73a6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:24.390606 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-6fe0721e-ebf5-4345-ab23-59cef10a5d1e tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:58:24.409043 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-6fe0721e-ebf5-4345-ab23-59cef10a5d1e tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Getting quotas for user 79446f26d8134b3d941a10368a579419 and project ffea16469112489fa90dcfff7fb08e19. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:58:25.063740 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4a228d41-30f0-4b24-b09d-5b9fb0fe73a6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:25.075667 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6fe0721e-ebf5-4345-ab23-59cef10a5d1e tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "POST /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata" status: 200 len: 85 microversion: 2.1 time: 0.807988 Oct 10 18:58:25.080927 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1179/2111] 10.222.0.43 () {60 vars in 1281 bytes} [Mon Oct 10 18:58:24 2022] POST /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata => generated 85 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:58:25.084466 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d6d9cecd-377e-4b47-8c5c-59301e7cebc1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:25.089114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d6d9cecd-377e-4b47-8c5c-59301e7cebc1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:25.089618 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d6d9cecd-377e-4b47-8c5c-59301e7cebc1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:25.090059 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d6d9cecd-377e-4b47-8c5c-59301e7cebc1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:25.090805 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d6d9cecd-377e-4b47-8c5c-59301e7cebc1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:25.092806 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4a228d41-30f0-4b24-b09d-5b9fb0fe73a6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:25.094631 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4a228d41-30f0-4b24-b09d-5b9fb0fe73a6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:25.095128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d6d9cecd-377e-4b47-8c5c-59301e7cebc1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:25.095947 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4a228d41-30f0-4b24-b09d-5b9fb0fe73a6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.748786 Oct 10 18:58:25.097765 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d6d9cecd-377e-4b47-8c5c-59301e7cebc1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:25.112724 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 933/2112] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:24 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:25.124153 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-332a90a8-6a81-4361-95c2-74caa03b7092 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f31922ab940>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:25.152443 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d6d9cecd-377e-4b47-8c5c-59301e7cebc1 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.069746 Oct 10 18:58:25.153692 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1180/2113] 10.222.0.43 () {60 vars in 1217 bytes} [Mon Oct 10 18:58:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 10 18:58:25.159945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b972e6b9-afa6-418f-abbf-56d37e704599 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:25.161165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b972e6b9-afa6-418f-abbf-56d37e704599 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:25.172866 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b972e6b9-afa6-418f-abbf-56d37e704599 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:25.173378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b972e6b9-afa6-418f-abbf-56d37e704599 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:25.173859 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b972e6b9-afa6-418f-abbf-56d37e704599 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:25.174642 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b972e6b9-afa6-418f-abbf-56d37e704599 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:25.175548 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b972e6b9-afa6-418f-abbf-56d37e704599 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:25.175975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b972e6b9-afa6-418f-abbf-56d37e704599 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:25.188063 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-332a90a8-6a81-4361-95c2-74caa03b7092 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.074172 Oct 10 18:58:25.188755 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 934/2114] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:25 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:25.206113 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-795772d4-a7ef-4e84-b3b3-72fd489a5f62 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] Calling method '.version_select at 0x7f319226f3a0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:25.270528 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-795772d4-a7ef-4e84-b3b3-72fd489a5f62 tempest-ImagesMetadataTestJSON-170293852 tempest-ImagesMetadataTestJSON-170293852-project] 10.222.0.43 "GET /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata" status: 200 len: 85 microversion: 2.1 time: 0.068881 Oct 10 18:58:25.271107 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 935/2115] 10.222.0.43 () {58 vars in 1260 bytes} [Mon Oct 10 18:58:25 2022] GET /compute/v2.1/images/b6e2b73f-359d-469b-8ea2-2b0e5dc77459/metadata => generated 85 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 18:58:25.285484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-17a3c85b-2021-4b70-983f-b084f2a64b21 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860863-1", "block_migration": "auto"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:25.297552 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-17a3c85b-2021-4b70-983f-b084f2a64b21 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:25.306697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-17a3c85b-2021-4b70-983f-b084f2a64b21 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:25.307180 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-17a3c85b-2021-4b70-983f-b084f2a64b21 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:25.307612 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-17a3c85b-2021-4b70-983f-b084f2a64b21 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:25.308312 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-17a3c85b-2021-4b70-983f-b084f2a64b21 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:25.310148 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-17a3c85b-2021-4b70-983f-b084f2a64b21 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:25.315317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-17a3c85b-2021-4b70-983f-b084f2a64b21 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:25.394530 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-17a3c85b-2021-4b70-983f-b084f2a64b21 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'flavor' on Instance uuid fce27ab7-7a56-4c87-95b1-5cf9afa20f24 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:58:25.414461 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-17a3c85b-2021-4b70-983f-b084f2a64b21 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Going to try to live migrate instance to n-h1-860863-1 {{(pid=127289) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 18:58:25.473147 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b972e6b9-afa6-418f-abbf-56d37e704599 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:25.482153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b972e6b9-afa6-418f-abbf-56d37e704599 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:25.484086 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b972e6b9-afa6-418f-abbf-56d37e704599 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:25.517019 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b972e6b9-afa6-418f-abbf-56d37e704599 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.361881 Oct 10 18:58:25.521059 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1181/2116] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:25 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:25.527757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-947232e2-9547-46fe-8aac-065a72139696 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:25.527757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-947232e2-9547-46fe-8aac-065a72139696 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:25.536866 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-947232e2-9547-46fe-8aac-065a72139696 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:25.537455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-947232e2-9547-46fe-8aac-065a72139696 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:25.537993 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-947232e2-9547-46fe-8aac-065a72139696 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:25.538921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-947232e2-9547-46fe-8aac-065a72139696 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:25.539570 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-947232e2-9547-46fe-8aac-065a72139696 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:25.540058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-947232e2-9547-46fe-8aac-065a72139696 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:25.704709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-947232e2-9547-46fe-8aac-065a72139696 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:25.715216 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-947232e2-9547-46fe-8aac-065a72139696 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1273 microversion: 2.1 time: 0.192864 Oct 10 18:58:25.716449 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1182/2117] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:25 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:26.132931 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-960b8e1c-73ff-4ac0-9873-54af5f818296 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:26.133590 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-960b8e1c-73ff-4ac0-9873-54af5f818296 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:26.141573 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-960b8e1c-73ff-4ac0-9873-54af5f818296 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:26.142355 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-960b8e1c-73ff-4ac0-9873-54af5f818296 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:26.142787 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-960b8e1c-73ff-4ac0-9873-54af5f818296 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:26.143699 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-960b8e1c-73ff-4ac0-9873-54af5f818296 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:26.144346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-960b8e1c-73ff-4ac0-9873-54af5f818296 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:26.144879 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-960b8e1c-73ff-4ac0-9873-54af5f818296 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:27.092824 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-960b8e1c-73ff-4ac0-9873-54af5f818296 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:27.107076 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-960b8e1c-73ff-4ac0-9873-54af5f818296 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:27.108715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-960b8e1c-73ff-4ac0-9873-54af5f818296 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:27.110028 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-960b8e1c-73ff-4ac0-9873-54af5f818296 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1875 microversion: 2.42 time: 0.983163 Oct 10 18:58:27.124768 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1183/2118] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:26 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1875 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:27.126584 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-044dca7e-cee3-4340-9ef8-b5a3bcbd0c11 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f31921b8430>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:27.183849 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-044dca7e-cee3-4340-9ef8-b5a3bcbd0c11 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.062422 Oct 10 18:58:27.192932 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1184/2119] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:27 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:27.193226 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1e2d2076-9832-4b85-b52e-975a272a3e57 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:27.197131 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1e2d2076-9832-4b85-b52e-975a272a3e57 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:27.225229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e2d2076-9832-4b85-b52e-975a272a3e57 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:27.231581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e2d2076-9832-4b85-b52e-975a272a3e57 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:27.231581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e2d2076-9832-4b85-b52e-975a272a3e57 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:27.231581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e2d2076-9832-4b85-b52e-975a272a3e57 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:27.231581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e2d2076-9832-4b85-b52e-975a272a3e57 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:27.231581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e2d2076-9832-4b85-b52e-975a272a3e57 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:27.382602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1e2d2076-9832-4b85-b52e-975a272a3e57 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:27.392375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1e2d2076-9832-4b85-b52e-975a272a3e57 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:27.398484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1e2d2076-9832-4b85-b52e-975a272a3e57 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:27.412705 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1e2d2076-9832-4b85-b52e-975a272a3e57 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.225770 Oct 10 18:58:27.417906 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1185/2120] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:27 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:27.475287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e4e6ef5b-d9ef-452d-98b5-76eaff0bb0b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:27.475287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e4e6ef5b-d9ef-452d-98b5-76eaff0bb0b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:27.487605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4e6ef5b-d9ef-452d-98b5-76eaff0bb0b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:27.488111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4e6ef5b-d9ef-452d-98b5-76eaff0bb0b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:27.488571 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4e6ef5b-d9ef-452d-98b5-76eaff0bb0b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:27.492356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4e6ef5b-d9ef-452d-98b5-76eaff0bb0b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:27.492356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4e6ef5b-d9ef-452d-98b5-76eaff0bb0b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:27.492356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4e6ef5b-d9ef-452d-98b5-76eaff0bb0b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:27.931930 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e4e6ef5b-d9ef-452d-98b5-76eaff0bb0b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:27.944469 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e4e6ef5b-d9ef-452d-98b5-76eaff0bb0b7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1315 microversion: 2.1 time: 0.489360 Oct 10 18:58:27.956571 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1186/2121] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:27 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:28.143567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-686fccd0-499d-4372-bc2d-2c51d48115d2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:28.144192 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-686fccd0-499d-4372-bc2d-2c51d48115d2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:28.182683 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-686fccd0-499d-4372-bc2d-2c51d48115d2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:28.185088 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-686fccd0-499d-4372-bc2d-2c51d48115d2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:28.187189 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-686fccd0-499d-4372-bc2d-2c51d48115d2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:28.190383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-686fccd0-499d-4372-bc2d-2c51d48115d2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:28.191113 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-686fccd0-499d-4372-bc2d-2c51d48115d2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:28.192784 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-686fccd0-499d-4372-bc2d-2c51d48115d2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:28.789699 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-686fccd0-499d-4372-bc2d-2c51d48115d2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:28.829110 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-686fccd0-499d-4372-bc2d-2c51d48115d2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:28.834392 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-686fccd0-499d-4372-bc2d-2c51d48115d2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:28.841908 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-686fccd0-499d-4372-bc2d-2c51d48115d2 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 2833 microversion: 2.42 time: 0.702773 Oct 10 18:58:28.845025 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1187/2122] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:28 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 2833 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:28.859644 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-24acf9b0-96fa-4883-9c0c-717c7b392895 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f31921b8040>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:30.776808 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-17a3c85b-2021-4b70-983f-b084f2a64b21 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24/action" status: 202 len: 0 microversion: 2.25 time: 5.497093 Oct 10 18:58:30.777260 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 936/2123] 10.222.0.43 () {62 vars in 1319 bytes} [Mon Oct 10 18:58:25 2022] POST /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24/action => generated 0 bytes in 5506 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:58:30.784778 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-e9d25637-c877-4b36-b6ee-13330fae50d3 req-419ed452-c31d-4dbb-be31-68157d367ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f684567-fedb-4b54-8ddd-5fc50d4fda3b", "tag": "d9208944-dbb2-4d46-83e2-591bfd6bf183"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:30.815124 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-24acf9b0-96fa-4883-9c0c-717c7b392895 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 1.953345 Oct 10 18:58:30.816090 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1188/2124] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:28 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:30.822179 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e9d25637-c877-4b36-b6ee-13330fae50d3 req-419ed452-c31d-4dbb-be31-68157d367ed1 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:30.831391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fd116438-75eb-4b94-89ec-22038dec37a6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:30.835621 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e9d25637-c877-4b36-b6ee-13330fae50d3 req-419ed452-c31d-4dbb-be31-68157d367ed1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:30.835621 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e9d25637-c877-4b36-b6ee-13330fae50d3 req-419ed452-c31d-4dbb-be31-68157d367ed1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:30.836125 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fd116438-75eb-4b94-89ec-22038dec37a6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:30.857810 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd116438-75eb-4b94-89ec-22038dec37a6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:30.863217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd116438-75eb-4b94-89ec-22038dec37a6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:30.869365 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd116438-75eb-4b94-89ec-22038dec37a6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:30.870312 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-e9d25637-c877-4b36-b6ee-13330fae50d3 req-419ed452-c31d-4dbb-be31-68157d367ed1 service nova] Creating event network-changed:d9208944-dbb2-4d46-83e2-591bfd6bf183 for instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b on n-h2-860863-1 Oct 10 18:58:30.870505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd116438-75eb-4b94-89ec-22038dec37a6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:30.872387 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd116438-75eb-4b94-89ec-22038dec37a6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:30.872878 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd116438-75eb-4b94-89ec-22038dec37a6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:30.882306 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-e9d25637-c877-4b36-b6ee-13330fae50d3 req-419ed452-c31d-4dbb-be31-68157d367ed1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101738 Oct 10 18:58:30.882947 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 937/2125] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:30.895101 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-0768a5a9-e1bf-4d64-811b-7758c39fbe59 req-be1f2cee-84cf-4590-8707-49d141aac12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23440a72-5db4-4da8-8af0-176166843949", "name": "network-vif-plugged", "status": "completed", "tag": "e6382291-a00e-49b0-905a-3ea8adf9eb83"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:30.926794 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-0768a5a9-e1bf-4d64-811b-7758c39fbe59 req-be1f2cee-84cf-4590-8707-49d141aac12e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:30.928559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-0768a5a9-e1bf-4d64-811b-7758c39fbe59 req-be1f2cee-84cf-4590-8707-49d141aac12e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:30.929617 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-0768a5a9-e1bf-4d64-811b-7758c39fbe59 req-be1f2cee-84cf-4590-8707-49d141aac12e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:30.972649 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-0768a5a9-e1bf-4d64-811b-7758c39fbe59 req-be1f2cee-84cf-4590-8707-49d141aac12e service nova] Creating event network-vif-plugged:e6382291-a00e-49b0-905a-3ea8adf9eb83 for instance 23440a72-5db4-4da8-8af0-176166843949 on n-h1-860863-1 Oct 10 18:58:30.992715 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-0768a5a9-e1bf-4d64-811b-7758c39fbe59 req-be1f2cee-84cf-4590-8707-49d141aac12e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107085 Oct 10 18:58:30.994891 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 938/2126] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:31.010923 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ecbf4eec-239d-4230-859f-53df0641b78a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:31.011527 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ecbf4eec-239d-4230-859f-53df0641b78a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:31.021064 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ecbf4eec-239d-4230-859f-53df0641b78a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:31.021557 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ecbf4eec-239d-4230-859f-53df0641b78a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:31.021993 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ecbf4eec-239d-4230-859f-53df0641b78a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:31.025114 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ecbf4eec-239d-4230-859f-53df0641b78a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:31.025465 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ecbf4eec-239d-4230-859f-53df0641b78a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:31.033284 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ecbf4eec-239d-4230-859f-53df0641b78a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:31.290057 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fd116438-75eb-4b94-89ec-22038dec37a6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:31.305973 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fd116438-75eb-4b94-89ec-22038dec37a6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:31.313560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fd116438-75eb-4b94-89ec-22038dec37a6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:31.334173 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fd116438-75eb-4b94-89ec-22038dec37a6 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1546 microversion: 2.91 time: 0.513067 Oct 10 18:58:31.335716 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1189/2127] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:30 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1546 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:31.360685 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d6b5a925-a25b-42f8-ac12-d4a265823276 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:31.361779 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d6b5a925-a25b-42f8-ac12-d4a265823276 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:31.382635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d6b5a925-a25b-42f8-ac12-d4a265823276 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:31.383681 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d6b5a925-a25b-42f8-ac12-d4a265823276 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:31.384329 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d6b5a925-a25b-42f8-ac12-d4a265823276 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:31.385658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d6b5a925-a25b-42f8-ac12-d4a265823276 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:31.388814 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d6b5a925-a25b-42f8-ac12-d4a265823276 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:31.392014 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d6b5a925-a25b-42f8-ac12-d4a265823276 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:31.697854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d6b5a925-a25b-42f8-ac12-d4a265823276 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:31.733002 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d6b5a925-a25b-42f8-ac12-d4a265823276 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1315 microversion: 2.1 time: 0.376518 Oct 10 18:58:31.733002 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1190/2128] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:31 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:31.753925 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9b2e0574-6674-4f86-88b6-f7b82bd9c704 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:31.760651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9b2e0574-6674-4f86-88b6-f7b82bd9c704 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:31.776646 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9b2e0574-6674-4f86-88b6-f7b82bd9c704 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:31.777494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9b2e0574-6674-4f86-88b6-f7b82bd9c704 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:31.778933 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9b2e0574-6674-4f86-88b6-f7b82bd9c704 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:31.780266 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9b2e0574-6674-4f86-88b6-f7b82bd9c704 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:31.780969 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9b2e0574-6674-4f86-88b6-f7b82bd9c704 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:31.781579 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9b2e0574-6674-4f86-88b6-f7b82bd9c704 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:32.143612 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9b2e0574-6674-4f86-88b6-f7b82bd9c704 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:32.158432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9b2e0574-6674-4f86-88b6-f7b82bd9c704 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:32.159895 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9b2e0574-6674-4f86-88b6-f7b82bd9c704 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:32.161453 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9b2e0574-6674-4f86-88b6-f7b82bd9c704 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.438707 Oct 10 18:58:32.161951 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1191/2129] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:31 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:32.166499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-991072ec-dac2-4229-ad83-665746650e6f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f31921b84c0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:32.263261 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-991072ec-dac2-4229-ad83-665746650e6f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.096651 Oct 10 18:58:32.263261 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1192/2130] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:32 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:32.352867 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ecbf4eec-239d-4230-859f-53df0641b78a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582/os-interface" status: 200 len: 1830 microversion: 2.42 time: 1.356631 Oct 10 18:58:32.354261 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 939/2131] 10.222.0.43 () {60 vars in 1316 bytes} [Mon Oct 10 18:58:30 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582/os-interface => generated 1830 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:32.368200 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8d3240b3-4c52-4223-b288-292815d45522 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:32.369247 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8d3240b3-4c52-4223-b288-292815d45522 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:32.381638 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d3240b3-4c52-4223-b288-292815d45522 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:32.382971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d3240b3-4c52-4223-b288-292815d45522 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:32.383629 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d3240b3-4c52-4223-b288-292815d45522 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:32.384661 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d3240b3-4c52-4223-b288-292815d45522 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:32.385390 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d3240b3-4c52-4223-b288-292815d45522 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:32.386022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d3240b3-4c52-4223-b288-292815d45522 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:32.394578 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:32.506236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8d3240b3-4c52-4223-b288-292815d45522 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:32.523635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8d3240b3-4c52-4223-b288-292815d45522 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:32.523635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8d3240b3-4c52-4223-b288-292815d45522 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:32.535395 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8d3240b3-4c52-4223-b288-292815d45522 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1533 microversion: 2.91 time: 0.171734 Oct 10 18:58:32.541141 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1193/2132] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:32 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1533 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:32.575019 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cae95350-3927-4701-a9a2-74fe644ef507 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:32.575815 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cae95350-3927-4701-a9a2-74fe644ef507 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:32.584842 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cae95350-3927-4701-a9a2-74fe644ef507 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:32.586557 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cae95350-3927-4701-a9a2-74fe644ef507 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:32.587715 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cae95350-3927-4701-a9a2-74fe644ef507 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:32.591385 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cae95350-3927-4701-a9a2-74fe644ef507 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:32.592081 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cae95350-3927-4701-a9a2-74fe644ef507 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:32.594745 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cae95350-3927-4701-a9a2-74fe644ef507 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:32.748709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-98741c29-96d4-4534-b6e1-e9a8482e0b8a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:32.751776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-98741c29-96d4-4534-b6e1-e9a8482e0b8a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:32.760022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98741c29-96d4-4534-b6e1-e9a8482e0b8a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:32.761455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98741c29-96d4-4534-b6e1-e9a8482e0b8a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:32.765706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98741c29-96d4-4534-b6e1-e9a8482e0b8a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:32.766806 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98741c29-96d4-4534-b6e1-e9a8482e0b8a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:32.767451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98741c29-96d4-4534-b6e1-e9a8482e0b8a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:32.770881 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98741c29-96d4-4534-b6e1-e9a8482e0b8a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:32.881986 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-cae95350-3927-4701-a9a2-74fe644ef507 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] Lazy-loading 'services' on Instance uuid 09b8e807-521f-4b1d-9082-71ffd73f2d63 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:58:32.910406 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cae95350-3927-4701-a9a2-74fe644ef507 tempest-UnshelveToHostMultiNodesTest-447169642 tempest-UnshelveToHostMultiNodesTest-447169642-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1938 microversion: 2.91 time: 0.339374 Oct 10 18:58:32.926798 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 940/2133] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:32 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1938 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:32.972448 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b62bbcca-606c-450a-9d96-8b4dcc33cbed tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:32.973407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b62bbcca-606c-450a-9d96-8b4dcc33cbed tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:32.989009 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b62bbcca-606c-450a-9d96-8b4dcc33cbed tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:32.990188 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b62bbcca-606c-450a-9d96-8b4dcc33cbed tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:32.991494 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b62bbcca-606c-450a-9d96-8b4dcc33cbed tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:32.992777 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b62bbcca-606c-450a-9d96-8b4dcc33cbed tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:32.993477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b62bbcca-606c-450a-9d96-8b4dcc33cbed tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:32.994256 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b62bbcca-606c-450a-9d96-8b4dcc33cbed tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:33.039516 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b62bbcca-606c-450a-9d96-8b4dcc33cbed tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:58:33.184168 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-98741c29-96d4-4534-b6e1-e9a8482e0b8a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:33.199457 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-98741c29-96d4-4534-b6e1-e9a8482e0b8a tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1315 microversion: 2.1 time: 0.454761 Oct 10 18:58:33.201250 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1194/2134] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:32 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:33.225110 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b07efaeb-b2d8-4013-8f8b-d6c1a4b85cfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:33.225850 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b07efaeb-b2d8-4013-8f8b-d6c1a4b85cfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:33.244248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07efaeb-b2d8-4013-8f8b-d6c1a4b85cfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:33.244985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07efaeb-b2d8-4013-8f8b-d6c1a4b85cfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:33.247008 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07efaeb-b2d8-4013-8f8b-d6c1a4b85cfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:33.248095 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07efaeb-b2d8-4013-8f8b-d6c1a4b85cfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:33.250479 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07efaeb-b2d8-4013-8f8b-d6c1a4b85cfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:33.251151 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b07efaeb-b2d8-4013-8f8b-d6c1a4b85cfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:33.396182 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b62bbcca-606c-450a-9d96-8b4dcc33cbed tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "DELETE /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 204 len: 0 microversion: 2.91 time: 0.430048 Oct 10 18:58:33.397171 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 941/2135] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:58:32 2022] DELETE /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 18:58:33.404407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-90b8f561-0ecc-4520-9939-192703412290 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f319220b0d0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:33.854704 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b07efaeb-b2d8-4013-8f8b-d6c1a4b85cfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:33.875852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b07efaeb-b2d8-4013-8f8b-d6c1a4b85cfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:33.877774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b07efaeb-b2d8-4013-8f8b-d6c1a4b85cfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:33.881884 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b07efaeb-b2d8-4013-8f8b-d6c1a4b85cfd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.677333 Oct 10 18:58:33.916084 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1195/2136] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:33 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:33.921435 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4b342eb4-a381-425f-929a-e25e642dd217 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:33.922281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4b342eb4-a381-425f-929a-e25e642dd217 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:33.929886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b342eb4-a381-425f-929a-e25e642dd217 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:33.930627 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b342eb4-a381-425f-929a-e25e642dd217 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:33.934313 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b342eb4-a381-425f-929a-e25e642dd217 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:33.934313 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b342eb4-a381-425f-929a-e25e642dd217 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:33.934313 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b342eb4-a381-425f-929a-e25e642dd217 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:33.934313 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b342eb4-a381-425f-929a-e25e642dd217 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:34.108617 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4b342eb4-a381-425f-929a-e25e642dd217 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:34.119852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4b342eb4-a381-425f-929a-e25e642dd217 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:34.135581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4b342eb4-a381-425f-929a-e25e642dd217 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:34.141415 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4b342eb4-a381-425f-929a-e25e642dd217 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.223843 Oct 10 18:58:34.142333 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1196/2137] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:33 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:34.227794 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4af0cb2b-4a86-4930-8960-5003f66f03bd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:34.228703 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4af0cb2b-4a86-4930-8960-5003f66f03bd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:34.236999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4af0cb2b-4a86-4930-8960-5003f66f03bd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:34.237824 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4af0cb2b-4a86-4930-8960-5003f66f03bd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:34.238538 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4af0cb2b-4a86-4930-8960-5003f66f03bd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:34.239574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4af0cb2b-4a86-4930-8960-5003f66f03bd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:34.240237 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4af0cb2b-4a86-4930-8960-5003f66f03bd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:34.240940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4af0cb2b-4a86-4930-8960-5003f66f03bd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:34.439935 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=28 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:34.744362 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4af0cb2b-4a86-4930-8960-5003f66f03bd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:34.758809 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4af0cb2b-4a86-4930-8960-5003f66f03bd tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1315 microversion: 2.1 time: 0.537099 Oct 10 18:58:34.759405 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1197/2138] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:34 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:34.786329 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-19975c48-b781-4eac-b142-795ee66e7759 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921dc820>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:34.911567 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-90b8f561-0ecc-4520-9939-192703412290 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 1.510856 Oct 10 18:58:34.935756 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 942/2139] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:33 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:34.940875 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c75d9c54-156b-44fa-98e1-40e0aaa98683 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:34.941059 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-19975c48-b781-4eac-b142-795ee66e7759 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/2ca1f23d-20e0-4ce0-8bd4-9e3d3f0c5fbf" status: 200 len: 662 microversion: 2.1 time: 0.160845 Oct 10 18:58:34.943890 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1198/2140] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:34 2022] GET /compute/v2.1/images/2ca1f23d-20e0-4ce0-8bd4-9e3d3f0c5fbf => generated 662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:34.954395 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c75d9c54-156b-44fa-98e1-40e0aaa98683 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:34.960204 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a98bccb5-476e-424a-a2dd-08606c295ef4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d6811f0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:34.969091 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c75d9c54-156b-44fa-98e1-40e0aaa98683 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:34.969834 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c75d9c54-156b-44fa-98e1-40e0aaa98683 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:34.971211 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c75d9c54-156b-44fa-98e1-40e0aaa98683 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:34.972743 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c75d9c54-156b-44fa-98e1-40e0aaa98683 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:34.974137 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c75d9c54-156b-44fa-98e1-40e0aaa98683 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:34.975794 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c75d9c54-156b-44fa-98e1-40e0aaa98683 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:35.049757 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a98bccb5-476e-424a-a2dd-08606c295ef4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/2ca1f23d-20e0-4ce0-8bd4-9e3d3f0c5fbf" status: 200 len: 662 microversion: 2.1 time: 0.090186 Oct 10 18:58:35.054202 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1199/2141] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:34 2022] GET /compute/v2.1/images/2ca1f23d-20e0-4ce0-8bd4-9e3d3f0c5fbf => generated 662 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:35.175908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:35.185474 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-40a29e5e-cd3a-4b1c-8448-5dcef5108ab9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:35.186872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-40a29e5e-cd3a-4b1c-8448-5dcef5108ab9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:35.202589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-40a29e5e-cd3a-4b1c-8448-5dcef5108ab9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:35.203272 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-40a29e5e-cd3a-4b1c-8448-5dcef5108ab9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:35.203883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-40a29e5e-cd3a-4b1c-8448-5dcef5108ab9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:35.207003 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-40a29e5e-cd3a-4b1c-8448-5dcef5108ab9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:35.207752 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-40a29e5e-cd3a-4b1c-8448-5dcef5108ab9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:35.208337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-40a29e5e-cd3a-4b1c-8448-5dcef5108ab9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:35.338607 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-40a29e5e-cd3a-4b1c-8448-5dcef5108ab9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:35.373275 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-40a29e5e-cd3a-4b1c-8448-5dcef5108ab9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:35.377051 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-40a29e5e-cd3a-4b1c-8448-5dcef5108ab9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a452534769544fdaa6f735379ccb538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b78d4d107c74390be387b72a5e339ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:35.384001 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-40a29e5e-cd3a-4b1c-8448-5dcef5108ab9 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 200 len: 1539 microversion: 2.91 time: 0.208217 Oct 10 18:58:35.384107 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1200/2142] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:35 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 1539 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:35.654265 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c75d9c54-156b-44fa-98e1-40e0aaa98683 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:35.673745 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c75d9c54-156b-44fa-98e1-40e0aaa98683 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:35.678433 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c75d9c54-156b-44fa-98e1-40e0aaa98683 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:35.678433 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c75d9c54-156b-44fa-98e1-40e0aaa98683 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.739481 Oct 10 18:58:35.678433 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 943/2143] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:34 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:35.787031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b348b22f-2816-4103-ba26-e0a7ea91e4eb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:35.787989 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b348b22f-2816-4103-ba26-e0a7ea91e4eb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:35.818871 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b348b22f-2816-4103-ba26-e0a7ea91e4eb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:35.820241 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b348b22f-2816-4103-ba26-e0a7ea91e4eb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:35.820958 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b348b22f-2816-4103-ba26-e0a7ea91e4eb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:35.821902 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b348b22f-2816-4103-ba26-e0a7ea91e4eb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:35.824929 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b348b22f-2816-4103-ba26-e0a7ea91e4eb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:35.825643 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b348b22f-2816-4103-ba26-e0a7ea91e4eb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:35.927615 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1021a948-d503-495f-81ad-f381dd0c00ca tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f319236eee0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:36.004900 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1021a948-d503-495f-81ad-f381dd0c00ca tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.081306 Oct 10 18:58:36.006705 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 944/2144] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:35 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:36.113682 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b348b22f-2816-4103-ba26-e0a7ea91e4eb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:36.141328 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b348b22f-2816-4103-ba26-e0a7ea91e4eb tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1315 microversion: 2.1 time: 0.358972 Oct 10 18:58:36.143703 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1201/2145] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:35 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:36.226550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-53a24b72-d878-40f7-9615-111842afd9e4 req-7f8c204d-4e50-408a-81ee-0159325dbd60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f684567-fedb-4b54-8ddd-5fc50d4fda3b", "name": "network-vif-plugged", "status": "completed", "tag": "d9208944-dbb2-4d46-83e2-591bfd6bf183"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:36.243917 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-53a24b72-d878-40f7-9615-111842afd9e4 req-7f8c204d-4e50-408a-81ee-0159325dbd60 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:36.244416 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-53a24b72-d878-40f7-9615-111842afd9e4 req-7f8c204d-4e50-408a-81ee-0159325dbd60 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:36.258041 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-53a24b72-d878-40f7-9615-111842afd9e4 req-7f8c204d-4e50-408a-81ee-0159325dbd60 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:36.281574 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-53a24b72-d878-40f7-9615-111842afd9e4 req-7f8c204d-4e50-408a-81ee-0159325dbd60 service nova] Creating event network-vif-plugged:d9208944-dbb2-4d46-83e2-591bfd6bf183 for instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b on n-h2-860863-1 Oct 10 18:58:36.328650 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-53a24b72-d878-40f7-9615-111842afd9e4 req-7f8c204d-4e50-408a-81ee-0159325dbd60 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094095 Oct 10 18:58:36.335556 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 945/2146] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:36.419596 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7ead16ec-4744-4b54-9b00-d1d6d2e0d145 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:36.421246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7ead16ec-4744-4b54-9b00-d1d6d2e0d145 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] [instance: 09b8e807-521f-4b1d-9082-71ffd73f2d63] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:36.434988 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ead16ec-4744-4b54-9b00-d1d6d2e0d145 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:36.435849 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ead16ec-4744-4b54-9b00-d1d6d2e0d145 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:36.441371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ead16ec-4744-4b54-9b00-d1d6d2e0d145 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:36.443969 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ead16ec-4744-4b54-9b00-d1d6d2e0d145 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:36.446045 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ead16ec-4744-4b54-9b00-d1d6d2e0d145 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:36.446710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ead16ec-4744-4b54-9b00-d1d6d2e0d145 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:36.485371 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-7ead16ec-4744-4b54-9b00-d1d6d2e0d145 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] HTTP exception thrown: Instance 09b8e807-521f-4b1d-9082-71ffd73f2d63 could not be found. Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7ead16ec-4744-4b54-9b00-d1d6d2e0d145 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Request method failure captured: Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 HTTP/1.1 Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGqby23eagTK5g4JyPF-VVUQzpiOebF7D5ArDrHWiqvk0JDB7G1xcjjR6QlPyCTgNWKI5wkO_fjIfIIrxICTlBkqUp2jETZbppALApeEWVZ1mghXHlrCeVhs9oDw1eAMpY-k2TKHTf8tgLjRgOK8w57nDFbJZBe77Ze5li8offAXBok Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Openstack-Nova-Api-Version: 2.91 Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 7b78d4d107c74390be387b72a5e339ea Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-2071373301 Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7b78d4d107c74390be387b72a5e339ea", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7b78d4d107c74390be387b72a5e339ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b78d4d107c74390be387b72a5e339ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7b78d4d107c74390be387b72a5e339ea"}]}] Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-2071373301 Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 7b78d4d107c74390be387b72a5e339ea Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-2071373301 Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-UnshelveToHostMultiNodesTest-2071373301-project Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 9a452534769544fdaa6f735379ccb538 Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-2071373301-project Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 09b8e807-521f-4b1d-9082-71ffd73f2d63 could not be found. Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '09b8e807-521f-4b1d-9082-71ffd73f2d63'} Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b8e807-521f-4b1d-9082-71ffd73f2d63 could not be found. Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b8e807-521f-4b1d-9082-71ffd73f2d63 could not be found. Oct 10 18:58:36.489487 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:36.494811 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:36.494811 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:36.494811 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:36.494811 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:36.494811 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:36.494811 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:36.494811 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:36.494811 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b8e807-521f-4b1d-9082-71ffd73f2d63 could not be found. Oct 10 18:58:36.494811 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:36.494811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7ead16ec-4744-4b54-9b00-d1d6d2e0d145 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] Returning 404 to user: Instance 09b8e807-521f-4b1d-9082-71ffd73f2d63 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:36.494811 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7ead16ec-4744-4b54-9b00-d1d6d2e0d145 tempest-UnshelveToHostMultiNodesTest-2071373301 tempest-UnshelveToHostMultiNodesTest-2071373301-project] 10.222.0.43 "GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63" status: 404 len: 111 microversion: 2.91 time: 0.075244 Oct 10 18:58:36.503869 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1202/2147] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:36 2022] GET /compute/v2.1/servers/09b8e807-521f-4b1d-9082-71ffd73f2d63 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:58:36.674353 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-abcc6fe4-a8f1-4e9d-ac00-d1f3bdd46853 req-089f5ec0-618c-465d-ae2b-5c15d024596c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "tag": "d3835300-20da-488f-97b2-b41044bdcd24"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:36.702605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-47541975-1966-4db0-91af-71744a1b13c2 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:36.703227 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-47541975-1966-4db0-91af-71744a1b13c2 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:36.711163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-abcc6fe4-a8f1-4e9d-ac00-d1f3bdd46853 req-089f5ec0-618c-465d-ae2b-5c15d024596c service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:36.713737 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-abcc6fe4-a8f1-4e9d-ac00-d1f3bdd46853 req-089f5ec0-618c-465d-ae2b-5c15d024596c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:36.714341 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-abcc6fe4-a8f1-4e9d-ac00-d1f3bdd46853 req-089f5ec0-618c-465d-ae2b-5c15d024596c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:36.722186 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47541975-1966-4db0-91af-71744a1b13c2 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:36.727352 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47541975-1966-4db0-91af-71744a1b13c2 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:36.728049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47541975-1966-4db0-91af-71744a1b13c2 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:36.732174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47541975-1966-4db0-91af-71744a1b13c2 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:36.734459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47541975-1966-4db0-91af-71744a1b13c2 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:36.740915 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-47541975-1966-4db0-91af-71744a1b13c2 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:36.804246 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-abcc6fe4-a8f1-4e9d-ac00-d1f3bdd46853 req-089f5ec0-618c-465d-ae2b-5c15d024596c service nova] Creating event network-changed:d3835300-20da-488f-97b2-b41044bdcd24 for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 18:58:36.854430 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-abcc6fe4-a8f1-4e9d-ac00-d1f3bdd46853 req-089f5ec0-618c-465d-ae2b-5c15d024596c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184175 Oct 10 18:58:36.861867 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 946/2148] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:37.024119 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-da9a6507-3400-45a1-b82b-96bbf8a79be6 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f319236edc0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:37.463271 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-47541975-1966-4db0-91af-71744a1b13c2 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:37.473754 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-47541975-1966-4db0-91af-71744a1b13c2 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:37.475397 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-47541975-1966-4db0-91af-71744a1b13c2 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:37.477385 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-47541975-1966-4db0-91af-71744a1b13c2 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.779540 Oct 10 18:58:37.478439 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1203/2149] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:36 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:37.483459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1d43d97b-f934-4d78-b712-d571bd0936c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:37.484416 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1d43d97b-f934-4d78-b712-d571bd0936c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:37.490887 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d43d97b-f934-4d78-b712-d571bd0936c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:37.491733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d43d97b-f934-4d78-b712-d571bd0936c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:37.492321 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d43d97b-f934-4d78-b712-d571bd0936c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:37.493210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d43d97b-f934-4d78-b712-d571bd0936c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:37.493695 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d43d97b-f934-4d78-b712-d571bd0936c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:37.494125 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d43d97b-f934-4d78-b712-d571bd0936c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:38.322347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1d43d97b-f934-4d78-b712-d571bd0936c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:38.334194 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1d43d97b-f934-4d78-b712-d571bd0936c7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1315 microversion: 2.1 time: 0.851679 Oct 10 18:58:38.335042 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1204/2150] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:37 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1315 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:38.490543 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7d314065-fcc5-4e18-8c3f-7e96e0fe6e7b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d662e50>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:38.685477 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-da9a6507-3400-45a1-b82b-96bbf8a79be6 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 1.666193 Oct 10 18:58:38.686249 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 947/2151] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:37 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:58:38.704191 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e886730a-699f-4c89-b5ce-6787df0c7acd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:38.704940 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e886730a-699f-4c89-b5ce-6787df0c7acd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:38.716264 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7d314065-fcc5-4e18-8c3f-7e96e0fe6e7b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/3024ac6e-7e3d-458c-af29-f7284129d81e" status: 200 len: 662 microversion: 2.1 time: 0.229704 Oct 10 18:58:38.717515 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1205/2152] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:38 2022] GET /compute/v2.1/images/3024ac6e-7e3d-458c-af29-f7284129d81e => generated 662 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:58:38.733274 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-20b0b0d8-adb3-459a-90c3-05e5c62562b7 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318e7405e0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:38.744064 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e886730a-699f-4c89-b5ce-6787df0c7acd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:38.755305 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e886730a-699f-4c89-b5ce-6787df0c7acd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:38.755871 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e886730a-699f-4c89-b5ce-6787df0c7acd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:38.756672 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e886730a-699f-4c89-b5ce-6787df0c7acd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:38.757186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e886730a-699f-4c89-b5ce-6787df0c7acd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:38.757621 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e886730a-699f-4c89-b5ce-6787df0c7acd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:39.226264 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e886730a-699f-4c89-b5ce-6787df0c7acd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:39.240675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e886730a-699f-4c89-b5ce-6787df0c7acd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:39.246881 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e886730a-699f-4c89-b5ce-6787df0c7acd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:39.249639 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e886730a-699f-4c89-b5ce-6787df0c7acd tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.560029 Oct 10 18:58:39.252115 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 948/2153] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:38 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:39.364831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-822f2be4-bc55-41cc-b5cd-daafe8c48552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:39.365463 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-822f2be4-bc55-41cc-b5cd-daafe8c48552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:39.375973 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-822f2be4-bc55-41cc-b5cd-daafe8c48552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:39.376932 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-822f2be4-bc55-41cc-b5cd-daafe8c48552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:39.377936 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-822f2be4-bc55-41cc-b5cd-daafe8c48552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:39.386398 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-822f2be4-bc55-41cc-b5cd-daafe8c48552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:39.386895 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-822f2be4-bc55-41cc-b5cd-daafe8c48552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:39.387335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-822f2be4-bc55-41cc-b5cd-daafe8c48552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:39.577116 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-20b0b0d8-adb3-459a-90c3-05e5c62562b7 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/3024ac6e-7e3d-458c-af29-f7284129d81e" status: 200 len: 662 microversion: 2.1 time: 0.848122 Oct 10 18:58:39.580372 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1206/2154] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:38 2022] GET /compute/v2.1/images/3024ac6e-7e3d-458c-af29-f7284129d81e => generated 662 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:39.685768 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-822f2be4-bc55-41cc-b5cd-daafe8c48552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:39.703311 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b4ac6043-81fa-480d-91b9-022237550dc0 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f318d662820>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:39.717927 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-822f2be4-bc55-41cc-b5cd-daafe8c48552 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1502 microversion: 2.1 time: 0.356942 Oct 10 18:58:39.719403 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 949/2155] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:39 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1502 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:39.742478 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-57f7b882-4730-4090-b48a-a92d9363decc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:39.746820 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-57f7b882-4730-4090-b48a-a92d9363decc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:39.773751 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-57f7b882-4730-4090-b48a-a92d9363decc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:39.775432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-57f7b882-4730-4090-b48a-a92d9363decc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:39.777088 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-57f7b882-4730-4090-b48a-a92d9363decc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:39.778696 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-57f7b882-4730-4090-b48a-a92d9363decc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:39.791654 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-57f7b882-4730-4090-b48a-a92d9363decc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:39.792113 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-57f7b882-4730-4090-b48a-a92d9363decc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:39.895461 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-57f7b882-4730-4090-b48a-a92d9363decc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lazy-loading 'flavor' on Instance uuid 0f684567-fedb-4b54-8ddd-5fc50d4fda3b {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:58:39.908592 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:40.300637 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-57f7b882-4730-4090-b48a-a92d9363decc tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "POST /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b/action" status: 202 len: 0 microversion: 2.1 time: 0.561824 Oct 10 18:58:40.302520 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 950/2156] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:58:39 2022] POST /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 18:58:40.325005 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6e40d859-12a7-41c3-876b-feddf02a7c5a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:40.327891 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6e40d859-12a7-41c3-876b-feddf02a7c5a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:40.337413 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b4ac6043-81fa-480d-91b9-022237550dc0 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.637961 Oct 10 18:58:40.338375 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1207/2157] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:39 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:40.343729 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6e40d859-12a7-41c3-876b-feddf02a7c5a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:40.351151 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6e40d859-12a7-41c3-876b-feddf02a7c5a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:40.351830 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6e40d859-12a7-41c3-876b-feddf02a7c5a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:40.352461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-836ccaf5-8895-430a-a3ee-396c227f11a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:40.353245 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6e40d859-12a7-41c3-876b-feddf02a7c5a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:40.358860 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6e40d859-12a7-41c3-876b-feddf02a7c5a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:40.358860 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6e40d859-12a7-41c3-876b-feddf02a7c5a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:40.359383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-836ccaf5-8895-430a-a3ee-396c227f11a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:40.375094 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-836ccaf5-8895-430a-a3ee-396c227f11a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:40.376375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-836ccaf5-8895-430a-a3ee-396c227f11a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:40.378024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-836ccaf5-8895-430a-a3ee-396c227f11a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:40.386947 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-836ccaf5-8895-430a-a3ee-396c227f11a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:40.389446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-836ccaf5-8895-430a-a3ee-396c227f11a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:40.389946 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-836ccaf5-8895-430a-a3ee-396c227f11a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:40.750943 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6e40d859-12a7-41c3-876b-feddf02a7c5a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:40.771382 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6e40d859-12a7-41c3-876b-feddf02a7c5a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:40.774320 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6e40d859-12a7-41c3-876b-feddf02a7c5a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:40.779525 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6e40d859-12a7-41c3-876b-feddf02a7c5a tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.473256 Oct 10 18:58:40.782013 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 951/2158] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:40 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:40.931836 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-836ccaf5-8895-430a-a3ee-396c227f11a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:40.956209 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-836ccaf5-8895-430a-a3ee-396c227f11a7 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1510 microversion: 2.1 time: 0.611673 Oct 10 18:58:40.959336 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1208/2159] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:40 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1510 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:41.355761 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5132b807-c9c1-4027-b709-b1becdde9b20 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f319225daf0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:41.811678 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9873393a-c564-4061-9067-25e5ed7099e1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:41.812690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9873393a-c564-4061-9067-25e5ed7099e1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:41.837727 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9873393a-c564-4061-9067-25e5ed7099e1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:41.845856 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9873393a-c564-4061-9067-25e5ed7099e1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:41.846302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9873393a-c564-4061-9067-25e5ed7099e1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:41.847046 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9873393a-c564-4061-9067-25e5ed7099e1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:41.847498 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9873393a-c564-4061-9067-25e5ed7099e1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:41.847921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9873393a-c564-4061-9067-25e5ed7099e1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:42.343494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9873393a-c564-4061-9067-25e5ed7099e1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:42.360169 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9873393a-c564-4061-9067-25e5ed7099e1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:42.364625 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9873393a-c564-4061-9067-25e5ed7099e1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:42.365872 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9873393a-c564-4061-9067-25e5ed7099e1 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.559114 Oct 10 18:58:42.371827 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1209/2160] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:41 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:42.385117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2b84f7bc-38b2-4752-a7cb-058a13dfacd8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:42.385940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2b84f7bc-38b2-4752-a7cb-058a13dfacd8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:42.401501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2b84f7bc-38b2-4752-a7cb-058a13dfacd8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:42.403338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2b84f7bc-38b2-4752-a7cb-058a13dfacd8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:42.406707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2b84f7bc-38b2-4752-a7cb-058a13dfacd8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:42.407786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2b84f7bc-38b2-4752-a7cb-058a13dfacd8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:42.409614 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2b84f7bc-38b2-4752-a7cb-058a13dfacd8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:42.410713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2b84f7bc-38b2-4752-a7cb-058a13dfacd8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:42.614072 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2b84f7bc-38b2-4752-a7cb-058a13dfacd8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:42.625848 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2b84f7bc-38b2-4752-a7cb-058a13dfacd8 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1493 microversion: 2.1 time: 0.251296 Oct 10 18:58:42.628862 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1210/2161] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:42 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1493 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:42.641841 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d0f12680-f4b4-4a98-b2a6-971379216cc4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d669160>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:42.791588 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5132b807-c9c1-4027-b709-b1becdde9b20 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 1.440980 Oct 10 18:58:42.792782 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 952/2162] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:41 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:42.803550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d947aeb0-9f83-44ec-bbfb-0653d84ed78c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:42.804509 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d947aeb0-9f83-44ec-bbfb-0653d84ed78c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:42.809972 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d0f12680-f4b4-4a98-b2a6-971379216cc4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/ed1e231c-b66d-47cf-afc8-4077037f9550" status: 200 len: 662 microversion: 2.1 time: 0.179792 Oct 10 18:58:42.820224 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1211/2163] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:42 2022] GET /compute/v2.1/images/ed1e231c-b66d-47cf-afc8-4077037f9550 => generated 662 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:42.830114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ab177f35-55fc-4979-81db-1e9e678b9b4f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318ddc3430>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:42.836907 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d947aeb0-9f83-44ec-bbfb-0653d84ed78c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:42.837771 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d947aeb0-9f83-44ec-bbfb-0653d84ed78c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:42.839065 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d947aeb0-9f83-44ec-bbfb-0653d84ed78c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:42.841631 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d947aeb0-9f83-44ec-bbfb-0653d84ed78c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:42.842316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d947aeb0-9f83-44ec-bbfb-0653d84ed78c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:42.845075 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d947aeb0-9f83-44ec-bbfb-0653d84ed78c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:42.895567 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ab177f35-55fc-4979-81db-1e9e678b9b4f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/ed1e231c-b66d-47cf-afc8-4077037f9550" status: 200 len: 662 microversion: 2.1 time: 0.065834 Oct 10 18:58:42.896248 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1212/2164] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:42 2022] GET /compute/v2.1/images/ed1e231c-b66d-47cf-afc8-4077037f9550 => generated 662 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:58:42.932158 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d947aeb0-9f83-44ec-bbfb-0653d84ed78c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:58:43.098981 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1504097073", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:43.187036 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] validate_networks() for None {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:58:43.524227 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:58:43.527254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:58:43.528436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:58:43.529440 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:58:43.531714 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:58:43.535356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:43.550090 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d947aeb0-9f83-44ec-bbfb-0653d84ed78c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 204 len: 0 microversion: 2.1 time: 0.753990 Oct 10 18:58:43.554499 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 953/2165] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:58:42 2022] DELETE /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 0 bytes in 757 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:58:43.560567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8a1a0403-edf0-4ccd-a8cf-9ab53d9abb5d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:43.562270 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8a1a0403-edf0-4ccd-a8cf-9ab53d9abb5d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:43.566809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:43.567604 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:43.568187 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:43.569336 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:43.570187 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:43.570766 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:43.580080 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a1a0403-edf0-4ccd-a8cf-9ab53d9abb5d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:43.580603 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a1a0403-edf0-4ccd-a8cf-9ab53d9abb5d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:43.581025 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a1a0403-edf0-4ccd-a8cf-9ab53d9abb5d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:43.581741 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a1a0403-edf0-4ccd-a8cf-9ab53d9abb5d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:43.595739 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Getting quotas for project 77d197e4831748d9a1d12e4a3b44629d. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:58:43.600029 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Getting quotas for user e36772b0f87c46b2b31d642729e02b50 and project 77d197e4831748d9a1d12e4a3b44629d. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:58:43.603923 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a1a0403-edf0-4ccd-a8cf-9ab53d9abb5d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:43.605233 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a1a0403-edf0-4ccd-a8cf-9ab53d9abb5d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:43.631280 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:58:43.634901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:58:43.826133 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-602ac49d-a65b-4176-bf4d-52b243fe881e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730951 Oct 10 18:58:43.827290 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1213/2166] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:58:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 18:58:43.839725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c62bfad5-b973-4e76-ae3e-506246c10268 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:43.844744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c62bfad5-b973-4e76-ae3e-506246c10268 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:43.863327 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c62bfad5-b973-4e76-ae3e-506246c10268 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:43.863832 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c62bfad5-b973-4e76-ae3e-506246c10268 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:43.864275 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c62bfad5-b973-4e76-ae3e-506246c10268 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:43.865032 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c62bfad5-b973-4e76-ae3e-506246c10268 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:43.865851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c62bfad5-b973-4e76-ae3e-506246c10268 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:43.877434 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c62bfad5-b973-4e76-ae3e-506246c10268 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:43.887708 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8a1a0403-edf0-4ccd-a8cf-9ab53d9abb5d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:43.919017 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8a1a0403-edf0-4ccd-a8cf-9ab53d9abb5d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:43.936316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8a1a0403-edf0-4ccd-a8cf-9ab53d9abb5d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:43.938223 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8a1a0403-edf0-4ccd-a8cf-9ab53d9abb5d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.382155 Oct 10 18:58:43.940444 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 954/2167] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:43 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:43.960445 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cb5de352-eb40-40bd-84c2-667be619f620 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f3192362ca0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:44.061710 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cb5de352-eb40-40bd-84c2-667be619f620 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.117930 Oct 10 18:58:44.065135 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 955/2168] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:43 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:44.236603 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c62bfad5-b973-4e76-ae3e-506246c10268 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:44.245278 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c62bfad5-b973-4e76-ae3e-506246c10268 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1499 microversion: 2.1 time: 0.415187 Oct 10 18:58:44.259629 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1214/2169] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:43 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1499 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:44.324795 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1812442890", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:44.423968 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] validate_networks() for None {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:58:44.814227 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:58:44.814742 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:58:44.815478 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:58:44.815954 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:58:44.816721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:58:44.841279 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:44.841754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:44.842180 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:44.842981 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:44.843433 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:44.843849 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:44.868988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Getting quotas for project 77d197e4831748d9a1d12e4a3b44629d. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:58:44.874632 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Getting quotas for user e36772b0f87c46b2b31d642729e02b50 and project 77d197e4831748d9a1d12e4a3b44629d. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:58:44.891699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:58:44.894802 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:58:44.969789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-61d0d54b-becf-43c2-91da-6046ee1f26cf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:44.976354 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-61d0d54b-becf-43c2-91da-6046ee1f26cf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:44.983767 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61d0d54b-becf-43c2-91da-6046ee1f26cf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:44.984456 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61d0d54b-becf-43c2-91da-6046ee1f26cf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:44.985173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61d0d54b-becf-43c2-91da-6046ee1f26cf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:44.986141 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61d0d54b-becf-43c2-91da-6046ee1f26cf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:44.986745 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61d0d54b-becf-43c2-91da-6046ee1f26cf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:44.987323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61d0d54b-becf-43c2-91da-6046ee1f26cf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:45.107050 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-af0bd0e2-8ff5-4141-8f71-78cc6626ad20 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787953 Oct 10 18:58:45.114625 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 956/2170] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:58:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:58:45.128845 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b735a7d7-7cb7-4bbd-af39-fcffd73a871b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f31922abe50>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:45.219789 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b735a7d7-7cb7-4bbd-af39-fcffd73a871b tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.103783 Oct 10 18:58:45.221287 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 957/2171] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:45 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:45.230972 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bd88ce68-ce59-419a-88a0-b0638ddcf29f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:45.231588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bd88ce68-ce59-419a-88a0-b0638ddcf29f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:45.449822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-61d0d54b-becf-43c2-91da-6046ee1f26cf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:45.462677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-61d0d54b-becf-43c2-91da-6046ee1f26cf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:45.465638 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-61d0d54b-becf-43c2-91da-6046ee1f26cf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:45.467086 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-61d0d54b-becf-43c2-91da-6046ee1f26cf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.501424 Oct 10 18:58:45.468370 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1215/2172] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:44 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:45.477352 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e4f776be-2f24-409d-98c7-8be38845bd85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:45.480054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e4f776be-2f24-409d-98c7-8be38845bd85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:45.488411 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4f776be-2f24-409d-98c7-8be38845bd85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:45.489406 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4f776be-2f24-409d-98c7-8be38845bd85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:45.490242 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4f776be-2f24-409d-98c7-8be38845bd85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:45.491446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4f776be-2f24-409d-98c7-8be38845bd85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:45.492152 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4f776be-2f24-409d-98c7-8be38845bd85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:45.493893 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e4f776be-2f24-409d-98c7-8be38845bd85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:45.638448 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bd88ce68-ce59-419a-88a0-b0638ddcf29f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:45.654204 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bd88ce68-ce59-419a-88a0-b0638ddcf29f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1218 microversion: 2.1 time: 0.424366 Oct 10 18:58:45.656190 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 958/2173] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:45 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1218 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:45.898613 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e4f776be-2f24-409d-98c7-8be38845bd85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:45.916128 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e4f776be-2f24-409d-98c7-8be38845bd85 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1499 microversion: 2.1 time: 0.445389 Oct 10 18:58:45.917937 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1216/2174] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:45 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1499 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:46.243693 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-96bd3028-a26d-4f7c-ad14-8ff6dcebbc52 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f319225d670>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:46.388796 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-96bd3028-a26d-4f7c-ad14-8ff6dcebbc52 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.153403 Oct 10 18:58:46.400575 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 959/2175] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:46 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:46.511266 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-96765a43-6c8b-4642-8df4-ca9fb2783d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:46.513092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-96765a43-6c8b-4642-8df4-ca9fb2783d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:46.525854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96765a43-6c8b-4642-8df4-ca9fb2783d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:46.527121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96765a43-6c8b-4642-8df4-ca9fb2783d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:46.528184 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96765a43-6c8b-4642-8df4-ca9fb2783d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:46.530437 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96765a43-6c8b-4642-8df4-ca9fb2783d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:46.531833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96765a43-6c8b-4642-8df4-ca9fb2783d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:46.533322 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-96765a43-6c8b-4642-8df4-ca9fb2783d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:46.689768 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e530c7ca-61e4-4623-be0b-882c9e6e1de5 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:46.691504 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e530c7ca-61e4-4623-be0b-882c9e6e1de5 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:46.909553 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e530c7ca-61e4-4623-be0b-882c9e6e1de5 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:46.926852 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e530c7ca-61e4-4623-be0b-882c9e6e1de5 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1218 microversion: 2.1 time: 0.237622 Oct 10 18:58:46.926852 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 960/2176] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:46 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1218 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:46.961551 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-8818baa0-f088-48b3-9f66-67eb0d815dd0 req-5ab179b1-7ebf-4a97-a99e-6f9bb4ef9a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f684567-fedb-4b54-8ddd-5fc50d4fda3b", "name": "network-vif-deleted", "tag": "d9208944-dbb2-4d46-83e2-591bfd6bf183"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:47.009145 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-8818baa0-f088-48b3-9f66-67eb0d815dd0 req-5ab179b1-7ebf-4a97-a99e-6f9bb4ef9a4f service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:47.010147 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-8818baa0-f088-48b3-9f66-67eb0d815dd0 req-5ab179b1-7ebf-4a97-a99e-6f9bb4ef9a4f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:47.016931 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-8818baa0-f088-48b3-9f66-67eb0d815dd0 req-5ab179b1-7ebf-4a97-a99e-6f9bb4ef9a4f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:47.060674 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-8818baa0-f088-48b3-9f66-67eb0d815dd0 req-5ab179b1-7ebf-4a97-a99e-6f9bb4ef9a4f service nova] Creating event network-vif-deleted:d9208944-dbb2-4d46-83e2-591bfd6bf183 for instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b on n-h2-860863-1 Oct 10 18:58:47.068269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-96765a43-6c8b-4642-8df4-ca9fb2783d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:47.078715 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-8818baa0-f088-48b3-9f66-67eb0d815dd0 req-5ab179b1-7ebf-4a97-a99e-6f9bb4ef9a4f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150019 Oct 10 18:58:47.081487 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 961/2177] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:47.081615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-96765a43-6c8b-4642-8df4-ca9fb2783d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:47.087172 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-96765a43-6c8b-4642-8df4-ca9fb2783d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:47.087172 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-96765a43-6c8b-4642-8df4-ca9fb2783d86 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.582264 Oct 10 18:58:47.087172 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1217/2178] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:46 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:47.102467 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a497f3a0-49e3-4ac9-a652-609fef90744d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:47.105355 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a497f3a0-49e3-4ac9-a652-609fef90744d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:47.117848 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a497f3a0-49e3-4ac9-a652-609fef90744d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:47.123404 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a497f3a0-49e3-4ac9-a652-609fef90744d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:47.124026 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a497f3a0-49e3-4ac9-a652-609fef90744d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:47.131624 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a497f3a0-49e3-4ac9-a652-609fef90744d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:47.131624 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a497f3a0-49e3-4ac9-a652-609fef90744d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:47.131624 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a497f3a0-49e3-4ac9-a652-609fef90744d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:47.186565 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a497f3a0-49e3-4ac9-a652-609fef90744d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:47.187477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a497f3a0-49e3-4ac9-a652-609fef90744d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:47.188166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a497f3a0-49e3-4ac9-a652-609fef90744d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:47.189633 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-a497f3a0-49e3-4ac9-a652-609fef90744d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lazy-loading 'fault' on Instance uuid 0f684567-fedb-4b54-8ddd-5fc50d4fda3b {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:58:47.274173 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a497f3a0-49e3-4ac9-a652-609fef90744d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afedfd9cc5b241ad97e27f6e911244a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5d5fb01be0c409d98c222551a2c0e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:47.287799 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a497f3a0-49e3-4ac9-a652-609fef90744d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 200 len: 1305 microversion: 2.1 time: 0.198610 Oct 10 18:58:47.291135 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 962/2179] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:47 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 1305 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:47.405207 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-70bb4f7d-2cb3-43ae-bb7e-8e12609e01c4 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f318d5a7550>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:47.494812 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-70bb4f7d-2cb3-43ae-bb7e-8e12609e01c4 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.093641 Oct 10 18:58:47.496032 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1218/2180] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:47 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:47.953871 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d55a3264-c987-4030-b2f5-5e7979d40766 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:47.955710 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d55a3264-c987-4030-b2f5-5e7979d40766 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:47.988135 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d55a3264-c987-4030-b2f5-5e7979d40766 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:47.989965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d55a3264-c987-4030-b2f5-5e7979d40766 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:47.992078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d55a3264-c987-4030-b2f5-5e7979d40766 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:47.995697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d55a3264-c987-4030-b2f5-5e7979d40766 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:47.999166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d55a3264-c987-4030-b2f5-5e7979d40766 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:48.000136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d55a3264-c987-4030-b2f5-5e7979d40766 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:48.134174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d55a3264-c987-4030-b2f5-5e7979d40766 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:48.156833 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d55a3264-c987-4030-b2f5-5e7979d40766 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1270 microversion: 2.1 time: 0.204639 Oct 10 18:58:48.159735 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 963/2181] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:47 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1270 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:48.187314 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c63ea691-df58-4dae-a16a-6bec8f2cd9c6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:48.189233 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c63ea691-df58-4dae-a16a-6bec8f2cd9c6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:48.205635 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c63ea691-df58-4dae-a16a-6bec8f2cd9c6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:48.207183 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c63ea691-df58-4dae-a16a-6bec8f2cd9c6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:48.213178 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c63ea691-df58-4dae-a16a-6bec8f2cd9c6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:48.214151 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c63ea691-df58-4dae-a16a-6bec8f2cd9c6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:48.220169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c63ea691-df58-4dae-a16a-6bec8f2cd9c6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:48.220169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c63ea691-df58-4dae-a16a-6bec8f2cd9c6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:48.321906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-973166884", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:48.406465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] validate_networks() for None {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:58:48.683666 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c63ea691-df58-4dae-a16a-6bec8f2cd9c6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:48.698746 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c63ea691-df58-4dae-a16a-6bec8f2cd9c6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:48.702623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c63ea691-df58-4dae-a16a-6bec8f2cd9c6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:48.707814 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c63ea691-df58-4dae-a16a-6bec8f2cd9c6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.540011 Oct 10 18:58:48.712124 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 964/2182] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:48 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:48.723913 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dd86b740-d9f9-464f-9731-0eead41ca187 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:48.727089 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-dd86b740-d9f9-464f-9731-0eead41ca187 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:48.741904 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dd86b740-d9f9-464f-9731-0eead41ca187 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:48.743423 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dd86b740-d9f9-464f-9731-0eead41ca187 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:48.747185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dd86b740-d9f9-464f-9731-0eead41ca187 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:48.747185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dd86b740-d9f9-464f-9731-0eead41ca187 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:48.747942 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dd86b740-d9f9-464f-9731-0eead41ca187 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:48.749354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dd86b740-d9f9-464f-9731-0eead41ca187 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:48.782190 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-dd86b740-d9f9-464f-9731-0eead41ca187 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.782681 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:58:48.783109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:58:48.783587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:58:48.784000 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:58:48.784414 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dd86b740-d9f9-464f-9731-0eead41ca187 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b HTTP/1.1 Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '0f684567-fedb-4b54-8ddd-5fc50d4fda3b'} Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:48.785165 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.789379 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:48.789379 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:48.789379 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:48.789379 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:48.789379 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:48.789379 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.789379 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.791258 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dd86b740-d9f9-464f-9731-0eead41ca187 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:48.792341 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dd86b740-d9f9-464f-9731-0eead41ca187 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 404 len: 111 microversion: 2.1 time: 0.078634 Oct 10 18:58:48.793496 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 965/2183] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:48 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:48.794542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:48.795040 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:48.800385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:48.800385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:48.800385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:48.800385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:48.805429 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b894dd2e-c898-4c9b-ad2d-def838f3fdbc tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f319225d700>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:48.810883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:48.821953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Getting quotas for project 18b84921346941a69fa1ae60fc2d7823. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:58:48.826465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Getting quotas for user 6bff97a46d3245adb48d3dfbd7333590 and project 18b84921346941a69fa1ae60fc2d7823. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:58:48.840201 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:58:48.842451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:58:48.869949 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b894dd2e-c898-4c9b-ad2d-def838f3fdbc tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.074986 Oct 10 18:58:48.871001 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 966/2184] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:48 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:48.876082 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-aee807ab-de28-4c84-80c9-e33fb70de936 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:48.876853 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-aee807ab-de28-4c84-80c9-e33fb70de936 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:48.887631 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-aee807ab-de28-4c84-80c9-e33fb70de936 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:48.888192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-aee807ab-de28-4c84-80c9-e33fb70de936 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:48.888718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-aee807ab-de28-4c84-80c9-e33fb70de936 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:48.889909 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-aee807ab-de28-4c84-80c9-e33fb70de936 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:48.890150 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-aee807ab-de28-4c84-80c9-e33fb70de936 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:48.890733 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-aee807ab-de28-4c84-80c9-e33fb70de936 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:48.914435 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-aee807ab-de28-4c84-80c9-e33fb70de936 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-aee807ab-de28-4c84-80c9-e33fb70de936 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b HTTP/1.1 Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '0f684567-fedb-4b54-8ddd-5fc50d4fda3b'} Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:48.918907 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:48.923985 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.923985 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.923985 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:48.923985 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.923985 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:48.923985 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:48.923985 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:48.923985 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:48.923985 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:48.923985 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.923985 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.923985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-aee807ab-de28-4c84-80c9-e33fb70de936 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:48.923985 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-aee807ab-de28-4c84-80c9-e33fb70de936 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 404 len: 111 microversion: 2.1 time: 0.046791 Oct 10 18:58:48.923985 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 967/2185] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:58:48 2022] DELETE /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:48.931527 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6a7921a4-4b3f-45f8-a313-752822860315 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:48.932226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6a7921a4-4b3f-45f8-a313-752822860315 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 0f684567-fedb-4b54-8ddd-5fc50d4fda3b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:48.939898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:48.942892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a7921a4-4b3f-45f8-a313-752822860315 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:48.943942 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a7921a4-4b3f-45f8-a313-752822860315 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:48.945503 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a7921a4-4b3f-45f8-a313-752822860315 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:48.946482 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a7921a4-4b3f-45f8-a313-752822860315 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:48.947096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a7921a4-4b3f-45f8-a313-752822860315 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:48.948155 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a7921a4-4b3f-45f8-a313-752822860315 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:48.975697 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-6a7921a4-4b3f-45f8-a313-752822860315 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6a7921a4-4b3f-45f8-a313-752822860315 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b HTTP/1.1 Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '0f684567-fedb-4b54-8ddd-5fc50d4fda3b'} Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:48.977998 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.982546 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:48.982546 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:48.982546 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:48.982546 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:48.982546 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:48.982546 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. Oct 10 18:58:48.982546 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:48.984756 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6a7921a4-4b3f-45f8-a313-752822860315 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 0f684567-fedb-4b54-8ddd-5fc50d4fda3b could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:48.991041 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6a7921a4-4b3f-45f8-a313-752822860315 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b" status: 404 len: 111 microversion: 2.1 time: 0.064267 Oct 10 18:58:48.993144 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 968/2186] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:48 2022] GET /compute/v2.1/servers/0f684567-fedb-4b54-8ddd-5fc50d4fda3b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:49.020195 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8b63001c-529b-4d86-8b44-0711b7b5529e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:49.036785 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8b63001c-529b-4d86-8b44-0711b7b5529e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:49.040344 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3321d801-e7a6-46e7-8554-d89ce3a9b6a3 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.072850 Oct 10 18:58:49.045533 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1219/2187] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:58:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 18:58:49.055390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b63001c-529b-4d86-8b44-0711b7b5529e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.057225 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e1a0db74-59cb-4f43-b53a-bcd6085a6e40 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:49.059715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e1a0db74-59cb-4f43-b53a-bcd6085a6e40 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:49.059829 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b63001c-529b-4d86-8b44-0711b7b5529e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.059829 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b63001c-529b-4d86-8b44-0711b7b5529e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.060565 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b63001c-529b-4d86-8b44-0711b7b5529e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.062384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b63001c-529b-4d86-8b44-0711b7b5529e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.063032 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b63001c-529b-4d86-8b44-0711b7b5529e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.103289 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-8b63001c-529b-4d86-8b44-0711b7b5529e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8b63001c-529b-4d86-8b44-0711b7b5529e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e HTTP/1.1 Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '8256637b-2667-49ec-9a24-a81063c7f99e'} Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:49.105226 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:49.109457 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:49.109457 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.109457 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.109457 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.109457 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.109457 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.109457 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.109457 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:49.109457 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:49.109457 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:49.109457 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.116453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8b63001c-529b-4d86-8b44-0711b7b5529e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:49.117619 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8b63001c-529b-4d86-8b44-0711b7b5529e tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 404 len: 111 microversion: 2.1 time: 0.119049 Oct 10 18:58:49.118684 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 969/2188] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:58:48 2022] DELETE /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:49.131485 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-edb2c699-0767-4923-93b6-0fc7a5c9c415 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:49.133224 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-edb2c699-0767-4923-93b6-0fc7a5c9c415 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 8256637b-2667-49ec-9a24-a81063c7f99e] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:49.148352 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edb2c699-0767-4923-93b6-0fc7a5c9c415 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.149246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edb2c699-0767-4923-93b6-0fc7a5c9c415 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.149961 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edb2c699-0767-4923-93b6-0fc7a5c9c415 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.152856 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edb2c699-0767-4923-93b6-0fc7a5c9c415 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.153540 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edb2c699-0767-4923-93b6-0fc7a5c9c415 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.155568 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edb2c699-0767-4923-93b6-0fc7a5c9c415 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.193533 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-edb2c699-0767-4923-93b6-0fc7a5c9c415 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-edb2c699-0767-4923-93b6-0fc7a5c9c415 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e HTTP/1.1 Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '8256637b-2667-49ec-9a24-a81063c7f99e'} Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.196122 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.201708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.201708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.201708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.201708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:49.201708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:49.201708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. Oct 10 18:58:49.201708 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.205216 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-edb2c699-0767-4923-93b6-0fc7a5c9c415 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 8256637b-2667-49ec-9a24-a81063c7f99e could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:49.206499 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-edb2c699-0767-4923-93b6-0fc7a5c9c415 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e" status: 404 len: 111 microversion: 2.1 time: 0.083670 Oct 10 18:58:49.208749 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 970/2189] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:49 2022] GET /compute/v2.1/servers/8256637b-2667-49ec-9a24-a81063c7f99e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:49.220182 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9e4b9689-1508-49ed-b619-a1d401f7e79f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:49.226576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9e4b9689-1508-49ed-b619-a1d401f7e79f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:49.239224 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e4b9689-1508-49ed-b619-a1d401f7e79f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.241477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e4b9689-1508-49ed-b619-a1d401f7e79f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.245923 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e4b9689-1508-49ed-b619-a1d401f7e79f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.247444 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e4b9689-1508-49ed-b619-a1d401f7e79f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.249123 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e4b9689-1508-49ed-b619-a1d401f7e79f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.250839 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9e4b9689-1508-49ed-b619-a1d401f7e79f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.493834 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9e4b9689-1508-49ed-b619-a1d401f7e79f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:49.516597 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9e4b9689-1508-49ed-b619-a1d401f7e79f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1278 microversion: 2.1 time: 0.303582 Oct 10 18:58:49.517105 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 971/2190] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:49 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1278 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:49.522164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f8799585-9786-4803-a1d4-3ea0cc1f31c1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:49.522969 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f8799585-9786-4803-a1d4-3ea0cc1f31c1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:49.541050 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8799585-9786-4803-a1d4-3ea0cc1f31c1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.541774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8799585-9786-4803-a1d4-3ea0cc1f31c1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.542404 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8799585-9786-4803-a1d4-3ea0cc1f31c1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.543341 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8799585-9786-4803-a1d4-3ea0cc1f31c1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.543989 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8799585-9786-4803-a1d4-3ea0cc1f31c1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.544647 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8799585-9786-4803-a1d4-3ea0cc1f31c1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.566183 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-f8799585-9786-4803-a1d4-3ea0cc1f31c1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f8799585-9786-4803-a1d4-3ea0cc1f31c1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b HTTP/1.1 Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '2ab18d87-5b5b-4d03-a0c0-a07a998f411b'} Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:49.568281 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:49.572067 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:58:49.572067 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.572067 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.572067 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.572067 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.572067 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.572067 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.572067 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:49.572067 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:49.572067 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:58:49.572067 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.575261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f8799585-9786-4803-a1d4-3ea0cc1f31c1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:49.576327 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f8799585-9786-4803-a1d4-3ea0cc1f31c1 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 404 len: 111 microversion: 2.1 time: 0.058119 Oct 10 18:58:49.576948 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 972/2191] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:58:49 2022] DELETE /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:49.590390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ff81106b-50b9-4e5f-923c-3fc81195cbdf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:49.591184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ff81106b-50b9-4e5f-923c-3fc81195cbdf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 2ab18d87-5b5b-4d03-a0c0-a07a998f411b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:49.604360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ff81106b-50b9-4e5f-923c-3fc81195cbdf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.605642 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ff81106b-50b9-4e5f-923c-3fc81195cbdf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.606390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ff81106b-50b9-4e5f-923c-3fc81195cbdf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.607647 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ff81106b-50b9-4e5f-923c-3fc81195cbdf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.610283 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ff81106b-50b9-4e5f-923c-3fc81195cbdf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.610982 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ff81106b-50b9-4e5f-923c-3fc81195cbdf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.634911 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-ff81106b-50b9-4e5f-923c-3fc81195cbdf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ff81106b-50b9-4e5f-923c-3fc81195cbdf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b HTTP/1.1 Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '2ab18d87-5b5b-4d03-a0c0-a07a998f411b'} Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.637039 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.640904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.640904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.640904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.640904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:49.640904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:49.640904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. Oct 10 18:58:49.640904 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.643497 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ff81106b-50b9-4e5f-923c-3fc81195cbdf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 2ab18d87-5b5b-4d03-a0c0-a07a998f411b could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:49.649203 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ff81106b-50b9-4e5f-923c-3fc81195cbdf tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b" status: 404 len: 111 microversion: 2.1 time: 0.067507 Oct 10 18:58:49.650083 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 973/2192] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:49 2022] GET /compute/v2.1/servers/2ab18d87-5b5b-4d03-a0c0-a07a998f411b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:49.674995 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c27545fc-1f0e-47c2-b077-47d3eb6f44b9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:49.677922 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c27545fc-1f0e-47c2-b077-47d3eb6f44b9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:49.686216 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e1a0db74-59cb-4f43-b53a-bcd6085a6e40 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:49.688667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c27545fc-1f0e-47c2-b077-47d3eb6f44b9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.689979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c27545fc-1f0e-47c2-b077-47d3eb6f44b9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.690534 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c27545fc-1f0e-47c2-b077-47d3eb6f44b9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.691315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c27545fc-1f0e-47c2-b077-47d3eb6f44b9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.691838 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c27545fc-1f0e-47c2-b077-47d3eb6f44b9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.692328 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c27545fc-1f0e-47c2-b077-47d3eb6f44b9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.696869 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e1a0db74-59cb-4f43-b53a-bcd6085a6e40 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1213 microversion: 2.1 time: 0.643426 Oct 10 18:58:49.703952 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1220/2193] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:49 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1213 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:58:49.722925 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-c27545fc-1f0e-47c2-b077-47d3eb6f44b9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c27545fc-1f0e-47c2-b077-47d3eb6f44b9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 HTTP/1.1 Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '51effa0d-d131-46be-ae0a-859e231dd233'} Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:49.726715 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:49.730666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:58:49.730666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.730666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.730666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.730666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.730666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.730666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.730666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:49.730666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:49.730666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:58:49.730666 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.730666 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c27545fc-1f0e-47c2-b077-47d3eb6f44b9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:49.732074 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c27545fc-1f0e-47c2-b077-47d3eb6f44b9 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 404 len: 111 microversion: 2.1 time: 0.076467 Oct 10 18:58:49.735850 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 974/2194] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:58:49 2022] DELETE /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:49.744325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-007a60fb-88df-4264-90e1-1a8d877423ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:49.746717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-007a60fb-88df-4264-90e1-1a8d877423ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:49.759030 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f0da08d6-b6a9-4b43-a02c-04ec29435472 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:49.759646 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f0da08d6-b6a9-4b43-a02c-04ec29435472 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 51effa0d-d131-46be-ae0a-859e231dd233] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:49.766485 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0da08d6-b6a9-4b43-a02c-04ec29435472 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.767046 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0da08d6-b6a9-4b43-a02c-04ec29435472 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.767482 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0da08d6-b6a9-4b43-a02c-04ec29435472 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.768192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0da08d6-b6a9-4b43-a02c-04ec29435472 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.768635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-007a60fb-88df-4264-90e1-1a8d877423ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.769563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0da08d6-b6a9-4b43-a02c-04ec29435472 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.770211 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0da08d6-b6a9-4b43-a02c-04ec29435472 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.771055 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-007a60fb-88df-4264-90e1-1a8d877423ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.777025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-007a60fb-88df-4264-90e1-1a8d877423ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.780126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-007a60fb-88df-4264-90e1-1a8d877423ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:49.782116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-007a60fb-88df-4264-90e1-1a8d877423ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:49.783026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-007a60fb-88df-4264-90e1-1a8d877423ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:49.802875 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-f0da08d6-b6a9-4b43-a02c-04ec29435472 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f0da08d6-b6a9-4b43-a02c-04ec29435472 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 HTTP/1.1 Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '51effa0d-d131-46be-ae0a-859e231dd233'} Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.808049 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.815187 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.815187 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.815187 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.815187 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:49.815187 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:49.815187 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. Oct 10 18:58:49.815187 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.815187 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f0da08d6-b6a9-4b43-a02c-04ec29435472 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 51effa0d-d131-46be-ae0a-859e231dd233 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:49.815187 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f0da08d6-b6a9-4b43-a02c-04ec29435472 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233" status: 404 len: 111 microversion: 2.1 time: 0.056185 Oct 10 18:58:49.815187 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 975/2195] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:49 2022] GET /compute/v2.1/servers/51effa0d-d131-46be-ae0a-859e231dd233 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:49.822966 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-03193510-7d88-4180-87e7-5c0c6e67ec40 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:49.823473 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-03193510-7d88-4180-87e7-5c0c6e67ec40 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: a2fa0400-c9b5-49df-af7c-2ffcb7a502e7] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:49.838893 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-03193510-7d88-4180-87e7-5c0c6e67ec40 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-03193510-7d88-4180-87e7-5c0c6e67ec40 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/servers/a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 HTTP/1.1 Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'a2fa0400-c9b5-49df-af7c-2ffcb7a502e7'} Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.840455 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.844882 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.844882 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.844882 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.844882 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:49.844882 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:49.844882 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:58:49.844882 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.847368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-03193510-7d88-4180-87e7-5c0c6e67ec40 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:49.848246 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-03193510-7d88-4180-87e7-5c0c6e67ec40 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a2fa0400-c9b5-49df-af7c-2ffcb7a502e7" status: 404 len: 111 microversion: 2.1 time: 0.033214 Oct 10 18:58:49.848815 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 976/2196] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:58:49 2022] DELETE /compute/v2.1/servers/a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 18:58:49.861099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0a4272d2-120c-4401-8f27-12be0f62ff6c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:49.865677 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0a4272d2-120c-4401-8f27-12be0f62ff6c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: a2fa0400-c9b5-49df-af7c-2ffcb7a502e7] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:49.874683 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-0a4272d2-120c-4401-8f27-12be0f62ff6c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0a4272d2-120c-4401-8f27-12be0f62ff6c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 HTTP/1.1 Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'a2fa0400-c9b5-49df-af7c-2ffcb7a502e7'} Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:49.877108 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:49.883600 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:49.883600 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:49.883600 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:49.883600 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. Oct 10 18:58:49.883600 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:49.885481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0a4272d2-120c-4401-8f27-12be0f62ff6c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:49.887635 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0a4272d2-120c-4401-8f27-12be0f62ff6c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/a2fa0400-c9b5-49df-af7c-2ffcb7a502e7" status: 404 len: 111 microversion: 2.1 time: 0.031275 Oct 10 18:58:49.889288 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 977/2197] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:49 2022] GET /compute/v2.1/servers/a2fa0400-c9b5-49df-af7c-2ffcb7a502e7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:49.896330 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7b68927d-184a-4b0b-8c0e-e9508d61c5bf tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f31922ab4c0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:49.971905 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7b68927d-184a-4b0b-8c0e-e9508d61c5bf tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.080907 Oct 10 18:58:49.973127 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 978/2198] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:49 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:50.503496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-007a60fb-88df-4264-90e1-1a8d877423ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:50.517454 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-007a60fb-88df-4264-90e1-1a8d877423ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:50.526260 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-007a60fb-88df-4264-90e1-1a8d877423ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:50.527973 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-007a60fb-88df-4264-90e1-1a8d877423ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.790881 Oct 10 18:58:50.543507 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-611817e4-4c6f-4a42-b5ed-42787c10ae88 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:50.544381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-611817e4-4c6f-4a42-b5ed-42787c10ae88 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:50.554995 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1221/2199] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:49 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:50.567794 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-611817e4-4c6f-4a42-b5ed-42787c10ae88 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:50.568296 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-611817e4-4c6f-4a42-b5ed-42787c10ae88 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:50.568845 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-611817e4-4c6f-4a42-b5ed-42787c10ae88 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:50.570617 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-611817e4-4c6f-4a42-b5ed-42787c10ae88 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:50.571542 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-611817e4-4c6f-4a42-b5ed-42787c10ae88 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:50.571542 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-611817e4-4c6f-4a42-b5ed-42787c10ae88 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:50.644612 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-611817e4-4c6f-4a42-b5ed-42787c10ae88 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:50.654076 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-611817e4-4c6f-4a42-b5ed-42787c10ae88 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1276 microversion: 2.1 time: 0.115381 Oct 10 18:58:50.654905 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 979/2200] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:50 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:50.728626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6af0a73a-09e1-40e5-8f66-51b5287248c5 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:50.729238 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6af0a73a-09e1-40e5-8f66-51b5287248c5 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:50.830690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6af0a73a-09e1-40e5-8f66-51b5287248c5 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:50.838316 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6af0a73a-09e1-40e5-8f66-51b5287248c5 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1213 microversion: 2.1 time: 0.114216 Oct 10 18:58:50.844358 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1222/2201] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:50 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1213 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:50.988445 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-eb21bccb-d2c9-4cc6-85d7-74ec666968c9 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f3192362040>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:51.051643 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-eb21bccb-d2c9-4cc6-85d7-74ec666968c9 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.067040 Oct 10 18:58:51.052462 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 980/2202] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:50 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:51.563178 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-94d1694e-81c1-4c7a-9da1-847f5f63a07d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:51.563880 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-94d1694e-81c1-4c7a-9da1-847f5f63a07d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:51.577353 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-94d1694e-81c1-4c7a-9da1-847f5f63a07d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:51.577769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-94d1694e-81c1-4c7a-9da1-847f5f63a07d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:51.578205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-94d1694e-81c1-4c7a-9da1-847f5f63a07d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:51.578926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-94d1694e-81c1-4c7a-9da1-847f5f63a07d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:51.579375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-94d1694e-81c1-4c7a-9da1-847f5f63a07d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:51.609549 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-94d1694e-81c1-4c7a-9da1-847f5f63a07d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:51.682426 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-edd670ca-0ae5-4cf9-b978-b3d5ec7c2721 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:51.683449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-edd670ca-0ae5-4cf9-b978-b3d5ec7c2721 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:51.703758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edd670ca-0ae5-4cf9-b978-b3d5ec7c2721 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:51.704665 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edd670ca-0ae5-4cf9-b978-b3d5ec7c2721 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:51.707174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edd670ca-0ae5-4cf9-b978-b3d5ec7c2721 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:51.713165 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edd670ca-0ae5-4cf9-b978-b3d5ec7c2721 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:51.715554 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edd670ca-0ae5-4cf9-b978-b3d5ec7c2721 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:51.719418 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edd670ca-0ae5-4cf9-b978-b3d5ec7c2721 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:52.430405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-94d1694e-81c1-4c7a-9da1-847f5f63a07d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:52.449983 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-94d1694e-81c1-4c7a-9da1-847f5f63a07d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:52.458260 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-94d1694e-81c1-4c7a-9da1-847f5f63a07d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:52.459404 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-94d1694e-81c1-4c7a-9da1-847f5f63a07d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.901531 Oct 10 18:58:52.477193 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1223/2203] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:51 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:52.490406 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-beb0a2dd-8906-47d3-92a0-576ae4a0860b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:52.491065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-beb0a2dd-8906-47d3-92a0-576ae4a0860b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:52.503079 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-beb0a2dd-8906-47d3-92a0-576ae4a0860b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:52.503581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-beb0a2dd-8906-47d3-92a0-576ae4a0860b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:52.504027 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-beb0a2dd-8906-47d3-92a0-576ae4a0860b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:52.504778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-beb0a2dd-8906-47d3-92a0-576ae4a0860b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:52.505240 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-beb0a2dd-8906-47d3-92a0-576ae4a0860b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:52.509560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-beb0a2dd-8906-47d3-92a0-576ae4a0860b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:52.680902 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-edd670ca-0ae5-4cf9-b978-b3d5ec7c2721 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:52.690252 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-edd670ca-0ae5-4cf9-b978-b3d5ec7c2721 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1318 microversion: 2.1 time: 1.015584 Oct 10 18:58:52.694914 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 981/2204] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:51 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1318 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:52.701194 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6a7eaccf-2d95-4937-8e39-881a519fc97f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f319237b8b0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:52.721900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-beb0a2dd-8906-47d3-92a0-576ae4a0860b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:52.731069 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-beb0a2dd-8906-47d3-92a0-576ae4a0860b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1265 microversion: 2.1 time: 0.252824 Oct 10 18:58:52.734860 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1224/2205] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:52 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:52.752851 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6a7eaccf-2d95-4937-8e39-881a519fc97f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1426 microversion: 2.1 time: 0.056597 Oct 10 18:58:52.753712 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 982/2206] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:52 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1426 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:53.490195 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f1179ef1-f684-4657-bcfc-7d2e3d53e436 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:53.490892 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f1179ef1-f684-4657-bcfc-7d2e3d53e436 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:53.503285 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f1179ef1-f684-4657-bcfc-7d2e3d53e436 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:53.505039 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f1179ef1-f684-4657-bcfc-7d2e3d53e436 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:53.506833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f1179ef1-f684-4657-bcfc-7d2e3d53e436 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:53.506833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f1179ef1-f684-4657-bcfc-7d2e3d53e436 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:53.507792 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f1179ef1-f684-4657-bcfc-7d2e3d53e436 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:53.508633 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f1179ef1-f684-4657-bcfc-7d2e3d53e436 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:53.653443 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-08d72a47-7d97-4c07-912c-ed8b1cdba09d req-b6a9babc-ed88-4212-b857-85d61ac101a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f", "tag": "5bffc937-d058-4e1d-89e3-1fcc517f98e7"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:53.671951 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-08d72a47-7d97-4c07-912c-ed8b1cdba09d req-b6a9babc-ed88-4212-b857-85d61ac101a6 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:53.677560 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-08d72a47-7d97-4c07-912c-ed8b1cdba09d req-b6a9babc-ed88-4212-b857-85d61ac101a6 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:53.678213 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-08d72a47-7d97-4c07-912c-ed8b1cdba09d req-b6a9babc-ed88-4212-b857-85d61ac101a6 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:53.707039 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:53.710142 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-08d72a47-7d97-4c07-912c-ed8b1cdba09d req-b6a9babc-ed88-4212-b857-85d61ac101a6 service nova] Creating event network-changed:5bffc937-d058-4e1d-89e3-1fcc517f98e7 for instance bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f on n-h1-860863-1 Oct 10 18:58:53.728160 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-08d72a47-7d97-4c07-912c-ed8b1cdba09d req-b6a9babc-ed88-4212-b857-85d61ac101a6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078444 Oct 10 18:58:53.729935 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 983/2207] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:58:53.736661 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4f02b031-c063-45f4-9396-475f68bf78ac tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:53.737716 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4f02b031-c063-45f4-9396-475f68bf78ac tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:53.744227 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f02b031-c063-45f4-9396-475f68bf78ac tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:53.744958 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f02b031-c063-45f4-9396-475f68bf78ac tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:53.745549 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f02b031-c063-45f4-9396-475f68bf78ac tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:53.746434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f02b031-c063-45f4-9396-475f68bf78ac tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:53.747047 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f02b031-c063-45f4-9396-475f68bf78ac tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:53.747627 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4f02b031-c063-45f4-9396-475f68bf78ac tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:54.010717 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4f02b031-c063-45f4-9396-475f68bf78ac tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:54.020058 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4f02b031-c063-45f4-9396-475f68bf78ac tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1318 microversion: 2.1 time: 0.288733 Oct 10 18:58:54.020674 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 984/2208] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:53 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:54.032311 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e78491fc-9300-4b6b-bac6-bed250b6bb47 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:54.035506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e78491fc-9300-4b6b-bac6-bed250b6bb47 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:54.048948 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e78491fc-9300-4b6b-bac6-bed250b6bb47 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:54.049789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e78491fc-9300-4b6b-bac6-bed250b6bb47 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:54.050344 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e78491fc-9300-4b6b-bac6-bed250b6bb47 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:54.052878 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e78491fc-9300-4b6b-bac6-bed250b6bb47 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:54.053721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e78491fc-9300-4b6b-bac6-bed250b6bb47 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:54.054374 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e78491fc-9300-4b6b-bac6-bed250b6bb47 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:54.125626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f1179ef1-f684-4657-bcfc-7d2e3d53e436 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:54.140477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f1179ef1-f684-4657-bcfc-7d2e3d53e436 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:54.149517 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f1179ef1-f684-4657-bcfc-7d2e3d53e436 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:54.155678 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f1179ef1-f684-4657-bcfc-7d2e3d53e436 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.666722 Oct 10 18:58:54.157870 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1225/2209] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:53 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:54.173302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ef58149b-6ae0-490e-81a3-fa6641c688b3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f318df774c0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:54.298120 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ef58149b-6ae0-490e-81a3-fa6641c688b3 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1435 microversion: 2.1 time: 0.137580 Oct 10 18:58:54.298760 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1226/2210] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:54 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1435 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:54.310643 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e78491fc-9300-4b6b-bac6-bed250b6bb47 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:54.314077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ce923fb2-89ce-41bf-b030-5963702dc496 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f318d669820>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:54.318858 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e78491fc-9300-4b6b-bac6-bed250b6bb47 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1271 microversion: 2.1 time: 0.297149 Oct 10 18:58:54.323085 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 985/2211] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:54 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1271 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:54.411877 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ce923fb2-89ce-41bf-b030-5963702dc496 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 200 len: 1435 microversion: 2.1 time: 0.102765 Oct 10 18:58:54.412917 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1227/2212] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:58:54 2022] GET /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 1435 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:54.427454 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f7557dc8-45df-4a90-b406-fcca0b093a2a tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:54.428085 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f7557dc8-45df-4a90-b406-fcca0b093a2a tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:54.442140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f7557dc8-45df-4a90-b406-fcca0b093a2a tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:54.442625 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f7557dc8-45df-4a90-b406-fcca0b093a2a tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:54.443463 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f7557dc8-45df-4a90-b406-fcca0b093a2a tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:54.445468 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f7557dc8-45df-4a90-b406-fcca0b093a2a tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:54.446082 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f7557dc8-45df-4a90-b406-fcca0b093a2a tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:54.447819 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f7557dc8-45df-4a90-b406-fcca0b093a2a tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:54.844230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-4030be4d-affc-47dd-9634-f49d3623f775 req-54224cab-7b38-45ff-b6ed-a358595276a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4098c038-9bbe-4f57-8b58-a6b33603f231", "tag": "f24f31eb-483d-4f5b-a6a5-8c0d1e1cce67"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:54.858699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:54.864503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4030be4d-affc-47dd-9634-f49d3623f775 req-54224cab-7b38-45ff-b6ed-a358595276a7 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:54.865209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4030be4d-affc-47dd-9634-f49d3623f775 req-54224cab-7b38-45ff-b6ed-a358595276a7 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:54.865649 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4030be4d-affc-47dd-9634-f49d3623f775 req-54224cab-7b38-45ff-b6ed-a358595276a7 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:54.888627 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-4030be4d-affc-47dd-9634-f49d3623f775 req-54224cab-7b38-45ff-b6ed-a358595276a7 service nova] Creating event network-changed:f24f31eb-483d-4f5b-a6a5-8c0d1e1cce67 for instance 4098c038-9bbe-4f57-8b58-a6b33603f231 on n-h1-860863-1 Oct 10 18:58:54.894130 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-4030be4d-affc-47dd-9634-f49d3623f775 req-54224cab-7b38-45ff-b6ed-a358595276a7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054106 Oct 10 18:58:54.894745 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1228/2213] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:54.965583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f7557dc8-45df-4a90-b406-fcca0b093a2a tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:54.978098 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f7557dc8-45df-4a90-b406-fcca0b093a2a tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1467 microversion: 2.1 time: 0.551549 Oct 10 18:58:54.980469 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 986/2214] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:54 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1467 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:55.008978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-de73e507-9e42-4d4e-92f5-f4dc2e780f5c tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f318d49f1f0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:55.048502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ac82c025-8ccf-40a1-8217-2f9ba5da58c1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:55.049354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ac82c025-8ccf-40a1-8217-2f9ba5da58c1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:55.058465 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ac82c025-8ccf-40a1-8217-2f9ba5da58c1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:55.058781 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ac82c025-8ccf-40a1-8217-2f9ba5da58c1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:55.059292 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ac82c025-8ccf-40a1-8217-2f9ba5da58c1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:55.060010 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ac82c025-8ccf-40a1-8217-2f9ba5da58c1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:55.064999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ac82c025-8ccf-40a1-8217-2f9ba5da58c1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:55.065522 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ac82c025-8ccf-40a1-8217-2f9ba5da58c1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:55.753611 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ac82c025-8ccf-40a1-8217-2f9ba5da58c1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:55.764456 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ac82c025-8ccf-40a1-8217-2f9ba5da58c1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1318 microversion: 2.1 time: 0.720966 Oct 10 18:58:55.765853 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 987/2215] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:55 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:58:55.771443 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0822e178-7368-4931-99ee-0303cf24dab6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:55.773049 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0822e178-7368-4931-99ee-0303cf24dab6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:55.783564 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0822e178-7368-4931-99ee-0303cf24dab6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:55.784406 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0822e178-7368-4931-99ee-0303cf24dab6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:55.785143 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0822e178-7368-4931-99ee-0303cf24dab6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:55.786468 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0822e178-7368-4931-99ee-0303cf24dab6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:55.787129 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0822e178-7368-4931-99ee-0303cf24dab6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:55.787836 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0822e178-7368-4931-99ee-0303cf24dab6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:56.470580 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0822e178-7368-4931-99ee-0303cf24dab6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:56.482192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0822e178-7368-4931-99ee-0303cf24dab6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:56.484246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0822e178-7368-4931-99ee-0303cf24dab6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:56.485966 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0822e178-7368-4931-99ee-0303cf24dab6 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.718863 Oct 10 18:58:56.487084 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 988/2216] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:55 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:56.497496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-53e6da24-9cf2-4a18-9b8a-382abd8b00cd tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:56.498396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-53e6da24-9cf2-4a18-9b8a-382abd8b00cd tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:56.506427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53e6da24-9cf2-4a18-9b8a-382abd8b00cd tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:56.507425 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53e6da24-9cf2-4a18-9b8a-382abd8b00cd tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:56.508164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53e6da24-9cf2-4a18-9b8a-382abd8b00cd tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:56.509749 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53e6da24-9cf2-4a18-9b8a-382abd8b00cd tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:56.510482 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53e6da24-9cf2-4a18-9b8a-382abd8b00cd tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:56.511262 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-53e6da24-9cf2-4a18-9b8a-382abd8b00cd tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:56.919399 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=10 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:56.940840 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-53e6da24-9cf2-4a18-9b8a-382abd8b00cd tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:56.957289 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-53e6da24-9cf2-4a18-9b8a-382abd8b00cd tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1313 microversion: 2.1 time: 0.465628 Oct 10 18:58:56.957289 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 989/2217] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:56 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:56.960093 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-56a3ee33-ce51-4743-aa2f-fa8e6879162a req-202506e0-7130-4c49-895d-03f4b48fab7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce27ab7-7a56-4c87-95b1-5cf9afa20f24", "name": "network-vif-unplugged", "status": "completed", "tag": "b1a81c55-5504-4e91-812f-a4ea821e79f4"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:57.017180 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-56a3ee33-ce51-4743-aa2f-fa8e6879162a req-202506e0-7130-4c49-895d-03f4b48fab7c service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.017684 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-56a3ee33-ce51-4743-aa2f-fa8e6879162a req-202506e0-7130-4c49-895d-03f4b48fab7c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.021539 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-56a3ee33-ce51-4743-aa2f-fa8e6879162a req-202506e0-7130-4c49-895d-03f4b48fab7c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.042798 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-56a3ee33-ce51-4743-aa2f-fa8e6879162a req-202506e0-7130-4c49-895d-03f4b48fab7c service nova] Creating event network-vif-unplugged:b1a81c55-5504-4e91-812f-a4ea821e79f4 for instance fce27ab7-7a56-4c87-95b1-5cf9afa20f24 on n-h2-860863-1 Oct 10 18:58:57.059233 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-56a3ee33-ce51-4743-aa2f-fa8e6879162a req-202506e0-7130-4c49-895d-03f4b48fab7c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102978 Oct 10 18:58:57.059855 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 990/2218] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:57.065260 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a8dda367-6d06-413f-8bc0-cee8b83f961d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:57.066053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a8dda367-6d06-413f-8bc0-cee8b83f961d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:57.073242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a8dda367-6d06-413f-8bc0-cee8b83f961d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.073978 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a8dda367-6d06-413f-8bc0-cee8b83f961d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.074570 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a8dda367-6d06-413f-8bc0-cee8b83f961d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.075453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a8dda367-6d06-413f-8bc0-cee8b83f961d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.076062 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a8dda367-6d06-413f-8bc0-cee8b83f961d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.076688 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a8dda367-6d06-413f-8bc0-cee8b83f961d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.096568 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-a8dda367-6d06-413f-8bc0-cee8b83f961d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a8dda367-6d06-413f-8bc0-cee8b83f961d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac HTTP/1.1 Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '4812966e-0f45-4261-bf1d-99e46ebab1ac'} Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:57.104351 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:57.108986 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:58:57.108986 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.108986 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:57.108986 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.108986 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.108986 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:57.108986 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:57.108986 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:57.108986 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:57.108986 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:58:57.108986 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.113972 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a8dda367-6d06-413f-8bc0-cee8b83f961d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:57.115124 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a8dda367-6d06-413f-8bc0-cee8b83f961d tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 404 len: 111 microversion: 2.1 time: 0.053817 Oct 10 18:58:57.116158 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 991/2219] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:58:57 2022] DELETE /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:57.120358 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8c6937e5-6859-45ac-bffe-ea795f0f3c13 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:57.123578 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8c6937e5-6859-45ac-bffe-ea795f0f3c13 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:57.145224 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c6937e5-6859-45ac-bffe-ea795f0f3c13 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.145720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c6937e5-6859-45ac-bffe-ea795f0f3c13 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.146171 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c6937e5-6859-45ac-bffe-ea795f0f3c13 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.146889 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c6937e5-6859-45ac-bffe-ea795f0f3c13 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.147914 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c6937e5-6859-45ac-bffe-ea795f0f3c13 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.148376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8c6937e5-6859-45ac-bffe-ea795f0f3c13 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.372944 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-de73e507-9e42-4d4e-92f5-f4dc2e780f5c tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "DELETE /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4" status: 204 len: 0 microversion: 2.1 time: 2.368957 Oct 10 18:58:57.373860 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1229/2220] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:55 2022] DELETE /compute/v2.1/images/6a120f8b-b69d-4e8c-9e95-a87d680ed1e4 => generated 0 bytes in 2371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:58:57.378610 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c774e583-d601-40f0-b64a-6dbeba2a2b36 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:57.379330 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c774e583-d601-40f0-b64a-6dbeba2a2b36 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: 4812966e-0f45-4261-bf1d-99e46ebab1ac] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:57.405489 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c774e583-d601-40f0-b64a-6dbeba2a2b36 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.418140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c774e583-d601-40f0-b64a-6dbeba2a2b36 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.418140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c774e583-d601-40f0-b64a-6dbeba2a2b36 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.418809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c774e583-d601-40f0-b64a-6dbeba2a2b36 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.421336 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c774e583-d601-40f0-b64a-6dbeba2a2b36 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.424710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c774e583-d601-40f0-b64a-6dbeba2a2b36 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.471668 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-c774e583-d601-40f0-b64a-6dbeba2a2b36 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c774e583-d601-40f0-b64a-6dbeba2a2b36 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac HTTP/1.1 Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '4812966e-0f45-4261-bf1d-99e46ebab1ac'} Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:57.473853 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.478544 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.478544 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:57.478544 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:57.478544 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:57.478544 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:57.478544 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. Oct 10 18:58:57.478544 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.480592 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c774e583-d601-40f0-b64a-6dbeba2a2b36 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance 4812966e-0f45-4261-bf1d-99e46ebab1ac could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:57.481655 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c774e583-d601-40f0-b64a-6dbeba2a2b36 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac" status: 404 len: 111 microversion: 2.1 time: 0.106861 Oct 10 18:58:57.487682 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1230/2221] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:57 2022] GET /compute/v2.1/servers/4812966e-0f45-4261-bf1d-99e46ebab1ac => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:57.495111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bf3cd3ba-c603-47e2-9123-136080ccf967 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '.version_select at 0x7f318d669a60>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:57.524659 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-bf3cd3ba-c603-47e2-9123-136080ccf967 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] HTTP exception thrown: Image not found. Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bf3cd3ba-c603-47e2-9123-136080ccf967 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Request method failure captured: Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e HTTP/1.1 Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGsSZQioYSvjPK1VpA0NBeJQl85F8GbMbN1hjzUTkdAA9j-2MHujTKMXqYC-OIyFpTwQ4Qaido255aMzv2tSKv9GZ-O7w9xIPLIb1-78dS3Cw_Hbee046cvq3dXsnahsU1X9OVuPH2cq6laAfGnOhVdzRolLqju3-a3NiC6Z2qudGAA Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b3e646a2c4854a3ca9fad749182efd62 Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesOneServerTestJSON-372030980 Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b3e646a2c4854a3ca9fad749182efd62", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b3e646a2c4854a3ca9fad749182efd62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b3e646a2c4854a3ca9fad749182efd62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b3e646a2c4854a3ca9fad749182efd62"}]}] Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesOneServerTestJSON-372030980 Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b3e646a2c4854a3ca9fad749182efd62 Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-372030980 Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesOneServerTestJSON-372030980-project Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 0795d65cfa274841a7d2c4c2fb90f13a Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesOneServerTestJSON-372030980-project Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: exception: Image not found. Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e'} Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e to delete Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e could not be found. Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.526936 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 10 18:58:57.531622 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.535574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bf3cd3ba-c603-47e2-9123-136080ccf967 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Returning 404 to user: Image not found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:57.542094 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bf3cd3ba-c603-47e2-9123-136080ccf967 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "DELETE /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e" status: 404 len: 62 microversion: 2.1 time: 0.048765 Oct 10 18:58:57.542094 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1231/2222] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:57 2022] DELETE /compute/v2.1/images/ea7cfe3e-e97a-41e1-8b13-65d1cc3f698e => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:58:57.551639 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bd434f77-2838-4e43-b0a2-aaf78c10e66c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:57.556769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bd434f77-2838-4e43-b0a2-aaf78c10e66c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:57.566032 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bd434f77-2838-4e43-b0a2-aaf78c10e66c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.567384 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bd434f77-2838-4e43-b0a2-aaf78c10e66c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.567771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bd434f77-2838-4e43-b0a2-aaf78c10e66c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.570516 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bd434f77-2838-4e43-b0a2-aaf78c10e66c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.571217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bd434f77-2838-4e43-b0a2-aaf78c10e66c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.572183 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bd434f77-2838-4e43-b0a2-aaf78c10e66c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.590401 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-bd434f77-2838-4e43-b0a2-aaf78c10e66c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bd434f77-2838-4e43-b0a2-aaf78c10e66c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 HTTP/1.1 Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'c06dba6c-63b1-4f22-a1b1-d8be963d59d8'} Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:57.592496 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:57.597066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:58:57.597066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.597066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:57.597066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.597066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.597066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:57.597066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:57.597066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:57.597066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:57.597066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:58:57.597066 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.598007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bd434f77-2838-4e43-b0a2-aaf78c10e66c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:57.599056 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bd434f77-2838-4e43-b0a2-aaf78c10e66c tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 404 len: 111 microversion: 2.1 time: 0.054671 Oct 10 18:58:57.604353 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1232/2223] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:58:57 2022] DELETE /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:57.611157 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-07e64550-9308-45f2-a51d-7d89c135040f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:57.613460 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-07e64550-9308-45f2-a51d-7d89c135040f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:57.622442 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-07e64550-9308-45f2-a51d-7d89c135040f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.623174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-07e64550-9308-45f2-a51d-7d89c135040f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.623787 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-07e64550-9308-45f2-a51d-7d89c135040f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.624862 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-07e64550-9308-45f2-a51d-7d89c135040f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.625465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-07e64550-9308-45f2-a51d-7d89c135040f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.626154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-07e64550-9308-45f2-a51d-7d89c135040f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.870831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-07e64550-9308-45f2-a51d-7d89c135040f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:57.879535 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-07e64550-9308-45f2-a51d-7d89c135040f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:57.880975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-07e64550-9308-45f2-a51d-7d89c135040f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:57.882247 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-07e64550-9308-45f2-a51d-7d89c135040f tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.276502 Oct 10 18:58:57.882804 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1233/2224] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:57 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:58:57.899566 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c6d69c2d-8ab3-4a24-913a-7f9e0d110f55 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:57.900814 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c6d69c2d-8ab3-4a24-913a-7f9e0d110f55 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:57.904634 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8c6937e5-6859-45ac-bffe-ea795f0f3c13 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:57.907365 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6d69c2d-8ab3-4a24-913a-7f9e0d110f55 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.907960 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6d69c2d-8ab3-4a24-913a-7f9e0d110f55 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.908491 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6d69c2d-8ab3-4a24-913a-7f9e0d110f55 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.909499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6d69c2d-8ab3-4a24-913a-7f9e0d110f55 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.910319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6d69c2d-8ab3-4a24-913a-7f9e0d110f55 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.910894 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6d69c2d-8ab3-4a24-913a-7f9e0d110f55 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.916757 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8c6937e5-6859-45ac-bffe-ea795f0f3c13 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1318 microversion: 2.1 time: 0.799897 Oct 10 18:58:57.917621 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 992/2225] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:57 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1318 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:57.935224 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-892f7adc-4107-40c8-b827-4df6e8174562 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:57.936227 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-892f7adc-4107-40c8-b827-4df6e8174562 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] [instance: c06dba6c-63b1-4f22-a1b1-d8be963d59d8] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:57.942402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c6d69c2d-8ab3-4a24-913a-7f9e0d110f55 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:58:57.944045 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-892f7adc-4107-40c8-b827-4df6e8174562 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.944434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-892f7adc-4107-40c8-b827-4df6e8174562 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.944905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-892f7adc-4107-40c8-b827-4df6e8174562 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.945616 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-892f7adc-4107-40c8-b827-4df6e8174562 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.946388 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-892f7adc-4107-40c8-b827-4df6e8174562 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.946825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-892f7adc-4107-40c8-b827-4df6e8174562 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.980696 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-892f7adc-4107-40c8-b827-4df6e8174562 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] HTTP exception thrown: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-892f7adc-4107-40c8-b827-4df6e8174562 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Request method failure captured: Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 HTTP/1.1 Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGoRM-y8RSlEN_08dwyp9g1CR7-rSvMGGKVWSvZPjEn1HsFCXNBRdRvWQ1FIksSmgAymdVC07HABOviUxDQD8r0oqvUJcgL7EcCf-Y0H2bbo2Agakf6Y251TIpDt-qMGUWC2hOHMvUP2A9cM4Nmax5qKwT_QTsE3iMMpcYE3zcCdj54 Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c5d5fb01be0c409d98c222551a2c0e2e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c5d5fb01be0c409d98c222551a2c0e2e"}]}] Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: c5d5fb01be0c409d98c222551a2c0e2e Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-DeleteServersTestJSON-606353386 Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: afedfd9cc5b241ad97e27f6e911244a1 Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-DeleteServersTestJSON-606353386-project Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'c06dba6c-63b1-4f22-a1b1-d8be963d59d8'} Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:58:57.982335 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.986427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:58:57.986427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:58:57.986427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:58:57.986427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:58:57.986427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:58:57.986427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. Oct 10 18:58:57.986427 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:58:57.986427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-892f7adc-4107-40c8-b827-4df6e8174562 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] Returning 404 to user: Instance c06dba6c-63b1-4f22-a1b1-d8be963d59d8 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:58:57.986427 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-892f7adc-4107-40c8-b827-4df6e8174562 tempest-DeleteServersTestJSON-606353386 tempest-DeleteServersTestJSON-606353386-project] 10.222.0.43 "GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8" status: 404 len: 111 microversion: 2.1 time: 0.053838 Oct 10 18:58:57.986427 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 993/2226] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:57 2022] GET /compute/v2.1/servers/c06dba6c-63b1-4f22-a1b1-d8be963d59d8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:58:57.990406 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a6990b7b-7f13-4925-bddb-01eaa7b84947 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:57.995725 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a6990b7b-7f13-4925-bddb-01eaa7b84947 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:57.997857 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6990b7b-7f13-4925-bddb-01eaa7b84947 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:57.998359 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6990b7b-7f13-4925-bddb-01eaa7b84947 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:57.999112 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6990b7b-7f13-4925-bddb-01eaa7b84947 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:57.999967 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6990b7b-7f13-4925-bddb-01eaa7b84947 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:58.000432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6990b7b-7f13-4925-bddb-01eaa7b84947 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:58.000889 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a6990b7b-7f13-4925-bddb-01eaa7b84947 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:58.387505 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a6990b7b-7f13-4925-bddb-01eaa7b84947 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:58.395911 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a6990b7b-7f13-4925-bddb-01eaa7b84947 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1313 microversion: 2.1 time: 0.410110 Oct 10 18:58:58.398719 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 994/2227] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:57 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:58.458191 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c6d69c2d-8ab3-4a24-913a-7f9e0d110f55 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "DELETE /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 204 len: 0 microversion: 2.1 time: 0.563747 Oct 10 18:58:58.459094 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1234/2228] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:58:57 2022] DELETE /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 18:58:58.468184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-040baa63-ce28-4b58-9f43-970148118398 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:58.469175 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-040baa63-ce28-4b58-9f43-970148118398 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:58.476772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-040baa63-ce28-4b58-9f43-970148118398 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:58.488505 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-040baa63-ce28-4b58-9f43-970148118398 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:58.490385 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-040baa63-ce28-4b58-9f43-970148118398 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:58.491277 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-040baa63-ce28-4b58-9f43-970148118398 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:58.492967 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-040baa63-ce28-4b58-9f43-970148118398 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:58.493638 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-040baa63-ce28-4b58-9f43-970148118398 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:58.918078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-296640c9-6a69-4a92-b413-62ef48d43792 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:58.919822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-296640c9-6a69-4a92-b413-62ef48d43792 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:58.934261 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:58:58.939989 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-296640c9-6a69-4a92-b413-62ef48d43792 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:58.947156 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-296640c9-6a69-4a92-b413-62ef48d43792 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:58.947156 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-296640c9-6a69-4a92-b413-62ef48d43792 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:58.947156 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-296640c9-6a69-4a92-b413-62ef48d43792 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:58.947596 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-040baa63-ce28-4b58-9f43-970148118398 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:58.948027 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-296640c9-6a69-4a92-b413-62ef48d43792 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:58.948027 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-296640c9-6a69-4a92-b413-62ef48d43792 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:58.956419 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-040baa63-ce28-4b58-9f43-970148118398 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1473 microversion: 2.1 time: 0.492516 Oct 10 18:58:58.959252 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 995/2229] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:58 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1473 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:58.967423 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-312a6c7e-79fb-4be9-b227-73c395428273 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:58.968225 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-312a6c7e-79fb-4be9-b227-73c395428273 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:58.985365 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-312a6c7e-79fb-4be9-b227-73c395428273 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:58.990318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-312a6c7e-79fb-4be9-b227-73c395428273 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:58.996413 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-312a6c7e-79fb-4be9-b227-73c395428273 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:58.996413 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-312a6c7e-79fb-4be9-b227-73c395428273 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:58.996413 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-312a6c7e-79fb-4be9-b227-73c395428273 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:58.996413 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-312a6c7e-79fb-4be9-b227-73c395428273 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:59.236203 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-296640c9-6a69-4a92-b413-62ef48d43792 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:59.245623 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-296640c9-6a69-4a92-b413-62ef48d43792 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:59.247331 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-296640c9-6a69-4a92-b413-62ef48d43792 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:59.248802 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-296640c9-6a69-4a92-b413-62ef48d43792 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.341036 Oct 10 18:58:59.249598 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1235/2230] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:58:58 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:58:59.256477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-1cc8ec29-39b0-4e2b-b04e-f1dc7ba19f2d req-e9ed3b09-f686-4da0-abe8-99267366c10e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce27ab7-7a56-4c87-95b1-5cf9afa20f24", "tag": "b1a81c55-5504-4e91-812f-a4ea821e79f4"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:59.268150 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1cc8ec29-39b0-4e2b-b04e-f1dc7ba19f2d req-e9ed3b09-f686-4da0-abe8-99267366c10e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:59.269008 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1cc8ec29-39b0-4e2b-b04e-f1dc7ba19f2d req-e9ed3b09-f686-4da0-abe8-99267366c10e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:59.269690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1cc8ec29-39b0-4e2b-b04e-f1dc7ba19f2d req-e9ed3b09-f686-4da0-abe8-99267366c10e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:59.282872 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-1cc8ec29-39b0-4e2b-b04e-f1dc7ba19f2d req-e9ed3b09-f686-4da0-abe8-99267366c10e service nova] Creating event network-changed:b1a81c55-5504-4e91-812f-a4ea821e79f4 for instance fce27ab7-7a56-4c87-95b1-5cf9afa20f24 on n-h2-860863-1 Oct 10 18:58:59.290208 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-1cc8ec29-39b0-4e2b-b04e-f1dc7ba19f2d req-e9ed3b09-f686-4da0-abe8-99267366c10e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038982 Oct 10 18:58:59.291793 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1236/2231] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:59.299448 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-1d25979f-a8d7-4448-97fe-4a09f698b679 req-dc649b8b-4295-4a19-8537-ca4780b22b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23440a72-5db4-4da8-8af0-176166843949", "name": "network-vif-unplugged", "status": "completed", "tag": "e6382291-a00e-49b0-905a-3ea8adf9eb83"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:58:59.313986 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1d25979f-a8d7-4448-97fe-4a09f698b679 req-dc649b8b-4295-4a19-8537-ca4780b22b58 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:59.314697 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1d25979f-a8d7-4448-97fe-4a09f698b679 req-dc649b8b-4295-4a19-8537-ca4780b22b58 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:59.315353 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1d25979f-a8d7-4448-97fe-4a09f698b679 req-dc649b8b-4295-4a19-8537-ca4780b22b58 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:59.329164 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-1d25979f-a8d7-4448-97fe-4a09f698b679 req-dc649b8b-4295-4a19-8537-ca4780b22b58 service nova] Creating event network-vif-unplugged:e6382291-a00e-49b0-905a-3ea8adf9eb83 for instance 23440a72-5db4-4da8-8af0-176166843949 on n-h1-860863-1 Oct 10 18:58:59.334187 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-1d25979f-a8d7-4448-97fe-4a09f698b679 req-dc649b8b-4295-4a19-8537-ca4780b22b58 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040825 Oct 10 18:58:59.335263 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1237/2232] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:58:59.426401 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b57b793d-1ddc-40a1-8566-06bf56276668 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:59.428042 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b57b793d-1ddc-40a1-8566-06bf56276668 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:58:59.440998 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b57b793d-1ddc-40a1-8566-06bf56276668 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:59.441806 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b57b793d-1ddc-40a1-8566-06bf56276668 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:59.443008 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b57b793d-1ddc-40a1-8566-06bf56276668 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:59.444035 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b57b793d-1ddc-40a1-8566-06bf56276668 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:58:59.444877 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b57b793d-1ddc-40a1-8566-06bf56276668 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:58:59.446926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b57b793d-1ddc-40a1-8566-06bf56276668 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:58:59.525654 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-312a6c7e-79fb-4be9-b227-73c395428273 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:59.535689 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-312a6c7e-79fb-4be9-b227-73c395428273 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1318 microversion: 2.1 time: 0.574925 Oct 10 18:58:59.537261 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 996/2233] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:58 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:59.694951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b57b793d-1ddc-40a1-8566-06bf56276668 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:58:59.703357 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b57b793d-1ddc-40a1-8566-06bf56276668 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1313 microversion: 2.1 time: 0.281573 Oct 10 18:58:59.704256 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1238/2234] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:59 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:58:59.990280 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-473b5aa2-2047-49a5-9130-8330413e5f63 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:58:59.991302 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-473b5aa2-2047-49a5-9130-8330413e5f63 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:00.009874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-473b5aa2-2047-49a5-9130-8330413e5f63 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:00.013241 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-473b5aa2-2047-49a5-9130-8330413e5f63 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:00.013241 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-473b5aa2-2047-49a5-9130-8330413e5f63 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:00.013241 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-473b5aa2-2047-49a5-9130-8330413e5f63 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:00.013507 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-473b5aa2-2047-49a5-9130-8330413e5f63 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:00.013872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-473b5aa2-2047-49a5-9130-8330413e5f63 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:00.278902 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-79a63903-23d5-46e1-92a7-6166c934a42d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:00.280091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-79a63903-23d5-46e1-92a7-6166c934a42d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:00.288142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79a63903-23d5-46e1-92a7-6166c934a42d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:00.288945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79a63903-23d5-46e1-92a7-6166c934a42d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:00.289572 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79a63903-23d5-46e1-92a7-6166c934a42d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:00.290473 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79a63903-23d5-46e1-92a7-6166c934a42d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:00.291099 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79a63903-23d5-46e1-92a7-6166c934a42d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:00.292413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79a63903-23d5-46e1-92a7-6166c934a42d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:00.689429 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-473b5aa2-2047-49a5-9130-8330413e5f63 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:00.709094 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-473b5aa2-2047-49a5-9130-8330413e5f63 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1473 microversion: 2.1 time: 0.726548 Oct 10 18:59:00.710375 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 997/2235] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:58:59 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1473 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:00.715808 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3dfad937-9ed7-432b-ba37-6d9ef8ff75b9 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:00.717213 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3dfad937-9ed7-432b-ba37-6d9ef8ff75b9 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:00.725781 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3dfad937-9ed7-432b-ba37-6d9ef8ff75b9 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:00.727422 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3dfad937-9ed7-432b-ba37-6d9ef8ff75b9 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:00.728146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3dfad937-9ed7-432b-ba37-6d9ef8ff75b9 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:00.729156 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3dfad937-9ed7-432b-ba37-6d9ef8ff75b9 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:00.729665 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3dfad937-9ed7-432b-ba37-6d9ef8ff75b9 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:00.732520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3dfad937-9ed7-432b-ba37-6d9ef8ff75b9 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:00.837776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=16 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:00.880875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-79a63903-23d5-46e1-92a7-6166c934a42d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:00.893848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-79a63903-23d5-46e1-92a7-6166c934a42d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:00.895871 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-79a63903-23d5-46e1-92a7-6166c934a42d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:00.898537 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-79a63903-23d5-46e1-92a7-6166c934a42d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.624493 Oct 10 18:59:00.899576 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1239/2236] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:00 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:00.916561 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9d583382-5f7f-45aa-94b8-768701373beb tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:00.917972 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9d583382-5f7f-45aa-94b8-768701373beb tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:00.926396 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d583382-5f7f-45aa-94b8-768701373beb tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:00.927416 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d583382-5f7f-45aa-94b8-768701373beb tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:00.929929 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d583382-5f7f-45aa-94b8-768701373beb tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:00.930976 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d583382-5f7f-45aa-94b8-768701373beb tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:00.931938 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d583382-5f7f-45aa-94b8-768701373beb tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:00.932969 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d583382-5f7f-45aa-94b8-768701373beb tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:01.003073 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3dfad937-9ed7-432b-ba37-6d9ef8ff75b9 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:01.018565 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3dfad937-9ed7-432b-ba37-6d9ef8ff75b9 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1318 microversion: 2.1 time: 0.306904 Oct 10 18:59:01.019653 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 998/2237] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:00 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:01.327618 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9d583382-5f7f-45aa-94b8-768701373beb tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:01.342537 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9d583382-5f7f-45aa-94b8-768701373beb tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1313 microversion: 2.1 time: 0.441512 Oct 10 18:59:01.353103 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1240/2238] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:00 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:01.401844 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-1ab3c67a-a48b-43ea-8fba-47a3afbc3728 req-21fad6a8-5b2a-4d65-8abd-8833b403a2ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e0cf03a-8264-4848-a454-36ca690765b1", "tag": "d09a97aa-e8a8-470e-9283-8477f779ba27"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:01.421606 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1ab3c67a-a48b-43ea-8fba-47a3afbc3728 req-21fad6a8-5b2a-4d65-8abd-8833b403a2ab service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:01.422362 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1ab3c67a-a48b-43ea-8fba-47a3afbc3728 req-21fad6a8-5b2a-4d65-8abd-8833b403a2ab service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:01.422953 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1ab3c67a-a48b-43ea-8fba-47a3afbc3728 req-21fad6a8-5b2a-4d65-8abd-8833b403a2ab service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:01.440608 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-1ab3c67a-a48b-43ea-8fba-47a3afbc3728 req-21fad6a8-5b2a-4d65-8abd-8833b403a2ab service nova] Creating event network-changed:d09a97aa-e8a8-470e-9283-8477f779ba27 for instance 2e0cf03a-8264-4848-a454-36ca690765b1 on n-h2-860863-1 Oct 10 18:59:01.445172 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-1ab3c67a-a48b-43ea-8fba-47a3afbc3728 req-21fad6a8-5b2a-4d65-8abd-8833b403a2ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048617 Oct 10 18:59:01.446276 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 999/2239] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:01.663860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-4d958a43-f222-43ff-aee8-cf9ae4d49f46 req-0e168688-01d7-4575-8218-a4fdd9aa4d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f", "name": "network-vif-plugged", "status": "completed", "tag": "5bffc937-d058-4e1d-89e3-1fcc517f98e7"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:01.688684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4d958a43-f222-43ff-aee8-cf9ae4d49f46 req-0e168688-01d7-4575-8218-a4fdd9aa4d13 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:01.689324 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4d958a43-f222-43ff-aee8-cf9ae4d49f46 req-0e168688-01d7-4575-8218-a4fdd9aa4d13 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:01.689864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-4d958a43-f222-43ff-aee8-cf9ae4d49f46 req-0e168688-01d7-4575-8218-a4fdd9aa4d13 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:01.703832 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-4d958a43-f222-43ff-aee8-cf9ae4d49f46 req-0e168688-01d7-4575-8218-a4fdd9aa4d13 service nova] Creating event network-vif-plugged:5bffc937-d058-4e1d-89e3-1fcc517f98e7 for instance bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f on n-h1-860863-1 Oct 10 18:59:01.711015 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-4d958a43-f222-43ff-aee8-cf9ae4d49f46 req-0e168688-01d7-4575-8218-a4fdd9aa4d13 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050143 Oct 10 18:59:01.712259 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1241/2240] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:01.744223 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0fdc727f-710b-4f60-8ec2-ac462bb9c289 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:01.744982 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0fdc727f-710b-4f60-8ec2-ac462bb9c289 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:01.767405 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fdc727f-710b-4f60-8ec2-ac462bb9c289 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:01.770738 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fdc727f-710b-4f60-8ec2-ac462bb9c289 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:01.774706 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fdc727f-710b-4f60-8ec2-ac462bb9c289 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:01.775474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fdc727f-710b-4f60-8ec2-ac462bb9c289 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:01.782431 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fdc727f-710b-4f60-8ec2-ac462bb9c289 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:01.783626 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fdc727f-710b-4f60-8ec2-ac462bb9c289 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:01.936846 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2dbf7ffa-cedf-40a2-a6ed-a15658776526 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:01.938173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2dbf7ffa-cedf-40a2-a6ed-a15658776526 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:01.959142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2dbf7ffa-cedf-40a2-a6ed-a15658776526 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:01.959661 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2dbf7ffa-cedf-40a2-a6ed-a15658776526 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:01.960095 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2dbf7ffa-cedf-40a2-a6ed-a15658776526 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:01.960833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2dbf7ffa-cedf-40a2-a6ed-a15658776526 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:01.963190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2dbf7ffa-cedf-40a2-a6ed-a15658776526 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:01.963794 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2dbf7ffa-cedf-40a2-a6ed-a15658776526 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:01.983767 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0fdc727f-710b-4f60-8ec2-ac462bb9c289 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:01.999994 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0fdc727f-710b-4f60-8ec2-ac462bb9c289 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1431 microversion: 2.1 time: 0.267708 Oct 10 18:59:02.000911 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1000/2241] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:01 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1431 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:02.044462 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ce615552-b94f-41e0-af94-10b3d7b62196 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:02.045127 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ce615552-b94f-41e0-af94-10b3d7b62196 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:02.062169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce615552-b94f-41e0-af94-10b3d7b62196 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:02.062169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce615552-b94f-41e0-af94-10b3d7b62196 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:02.062169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce615552-b94f-41e0-af94-10b3d7b62196 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:02.062169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce615552-b94f-41e0-af94-10b3d7b62196 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:02.062169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce615552-b94f-41e0-af94-10b3d7b62196 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:02.062169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ce615552-b94f-41e0-af94-10b3d7b62196 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:02.408796 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ce615552-b94f-41e0-af94-10b3d7b62196 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:02.422106 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ce615552-b94f-41e0-af94-10b3d7b62196 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1318 microversion: 2.1 time: 0.382046 Oct 10 18:59:02.431145 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2dbf7ffa-cedf-40a2-a6ed-a15658776526 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:02.447166 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2dbf7ffa-cedf-40a2-a6ed-a15658776526 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:02.447642 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1001/2242] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:02 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:59:02.448643 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2dbf7ffa-cedf-40a2-a6ed-a15658776526 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:02.449959 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2dbf7ffa-cedf-40a2-a6ed-a15658776526 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.521649 Oct 10 18:59:02.459868 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-840ec2a6-1aeb-4287-b205-87b99d8d3627 req-2ce21927-c768-4557-a149-b368c3eb6f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23440a72-5db4-4da8-8af0-176166843949", "name": "network-vif-deleted", "tag": "e6382291-a00e-49b0-905a-3ea8adf9eb83"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:02.474084 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1242/2243] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:01 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:59:02.485367 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-840ec2a6-1aeb-4287-b205-87b99d8d3627 req-2ce21927-c768-4557-a149-b368c3eb6f5b service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:02.489652 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-840ec2a6-1aeb-4287-b205-87b99d8d3627 req-2ce21927-c768-4557-a149-b368c3eb6f5b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:02.490350 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f8532023-0242-40ef-a76c-eac3cd40af00 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:02.490509 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-840ec2a6-1aeb-4287-b205-87b99d8d3627 req-2ce21927-c768-4557-a149-b368c3eb6f5b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:02.491985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f8532023-0242-40ef-a76c-eac3cd40af00 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:02.499230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f8532023-0242-40ef-a76c-eac3cd40af00 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:02.506477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f8532023-0242-40ef-a76c-eac3cd40af00 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:02.507665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f8532023-0242-40ef-a76c-eac3cd40af00 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:02.508813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f8532023-0242-40ef-a76c-eac3cd40af00 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:02.511913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f8532023-0242-40ef-a76c-eac3cd40af00 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:02.512629 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f8532023-0242-40ef-a76c-eac3cd40af00 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:02.524133 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-840ec2a6-1aeb-4287-b205-87b99d8d3627 req-2ce21927-c768-4557-a149-b368c3eb6f5b service nova] Creating event network-vif-deleted:e6382291-a00e-49b0-905a-3ea8adf9eb83 for instance 23440a72-5db4-4da8-8af0-176166843949 on n-h1-860863-1 Oct 10 18:59:02.535312 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-840ec2a6-1aeb-4287-b205-87b99d8d3627 req-2ce21927-c768-4557-a149-b368c3eb6f5b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085220 Oct 10 18:59:02.538609 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1002/2244] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:02.854049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f8532023-0242-40ef-a76c-eac3cd40af00 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:02.867366 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f8532023-0242-40ef-a76c-eac3cd40af00 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1313 microversion: 2.1 time: 0.391849 Oct 10 18:59:02.868817 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1243/2245] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:02 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:03.024782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e093e563-4228-4877-9226-dc053097bf5f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:03.025820 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e093e563-4228-4877-9226-dc053097bf5f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:03.038488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e093e563-4228-4877-9226-dc053097bf5f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:03.038999 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e093e563-4228-4877-9226-dc053097bf5f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:03.041465 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e093e563-4228-4877-9226-dc053097bf5f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:03.042602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e093e563-4228-4877-9226-dc053097bf5f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:03.043360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e093e563-4228-4877-9226-dc053097bf5f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:03.044032 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e093e563-4228-4877-9226-dc053097bf5f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:03.144467 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e093e563-4228-4877-9226-dc053097bf5f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:03.145197 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e093e563-4228-4877-9226-dc053097bf5f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:03.145637 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e093e563-4228-4877-9226-dc053097bf5f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:03.158333 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-e093e563-4228-4877-9226-dc053097bf5f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lazy-loading 'fault' on Instance uuid 23440a72-5db4-4da8-8af0-176166843949 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:59:03.158333 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:03.250428 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e093e563-4228-4877-9226-dc053097bf5f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0795d65cfa274841a7d2c4c2fb90f13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e646a2c4854a3ca9fad749182efd62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:03.263241 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e093e563-4228-4877-9226-dc053097bf5f tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 200 len: 1307 microversion: 2.1 time: 0.241044 Oct 10 18:59:03.279095 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1003/2246] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:03 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 1307 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:03.456782 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d64f0c90-bc51-477b-baeb-fbecb8f3a567 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:03.458250 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d64f0c90-bc51-477b-baeb-fbecb8f3a567 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:03.467522 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d64f0c90-bc51-477b-baeb-fbecb8f3a567 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:03.468380 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d64f0c90-bc51-477b-baeb-fbecb8f3a567 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:03.469916 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d64f0c90-bc51-477b-baeb-fbecb8f3a567 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:03.470908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d64f0c90-bc51-477b-baeb-fbecb8f3a567 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:03.471734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d64f0c90-bc51-477b-baeb-fbecb8f3a567 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:03.472385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d64f0c90-bc51-477b-baeb-fbecb8f3a567 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:03.488939 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b4f4c294-526b-41ac-bd9a-bfab7ecce986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:03.494652 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b4f4c294-526b-41ac-bd9a-bfab7ecce986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:03.500268 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4f4c294-526b-41ac-bd9a-bfab7ecce986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:03.501030 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4f4c294-526b-41ac-bd9a-bfab7ecce986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:03.501656 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4f4c294-526b-41ac-bd9a-bfab7ecce986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:03.502552 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4f4c294-526b-41ac-bd9a-bfab7ecce986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:03.503156 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4f4c294-526b-41ac-bd9a-bfab7ecce986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:03.503724 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b4f4c294-526b-41ac-bd9a-bfab7ecce986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:03.986019 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b4f4c294-526b-41ac-bd9a-bfab7ecce986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:04.000146 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b4f4c294-526b-41ac-bd9a-bfab7ecce986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:04.008173 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b4f4c294-526b-41ac-bd9a-bfab7ecce986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:04.010173 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b4f4c294-526b-41ac-bd9a-bfab7ecce986 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.525302 Oct 10 18:59:04.032976 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1004/2247] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:03 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:59:04.043238 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c781292f-9491-4c32-981e-350e654bed02 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:04.049228 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c781292f-9491-4c32-981e-350e654bed02 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:04.052939 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c781292f-9491-4c32-981e-350e654bed02 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:04.054831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c781292f-9491-4c32-981e-350e654bed02 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:04.055479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c781292f-9491-4c32-981e-350e654bed02 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:04.056481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c781292f-9491-4c32-981e-350e654bed02 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:04.057266 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c781292f-9491-4c32-981e-350e654bed02 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:04.057866 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c781292f-9491-4c32-981e-350e654bed02 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:04.749363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d64f0c90-bc51-477b-baeb-fbecb8f3a567 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:04.753379 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:04.763443 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d64f0c90-bc51-477b-baeb-fbecb8f3a567 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1318 microversion: 2.1 time: 1.315925 Oct 10 18:59:04.764134 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1244/2248] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:03 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1318 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:04.775642 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d541560b-f27f-4fb7-a10d-80a9524d7882 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:04.777635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d541560b-f27f-4fb7-a10d-80a9524d7882 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] [instance: 23440a72-5db4-4da8-8af0-176166843949] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:04.799757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d541560b-f27f-4fb7-a10d-80a9524d7882 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:04.809150 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d541560b-f27f-4fb7-a10d-80a9524d7882 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:04.810267 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d541560b-f27f-4fb7-a10d-80a9524d7882 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:04.811519 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d541560b-f27f-4fb7-a10d-80a9524d7882 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:04.812157 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d541560b-f27f-4fb7-a10d-80a9524d7882 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:04.812901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d541560b-f27f-4fb7-a10d-80a9524d7882 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:04.851322 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-d541560b-f27f-4fb7-a10d-80a9524d7882 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] HTTP exception thrown: Instance 23440a72-5db4-4da8-8af0-176166843949 could not be found. Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d541560b-f27f-4fb7-a10d-80a9524d7882 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Request method failure captured: Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 HTTP/1.1 Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGsSZQioYSvjPK1VpA0NBeJQl85F8GbMbN1hjzUTkdAA9j-2MHujTKMXqYC-OIyFpTwQ4Qaido255aMzv2tSKv9GZ-O7w9xIPLIb1-78dS3Cw_Hbee046cvq3dXsnahsU1X9OVuPH2cq6laAfGnOhVdzRolLqju3-a3NiC6Z2qudGAA Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b3e646a2c4854a3ca9fad749182efd62 Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ImagesOneServerTestJSON-372030980 Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b3e646a2c4854a3ca9fad749182efd62", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b3e646a2c4854a3ca9fad749182efd62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b3e646a2c4854a3ca9fad749182efd62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b3e646a2c4854a3ca9fad749182efd62"}]}] Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ImagesOneServerTestJSON-372030980 Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b3e646a2c4854a3ca9fad749182efd62 Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-372030980 Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ImagesOneServerTestJSON-372030980-project Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 0795d65cfa274841a7d2c4c2fb90f13a Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ImagesOneServerTestJSON-372030980-project Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 23440a72-5db4-4da8-8af0-176166843949 could not be found. Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '23440a72-5db4-4da8-8af0-176166843949'} Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23440a72-5db4-4da8-8af0-176166843949 could not be found. Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23440a72-5db4-4da8-8af0-176166843949 could not be found. Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:04.853884 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:04.858131 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:04.858131 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:04.858131 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:04.858131 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:59:04.858131 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:59:04.858131 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23440a72-5db4-4da8-8af0-176166843949 could not be found. Oct 10 18:59:04.858131 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:04.858131 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d541560b-f27f-4fb7-a10d-80a9524d7882 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] Returning 404 to user: Instance 23440a72-5db4-4da8-8af0-176166843949 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:59:04.858131 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d541560b-f27f-4fb7-a10d-80a9524d7882 tempest-ImagesOneServerTestJSON-372030980 tempest-ImagesOneServerTestJSON-372030980-project] 10.222.0.43 "GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949" status: 404 len: 111 microversion: 2.1 time: 0.085631 Oct 10 18:59:04.862530 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1245/2249] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:04 2022] GET /compute/v2.1/servers/23440a72-5db4-4da8-8af0-176166843949 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:59:05.043996 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a005dfd7-e267-4238-9b5f-df5e6c2aba2d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:05.044646 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a005dfd7-e267-4238-9b5f-df5e6c2aba2d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:05.056361 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a005dfd7-e267-4238-9b5f-df5e6c2aba2d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:05.057034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a005dfd7-e267-4238-9b5f-df5e6c2aba2d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:05.057477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a005dfd7-e267-4238-9b5f-df5e6c2aba2d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:05.058197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a005dfd7-e267-4238-9b5f-df5e6c2aba2d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:05.058651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a005dfd7-e267-4238-9b5f-df5e6c2aba2d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:05.059073 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a005dfd7-e267-4238-9b5f-df5e6c2aba2d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:05.340043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c781292f-9491-4c32-981e-350e654bed02 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:05.363488 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c781292f-9491-4c32-981e-350e654bed02 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1313 microversion: 2.1 time: 1.326390 Oct 10 18:59:05.378965 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1005/2250] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:04 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1313 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:05.398185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-d296d952-ddf5-40b6-85cb-a6a7b154c467 req-67524c90-ff32-4720-889f-3074087b8430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4098c038-9bbe-4f57-8b58-a6b33603f231", "name": "network-vif-plugged", "status": "completed", "tag": "f24f31eb-483d-4f5b-a6a5-8c0d1e1cce67"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:05.429581 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d296d952-ddf5-40b6-85cb-a6a7b154c467 req-67524c90-ff32-4720-889f-3074087b8430 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:05.430930 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d296d952-ddf5-40b6-85cb-a6a7b154c467 req-67524c90-ff32-4720-889f-3074087b8430 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:05.431749 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d296d952-ddf5-40b6-85cb-a6a7b154c467 req-67524c90-ff32-4720-889f-3074087b8430 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:05.476818 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-d296d952-ddf5-40b6-85cb-a6a7b154c467 req-67524c90-ff32-4720-889f-3074087b8430 service nova] Creating event network-vif-plugged:f24f31eb-483d-4f5b-a6a5-8c0d1e1cce67 for instance 4098c038-9bbe-4f57-8b58-a6b33603f231 on n-h1-860863-1 Oct 10 18:59:05.506114 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-d296d952-ddf5-40b6-85cb-a6a7b154c467 req-67524c90-ff32-4720-889f-3074087b8430 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115391 Oct 10 18:59:05.511257 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1006/2251] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:05.574490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a005dfd7-e267-4238-9b5f-df5e6c2aba2d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:05.613656 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a005dfd7-e267-4238-9b5f-df5e6c2aba2d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:05.618395 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a005dfd7-e267-4238-9b5f-df5e6c2aba2d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:05.622514 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a005dfd7-e267-4238-9b5f-df5e6c2aba2d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.583583 Oct 10 18:59:05.626745 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1246/2252] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:05 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:05.791087 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1bbb3f32-8341-4491-b9db-0fa502416f7e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:05.792488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1bbb3f32-8341-4491-b9db-0fa502416f7e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:05.806942 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1bbb3f32-8341-4491-b9db-0fa502416f7e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:05.808940 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1bbb3f32-8341-4491-b9db-0fa502416f7e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:05.810118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1bbb3f32-8341-4491-b9db-0fa502416f7e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:05.812134 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1bbb3f32-8341-4491-b9db-0fa502416f7e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:05.814775 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1bbb3f32-8341-4491-b9db-0fa502416f7e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:05.816798 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1bbb3f32-8341-4491-b9db-0fa502416f7e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:06.392837 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-381024a8-3796-4f57-a17a-1f161be8baf2 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:06.394405 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-381024a8-3796-4f57-a17a-1f161be8baf2 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:06.406841 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-381024a8-3796-4f57-a17a-1f161be8baf2 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:06.407342 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-381024a8-3796-4f57-a17a-1f161be8baf2 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:06.408109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-381024a8-3796-4f57-a17a-1f161be8baf2 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:06.410586 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-381024a8-3796-4f57-a17a-1f161be8baf2 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:06.415373 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-381024a8-3796-4f57-a17a-1f161be8baf2 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:06.415373 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-381024a8-3796-4f57-a17a-1f161be8baf2 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:06.482235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1bbb3f32-8341-4491-b9db-0fa502416f7e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:06.511461 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1bbb3f32-8341-4491-b9db-0fa502416f7e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1318 microversion: 2.1 time: 0.724034 Oct 10 18:59:06.512142 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1007/2253] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:05 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1318 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:06.655873 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9809c6a9-61c4-4fb3-a405-196e41edc446 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:06.656464 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9809c6a9-61c4-4fb3-a405-196e41edc446 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:06.668255 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9809c6a9-61c4-4fb3-a405-196e41edc446 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:06.671238 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9809c6a9-61c4-4fb3-a405-196e41edc446 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:06.671853 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9809c6a9-61c4-4fb3-a405-196e41edc446 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:06.674089 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9809c6a9-61c4-4fb3-a405-196e41edc446 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:06.675640 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9809c6a9-61c4-4fb3-a405-196e41edc446 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:06.692128 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9809c6a9-61c4-4fb3-a405-196e41edc446 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:06.829789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-381024a8-3796-4f57-a17a-1f161be8baf2 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:06.856910 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-381024a8-3796-4f57-a17a-1f161be8baf2 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1313 microversion: 2.1 time: 0.454019 Oct 10 18:59:06.870740 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1247/2254] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:06 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:59:07.298915 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9809c6a9-61c4-4fb3-a405-196e41edc446 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:07.313938 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9809c6a9-61c4-4fb3-a405-196e41edc446 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:07.317298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9809c6a9-61c4-4fb3-a405-196e41edc446 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:07.319887 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9809c6a9-61c4-4fb3-a405-196e41edc446 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.668341 Oct 10 18:59:07.324020 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1008/2255] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:06 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:07.438819 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-92dbde3e-8133-4dbf-a86f-5eb238a98686 tempest-FloatingIPsNegativeTestJSON-963834189 tempest-FloatingIPsNegativeTestJSON-963834189-project] Calling method '.version_select at 0x7f318d5eb3a0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:07.542325 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-444a0d8e-1c42-4321-8277-0f739e4c4202 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:07.542955 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-444a0d8e-1c42-4321-8277-0f739e4c4202 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:07.550000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-444a0d8e-1c42-4321-8277-0f739e4c4202 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:07.550645 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-444a0d8e-1c42-4321-8277-0f739e4c4202 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:07.551087 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-444a0d8e-1c42-4321-8277-0f739e4c4202 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:07.552376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-444a0d8e-1c42-4321-8277-0f739e4c4202 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:07.552465 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-444a0d8e-1c42-4321-8277-0f739e4c4202 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:07.552881 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-444a0d8e-1c42-4321-8277-0f739e4c4202 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:07.622719 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-92dbde3e-8133-4dbf-a86f-5eb238a98686 tempest-FloatingIPsNegativeTestJSON-963834189 tempest-FloatingIPsNegativeTestJSON-963834189-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.690394 Oct 10 18:59:07.633457 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1248/2256] 10.222.0.43 () {58 vars in 1149 bytes} [Mon Oct 10 18:59:06 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 10 18:59:07.641997 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b61812fc-0903-49fd-a0a8-53e9927bbb2b tempest-FloatingIPsNegativeTestJSON-963834189 tempest-FloatingIPsNegativeTestJSON-963834189-project] Action: 'create', calling method: .version_select at 0x7f318e2c5160>, body: {"pool": "non_exist_pool"} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:07.731763 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-b61812fc-0903-49fd-a0a8-53e9927bbb2b tempest-FloatingIPsNegativeTestJSON-963834189 tempest-FloatingIPsNegativeTestJSON-963834189-project] HTTP exception thrown: Floating IP pool not found. Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b61812fc-0903-49fd-a0a8-53e9927bbb2b tempest-FloatingIPsNegativeTestJSON-963834189 tempest-FloatingIPsNegativeTestJSON-963834189-project] Request method failure captured: Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 26 Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGt6LRqIW2fNOHNzCCSvAL6zyQuM6_117S-apDQNA1GmRO38qAYGegGZIH25Rd1948pp32EXgQ0f1wtfawt3nBoGIPsadCQboVIQNfgI8ioEAzEYf2s2bGUc6YOBY7ocnjdN6OhmM7Pn33KHw7ThF9RpChu1a33dLs9zOPtInu7cMLE Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 17898eaf6d3145a186ddc132c4fc1238 Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-963834189 Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_17898eaf6d3145a186ddc132c4fc1238", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/17898eaf6d3145a186ddc132c4fc1238"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17898eaf6d3145a186ddc132c4fc1238"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17898eaf6d3145a186ddc132c4fc1238"}]}] Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-963834189 Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 17898eaf6d3145a186ddc132c4fc1238 Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-963834189 Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FloatingIPsNegativeTestJSON-963834189-project Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 093383bc9ae6463da58b84b3da9e9fba Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-963834189-project Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: {"pool": "non_exist_pool"} Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: exception: Floating IP pool not found. Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:59:07.734915 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:59:07.740952 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 10 18:59:07.740952 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:07.742706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b61812fc-0903-49fd-a0a8-53e9927bbb2b tempest-FloatingIPsNegativeTestJSON-963834189 tempest-FloatingIPsNegativeTestJSON-963834189-project] Returning 404 to user: Floating IP pool not found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:59:07.744025 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b61812fc-0903-49fd-a0a8-53e9927bbb2b tempest-FloatingIPsNegativeTestJSON-963834189 tempest-FloatingIPsNegativeTestJSON-963834189-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.108949 Oct 10 18:59:07.750091 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1249/2257] 10.222.0.43 () {60 vars in 1170 bytes} [Mon Oct 10 18:59:07 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 18:59:07.758881 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-2f91ae57-04b7-41bf-ab7f-1dc298fbfff8 req-7a8d46e1-4124-4315-bbce-7955ce2b02a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e0cf03a-8264-4848-a454-36ca690765b1", "name": "network-vif-plugged", "status": "completed", "tag": "d09a97aa-e8a8-470e-9283-8477f779ba27"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:07.777061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-2f91ae57-04b7-41bf-ab7f-1dc298fbfff8 req-7a8d46e1-4124-4315-bbce-7955ce2b02a4 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:07.777793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-2f91ae57-04b7-41bf-ab7f-1dc298fbfff8 req-7a8d46e1-4124-4315-bbce-7955ce2b02a4 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:07.778376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-2f91ae57-04b7-41bf-ab7f-1dc298fbfff8 req-7a8d46e1-4124-4315-bbce-7955ce2b02a4 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:07.798106 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-2f91ae57-04b7-41bf-ab7f-1dc298fbfff8 req-7a8d46e1-4124-4315-bbce-7955ce2b02a4 service nova] Creating event network-vif-plugged:d09a97aa-e8a8-470e-9283-8477f779ba27 for instance 2e0cf03a-8264-4848-a454-36ca690765b1 on n-h2-860863-1 Oct 10 18:59:07.806296 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-2f91ae57-04b7-41bf-ab7f-1dc298fbfff8 req-7a8d46e1-4124-4315-bbce-7955ce2b02a4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054387 Oct 10 18:59:07.807281 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1250/2258] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:07.816254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5a19fb3d-48fb-4f55-9ea0-ccfb922708a2 tempest-FloatingIPsNegativeTestJSON-963834189 tempest-FloatingIPsNegativeTestJSON-963834189-project] Calling method '.version_select at 0x7f318d5eb040>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:07.938032 n-d-860863-1 devstack@n-api.service[127288]: DEBUG neutronclient.v2_0.client [None req-5a19fb3d-48fb-4f55-9ea0-ccfb922708a2 tempest-FloatingIPsNegativeTestJSON-963834189 tempest-FloatingIPsNegativeTestJSON-963834189-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 81b58dfd-1559-4e3b-b3ef-7c9d41043352 could not be found", "detail": ""}} {{(pid=127288) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 10 18:59:07.939008 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-5a19fb3d-48fb-4f55-9ea0-ccfb922708a2 tempest-FloatingIPsNegativeTestJSON-963834189 tempest-FloatingIPsNegativeTestJSON-963834189-project] HTTP exception thrown: Floating IP not found for ID 81b58dfd-1559-4e3b-b3ef-7c9d41043352 Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5a19fb3d-48fb-4f55-9ea0-ccfb922708a2 tempest-FloatingIPsNegativeTestJSON-963834189 tempest-FloatingIPsNegativeTestJSON-963834189-project] Request method failure captured: Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/os-floating-ips/81b58dfd-1559-4e3b-b3ef-7c9d41043352 HTTP/1.1 Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGt6LRqIW2fNOHNzCCSvAL6zyQuM6_117S-apDQNA1GmRO38qAYGegGZIH25Rd1948pp32EXgQ0f1wtfawt3nBoGIPsadCQboVIQNfgI8ioEAzEYf2s2bGUc6YOBY7ocnjdN6OhmM7Pn33KHw7ThF9RpChu1a33dLs9zOPtInu7cMLE Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 17898eaf6d3145a186ddc132c4fc1238 Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-963834189 Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_17898eaf6d3145a186ddc132c4fc1238", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/17898eaf6d3145a186ddc132c4fc1238"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17898eaf6d3145a186ddc132c4fc1238"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/17898eaf6d3145a186ddc132c4fc1238"}]}] Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-963834189 Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 17898eaf6d3145a186ddc132c4fc1238 Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-963834189 Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-FloatingIPsNegativeTestJSON-963834189-project Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 093383bc9ae6463da58b84b3da9e9fba Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-963834189-project Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: method: Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: exception: Floating IP not found for ID 81b58dfd-1559-4e3b-b3ef-7c9d41043352 Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '81b58dfd-1559-4e3b-b3ef-7c9d41043352'} Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 81b58dfd-1559-4e3b-b3ef-7c9d41043352 could not be found Oct 10 18:59:07.942014 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df0dea68-fd46-482c-a578-c7d006d30bfc'] Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 81b58dfd-1559-4e3b-b3ef-7c9d41043352. Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 81b58dfd-1559-4e3b-b3ef-7c9d41043352 Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 81b58dfd-1559-4e3b-b3ef-7c9d41043352 Oct 10 18:59:07.946963 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:07.951846 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5a19fb3d-48fb-4f55-9ea0-ccfb922708a2 tempest-FloatingIPsNegativeTestJSON-963834189 tempest-FloatingIPsNegativeTestJSON-963834189-project] Returning 404 to user: Floating IP not found for ID 81b58dfd-1559-4e3b-b3ef-7c9d41043352 {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:59:07.953086 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5a19fb3d-48fb-4f55-9ea0-ccfb922708a2 tempest-FloatingIPsNegativeTestJSON-963834189 tempest-FloatingIPsNegativeTestJSON-963834189-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/81b58dfd-1559-4e3b-b3ef-7c9d41043352" status: 404 len: 111 microversion: 2.1 time: 0.144364 Oct 10 18:59:07.955687 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1251/2259] 10.222.0.43 () {58 vars in 1263 bytes} [Mon Oct 10 18:59:07 2022] DELETE /compute/v2.1/os-floating-ips/81b58dfd-1559-4e3b-b3ef-7c9d41043352 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:59:07.968203 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-42c1bcb0-948e-4f8a-b412-2742059894f0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:07.970735 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-42c1bcb0-948e-4f8a-b412-2742059894f0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:07.998130 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42c1bcb0-948e-4f8a-b412-2742059894f0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:07.999431 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42c1bcb0-948e-4f8a-b412-2742059894f0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:08.003127 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42c1bcb0-948e-4f8a-b412-2742059894f0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:08.005426 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42c1bcb0-948e-4f8a-b412-2742059894f0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:08.005913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42c1bcb0-948e-4f8a-b412-2742059894f0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:08.008257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-42c1bcb0-948e-4f8a-b412-2742059894f0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:08.127676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-444a0d8e-1c42-4321-8277-0f739e4c4202 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:08.145460 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-444a0d8e-1c42-4321-8277-0f739e4c4202 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1318 microversion: 2.1 time: 0.608755 Oct 10 18:59:08.147214 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1009/2260] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:07 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1318 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:59:08.355440 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-82dbeeef-4b04-46c5-af10-5d4aab5c9445 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:08.358435 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-82dbeeef-4b04-46c5-af10-5d4aab5c9445 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:08.375742 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-82dbeeef-4b04-46c5-af10-5d4aab5c9445 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:08.376759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-82dbeeef-4b04-46c5-af10-5d4aab5c9445 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:08.377416 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-82dbeeef-4b04-46c5-af10-5d4aab5c9445 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:08.381559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-82dbeeef-4b04-46c5-af10-5d4aab5c9445 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:08.381559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-82dbeeef-4b04-46c5-af10-5d4aab5c9445 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:08.381559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-82dbeeef-4b04-46c5-af10-5d4aab5c9445 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:08.451241 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-42c1bcb0-948e-4f8a-b412-2742059894f0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:08.462993 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-42c1bcb0-948e-4f8a-b412-2742059894f0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1313 microversion: 2.1 time: 0.508147 Oct 10 18:59:08.483720 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1252/2261] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:07 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:08.667130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-82dbeeef-4b04-46c5-af10-5d4aab5c9445 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:08.680045 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-82dbeeef-4b04-46c5-af10-5d4aab5c9445 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:08.682090 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-82dbeeef-4b04-46c5-af10-5d4aab5c9445 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:08.683659 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-82dbeeef-4b04-46c5-af10-5d4aab5c9445 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.334405 Oct 10 18:59:08.701761 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1010/2262] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:08 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:09.172043 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-92f21d79-d0dc-498c-8493-e80ef1e5564a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:09.172699 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-92f21d79-d0dc-498c-8493-e80ef1e5564a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:09.180146 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:09.181715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92f21d79-d0dc-498c-8493-e80ef1e5564a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:09.182394 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92f21d79-d0dc-498c-8493-e80ef1e5564a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:09.182831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92f21d79-d0dc-498c-8493-e80ef1e5564a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:09.183840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92f21d79-d0dc-498c-8493-e80ef1e5564a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:09.184840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92f21d79-d0dc-498c-8493-e80ef1e5564a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:09.185393 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92f21d79-d0dc-498c-8493-e80ef1e5564a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:09.500985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a808c72c-f1f8-4fb7-a1c0-518bae89b356 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:09.503971 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a808c72c-f1f8-4fb7-a1c0-518bae89b356 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:09.565043 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-92f21d79-d0dc-498c-8493-e80ef1e5564a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:09.567214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a808c72c-f1f8-4fb7-a1c0-518bae89b356 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:09.567900 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a808c72c-f1f8-4fb7-a1c0-518bae89b356 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:09.568498 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a808c72c-f1f8-4fb7-a1c0-518bae89b356 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:09.570562 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a808c72c-f1f8-4fb7-a1c0-518bae89b356 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:09.571323 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a808c72c-f1f8-4fb7-a1c0-518bae89b356 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:09.571957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a808c72c-f1f8-4fb7-a1c0-518bae89b356 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:09.583923 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-92f21d79-d0dc-498c-8493-e80ef1e5564a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1467 microversion: 2.1 time: 0.416384 Oct 10 18:59:09.587742 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1253/2263] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:09 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1467 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:09.614901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1320b7c4-6408-4a68-9516-6f668998bc99 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:09.619731 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1320b7c4-6408-4a68-9516-6f668998bc99 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:09.645291 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1320b7c4-6408-4a68-9516-6f668998bc99 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:09.648245 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1320b7c4-6408-4a68-9516-6f668998bc99 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:09.650168 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1320b7c4-6408-4a68-9516-6f668998bc99 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:09.652555 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1320b7c4-6408-4a68-9516-6f668998bc99 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:09.653430 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1320b7c4-6408-4a68-9516-6f668998bc99 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:09.655129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1320b7c4-6408-4a68-9516-6f668998bc99 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:10.024905 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1320b7c4-6408-4a68-9516-6f668998bc99 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:10.035221 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1320b7c4-6408-4a68-9516-6f668998bc99 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f" status: 200 len: 1468 microversion: 2.1 time: 0.425135 Oct 10 18:59:10.058558 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1254/2264] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:09 2022] GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f => generated 1468 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:59:10.077171 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1d17ea9f-db8b-4797-b64c-d0e93b667401 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:10.078091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1d17ea9f-db8b-4797-b64c-d0e93b667401 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:10.087144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d17ea9f-db8b-4797-b64c-d0e93b667401 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:10.088361 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d17ea9f-db8b-4797-b64c-d0e93b667401 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:10.089146 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d17ea9f-db8b-4797-b64c-d0e93b667401 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:10.090187 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d17ea9f-db8b-4797-b64c-d0e93b667401 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:10.091060 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d17ea9f-db8b-4797-b64c-d0e93b667401 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:10.091705 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d17ea9f-db8b-4797-b64c-d0e93b667401 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:10.341057 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a808c72c-f1f8-4fb7-a1c0-518bae89b356 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:10.362222 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a808c72c-f1f8-4fb7-a1c0-518bae89b356 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1313 microversion: 2.1 time: 0.875092 Oct 10 18:59:10.384708 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1011/2265] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:09 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1313 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:10.390446 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e72c40c3-1350-4f3b-9634-170daa064692 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1645693546"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:10.393654 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e72c40c3-1350-4f3b-9634-170daa064692 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:10.411855 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e72c40c3-1350-4f3b-9634-170daa064692 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:10.416719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e72c40c3-1350-4f3b-9634-170daa064692 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:10.416719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e72c40c3-1350-4f3b-9634-170daa064692 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:10.416719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e72c40c3-1350-4f3b-9634-170daa064692 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:10.416719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e72c40c3-1350-4f3b-9634-170daa064692 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:10.416719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e72c40c3-1350-4f3b-9634-170daa064692 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:10.485378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1d17ea9f-db8b-4797-b64c-d0e93b667401 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:10.500650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1d17ea9f-db8b-4797-b64c-d0e93b667401 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:10.502329 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1d17ea9f-db8b-4797-b64c-d0e93b667401 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:10.503557 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1d17ea9f-db8b-4797-b64c-d0e93b667401 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1485 microversion: 2.25 time: 0.442919 Oct 10 18:59:10.513835 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1255/2266] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:10 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1485 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:11.089237 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e72c40c3-1350-4f3b-9634-170daa064692 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "POST /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f/action" status: 202 len: 0 microversion: 2.1 time: 0.702910 Oct 10 18:59:11.089889 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1012/2267] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:59:10 2022] POST /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 18:59:11.109081 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-84048edf-da3c-4786-9db9-cd2af79e7c5c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318ddc33a0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:11.185984 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-84048edf-da3c-4786-9db9-cd2af79e7c5c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.088305 Oct 10 18:59:11.186673 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1256/2268] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:11 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:11.389682 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f6a34331-ca31-4661-a182-8cbc956f50e0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:11.391151 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f6a34331-ca31-4661-a182-8cbc956f50e0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:11.405496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6a34331-ca31-4661-a182-8cbc956f50e0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:11.406495 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6a34331-ca31-4661-a182-8cbc956f50e0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:11.407366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6a34331-ca31-4661-a182-8cbc956f50e0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:11.408369 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6a34331-ca31-4661-a182-8cbc956f50e0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:11.409044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6a34331-ca31-4661-a182-8cbc956f50e0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:11.411852 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f6a34331-ca31-4661-a182-8cbc956f50e0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:11.540859 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-03ede6ac-6479-4ec5-af52-9c247b86c130 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:11.542469 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-03ede6ac-6479-4ec5-af52-9c247b86c130 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:11.549775 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-03ede6ac-6479-4ec5-af52-9c247b86c130 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:11.551114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-03ede6ac-6479-4ec5-af52-9c247b86c130 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:11.555164 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-03ede6ac-6479-4ec5-af52-9c247b86c130 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:11.556885 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-03ede6ac-6479-4ec5-af52-9c247b86c130 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:11.557591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-03ede6ac-6479-4ec5-af52-9c247b86c130 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:11.558412 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-03ede6ac-6479-4ec5-af52-9c247b86c130 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:11.743927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f6a34331-ca31-4661-a182-8cbc956f50e0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:11.758303 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f6a34331-ca31-4661-a182-8cbc956f50e0 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1462 microversion: 2.1 time: 0.374847 Oct 10 18:59:11.759881 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1013/2269] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:11 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1462 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:11.841460 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-03ede6ac-6479-4ec5-af52-9c247b86c130 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:11.881536 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-03ede6ac-6479-4ec5-af52-9c247b86c130 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:11.887625 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-03ede6ac-6479-4ec5-af52-9c247b86c130 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:11.889208 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-03ede6ac-6479-4ec5-af52-9c247b86c130 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1475 microversion: 2.25 time: 0.353308 Oct 10 18:59:11.890683 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1257/2270] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:11 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1475 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:11.916481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e9e9d9a9-6e8c-4812-b846-6c0d282d4508 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '.version_select at 0x7f318eb399d0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:11.921992 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e9e9d9a9-6e8c-4812-b846-6c0d282d4508 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:11.923890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e9e9d9a9-6e8c-4812-b846-6c0d282d4508 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:11.925831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e9e9d9a9-6e8c-4812-b846-6c0d282d4508 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:11.944272 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e9e9d9a9-6e8c-4812-b846-6c0d282d4508 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.032659 Oct 10 18:59:11.956742 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1258/2271] 10.222.0.43 () {60 vars in 1184 bytes} [Mon Oct 10 18:59:11 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:59:11.966033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5495f194-31a6-4b25-af30-55ee17660309 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:11.968128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5495f194-31a6-4b25-af30-55ee17660309 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:11.982984 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5495f194-31a6-4b25-af30-55ee17660309 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:11.983709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5495f194-31a6-4b25-af30-55ee17660309 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:11.984370 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5495f194-31a6-4b25-af30-55ee17660309 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:11.985325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5495f194-31a6-4b25-af30-55ee17660309 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:11.986300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5495f194-31a6-4b25-af30-55ee17660309 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:11.986715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5495f194-31a6-4b25-af30-55ee17660309 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:12.101042 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-51b8f5d8-3ae8-47d4-b06d-c7f38ed7657e tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] Calling method '.version_select at 0x7f3192229ca0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:12.123625 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51b8f5d8-3ae8-47d4-b06d-c7f38ed7657e tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:12.124624 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51b8f5d8-3ae8-47d4-b06d-c7f38ed7657e tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:12.125317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51b8f5d8-3ae8-47d4-b06d-c7f38ed7657e tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:12.149590 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51b8f5d8-3ae8-47d4-b06d-c7f38ed7657e tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:12.153120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51b8f5d8-3ae8-47d4-b06d-c7f38ed7657e tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:12.153840 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51b8f5d8-3ae8-47d4-b06d-c7f38ed7657e tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:12.195092 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-51b8f5d8-3ae8-47d4-b06d-c7f38ed7657e tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/18b84921346941a69fa1ae60fc2d7823?start=2022-10-09T18%3A59%3A11.776464&end=2022-10-11T18%3A59%3A11.776464" status: 200 len: 694 microversion: 2.1 time: 0.414121 Oct 10 18:59:12.196503 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1014/2272] 10.222.0.43 () {58 vars in 1412 bytes} [Mon Oct 10 18:59:11 2022] GET /compute/v2.1/os-simple-tenant-usage/18b84921346941a69fa1ae60fc2d7823?start=2022-10-09T18%3A59%3A11.776464&end=2022-10-11T18%3A59%3A11.776464 => generated 694 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:59:12.206971 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-320c6683-9e95-4e2d-a430-3b04a73c75cb tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f3192362700>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:12.311557 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-320c6683-9e95-4e2d-a430-3b04a73c75cb tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.113312 Oct 10 18:59:12.330095 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1015/2273] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:12 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:59:12.340708 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-78f22e23-aa56-4f8f-bf15-fa06615cca5f tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '.version_select at 0x7f319226ff70>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:12.355497 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-78f22e23-aa56-4f8f-bf15-fa06615cca5f tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:12.355497 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-78f22e23-aa56-4f8f-bf15-fa06615cca5f tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:12.355497 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-78f22e23-aa56-4f8f-bf15-fa06615cca5f tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:12.368298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-78f22e23-aa56-4f8f-bf15-fa06615cca5f tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:12.369197 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-78f22e23-aa56-4f8f-bf15-fa06615cca5f tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:12.369854 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-78f22e23-aa56-4f8f-bf15-fa06615cca5f tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:12.383326 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-78f22e23-aa56-4f8f-bf15-fa06615cca5f tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/18b84921346941a69fa1ae60fc2d7823?start=2022-10-09T18%3A59%3A11.776464&end=2022-10-11T18%3A59%3A11.776464" status: 200 len: 694 microversion: 2.1 time: 0.047394 Oct 10 18:59:12.385162 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1016/2274] 10.222.0.43 () {58 vars in 1412 bytes} [Mon Oct 10 18:59:12 2022] GET /compute/v2.1/os-simple-tenant-usage/18b84921346941a69fa1ae60fc2d7823?start=2022-10-09T18%3A59%3A11.776464&end=2022-10-11T18%3A59%3A11.776464 => generated 694 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:12.400776 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-98cf10dd-30d4-4008-9c98-414b4a537fef tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] Calling method '.version_select at 0x7f3192229280>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:12.423174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98cf10dd-30d4-4008-9c98-414b4a537fef tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:12.423600 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98cf10dd-30d4-4008-9c98-414b4a537fef tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:12.424655 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98cf10dd-30d4-4008-9c98-414b4a537fef tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:12.430116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-5495f194-31a6-4b25-af30-55ee17660309 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] Lazy-loading 'services' on Instance uuid fce27ab7-7a56-4c87-95b1-5cf9afa20f24 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:59:12.459679 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5495f194-31a6-4b25-af30-55ee17660309 tempest-LiveAutoBlockMigrationV225Test-1552859446 tempest-LiveAutoBlockMigrationV225Test-1552859446-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1967 microversion: 2.25 time: 0.501435 Oct 10 18:59:12.470047 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1259/2275] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:11 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1967 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:12.482848 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98cf10dd-30d4-4008-9c98-414b4a537fef tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:12.483912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98cf10dd-30d4-4008-9c98-414b4a537fef tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:12.485783 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-98cf10dd-30d4-4008-9c98-414b4a537fef tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:12.502120 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b8e3bf1b-79f0-4492-b3d6-96b6b13ea7ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:12.502701 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b8e3bf1b-79f0-4492-b3d6-96b6b13ea7ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:12.522978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b8e3bf1b-79f0-4492-b3d6-96b6b13ea7ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:12.523480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b8e3bf1b-79f0-4492-b3d6-96b6b13ea7ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:12.523920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b8e3bf1b-79f0-4492-b3d6-96b6b13ea7ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:12.526535 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b8e3bf1b-79f0-4492-b3d6-96b6b13ea7ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:12.527009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b8e3bf1b-79f0-4492-b3d6-96b6b13ea7ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:12.533083 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b8e3bf1b-79f0-4492-b3d6-96b6b13ea7ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:12.604030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b8e3bf1b-79f0-4492-b3d6-96b6b13ea7ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:59:12.784176 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-98cf10dd-30d4-4008-9c98-414b4a537fef tempest-TenantUsagesTestJSON-563298672 tempest-TenantUsagesTestJSON-563298672-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-09T18%3A59%3A11.776464&end=2022-10-11T18%3A59%3A11.776464&detailed=1" status: 200 len: 27001 microversion: 2.1 time: 0.385828 Oct 10 18:59:12.787308 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1017/2276] 10.222.0.43 () {58 vars in 1335 bytes} [Mon Oct 10 18:59:12 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-09T18%3A59%3A11.776464&end=2022-10-11T18%3A59%3A11.776464&detailed=1 => generated 27001 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 10 18:59:12.831253 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2040d24f-174b-44d4-bf34-c104321aab56 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:12.833079 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2040d24f-174b-44d4-bf34-c104321aab56 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:12.842416 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2040d24f-174b-44d4-bf34-c104321aab56 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:12.843162 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2040d24f-174b-44d4-bf34-c104321aab56 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:12.843755 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2040d24f-174b-44d4-bf34-c104321aab56 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:12.844887 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2040d24f-174b-44d4-bf34-c104321aab56 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:12.845505 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2040d24f-174b-44d4-bf34-c104321aab56 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:12.846070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2040d24f-174b-44d4-bf34-c104321aab56 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:12.883750 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2040d24f-174b-44d4-bf34-c104321aab56 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:59:13.072204 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b8e3bf1b-79f0-4492-b3d6-96b6b13ea7ff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 204 len: 0 microversion: 2.25 time: 0.572280 Oct 10 18:59:13.072204 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1260/2277] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:59:12 2022] DELETE /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 18:59:13.081292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cd146461-1bd9-415f-bcc9-95087c82f6ec tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:13.082696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cd146461-1bd9-415f-bcc9-95087c82f6ec tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:13.089462 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cd146461-1bd9-415f-bcc9-95087c82f6ec tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:13.091803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cd146461-1bd9-415f-bcc9-95087c82f6ec tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:13.093052 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cd146461-1bd9-415f-bcc9-95087c82f6ec tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:13.093994 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cd146461-1bd9-415f-bcc9-95087c82f6ec tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:13.094482 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cd146461-1bd9-415f-bcc9-95087c82f6ec tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:13.094908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cd146461-1bd9-415f-bcc9-95087c82f6ec tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:13.245959 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:13.318211 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cd146461-1bd9-415f-bcc9-95087c82f6ec tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:13.327490 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2040d24f-174b-44d4-bf34-c104321aab56 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 204 len: 0 microversion: 2.1 time: 0.501309 Oct 10 18:59:13.327643 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1018/2278] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 18:59:12 2022] DELETE /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 18:59:13.333520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-adc388b0-56c9-4b78-ba27-a75084462f29 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921c6af0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:13.342136 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cd146461-1bd9-415f-bcc9-95087c82f6ec tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:13.345546 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cd146461-1bd9-415f-bcc9-95087c82f6ec tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:13.347071 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cd146461-1bd9-415f-bcc9-95087c82f6ec tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1481 microversion: 2.25 time: 0.270587 Oct 10 18:59:13.348108 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1261/2279] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:13 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1481 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:59:13.354481 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2cf9cbf6-f855-4458-9028-829c032a7f3b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:13.355465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2cf9cbf6-f855-4458-9028-829c032a7f3b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:13.362491 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2cf9cbf6-f855-4458-9028-829c032a7f3b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:13.363302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2cf9cbf6-f855-4458-9028-829c032a7f3b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:13.364114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2cf9cbf6-f855-4458-9028-829c032a7f3b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:13.365104 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2cf9cbf6-f855-4458-9028-829c032a7f3b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:13.365877 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2cf9cbf6-f855-4458-9028-829c032a7f3b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:13.366505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2cf9cbf6-f855-4458-9028-829c032a7f3b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:13.383580 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-adc388b0-56c9-4b78-ba27-a75084462f29 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.054675 Oct 10 18:59:13.384610 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1019/2280] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:13 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:13.543096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2cf9cbf6-f855-4458-9028-829c032a7f3b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:13.553930 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2cf9cbf6-f855-4458-9028-829c032a7f3b tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1468 microversion: 2.1 time: 0.204332 Oct 10 18:59:13.558030 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1262/2281] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:13 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1468 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:14.383988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2e77f854-8166-4918-9aa6-44d1a7d78b92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:14.385782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2e77f854-8166-4918-9aa6-44d1a7d78b92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:14.401248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-922cc3dc-90b0-4141-b7eb-f4eebf40bf39 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318eb399d0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:14.418991 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e77f854-8166-4918-9aa6-44d1a7d78b92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:14.419495 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e77f854-8166-4918-9aa6-44d1a7d78b92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:14.419938 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e77f854-8166-4918-9aa6-44d1a7d78b92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:14.427859 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e77f854-8166-4918-9aa6-44d1a7d78b92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:14.430076 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e77f854-8166-4918-9aa6-44d1a7d78b92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:14.430532 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2e77f854-8166-4918-9aa6-44d1a7d78b92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:14.468113 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-922cc3dc-90b0-4141-b7eb-f4eebf40bf39 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.071634 Oct 10 18:59:14.468882 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1263/2282] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:14 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:59:14.589282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c44a4db5-5e4d-4b73-ad98-cbf027f1d697 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:14.592243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c44a4db5-5e4d-4b73-ad98-cbf027f1d697 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:14.605418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c44a4db5-5e4d-4b73-ad98-cbf027f1d697 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:14.606343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c44a4db5-5e4d-4b73-ad98-cbf027f1d697 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:14.607033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c44a4db5-5e4d-4b73-ad98-cbf027f1d697 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:14.607975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c44a4db5-5e4d-4b73-ad98-cbf027f1d697 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:14.613989 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c44a4db5-5e4d-4b73-ad98-cbf027f1d697 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:14.618886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c44a4db5-5e4d-4b73-ad98-cbf027f1d697 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:14.658216 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2e77f854-8166-4918-9aa6-44d1a7d78b92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:14.679068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2e77f854-8166-4918-9aa6-44d1a7d78b92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:14.699612 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2e77f854-8166-4918-9aa6-44d1a7d78b92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:14.704106 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2e77f854-8166-4918-9aa6-44d1a7d78b92 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1439 microversion: 2.25 time: 0.327497 Oct 10 18:59:14.706857 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1020/2283] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:14 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1439 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:14.727375 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-59330999-7d2a-41dc-a7e4-4caf62545bbd req-9d164a7a-5b4c-4857-9058-ab42412241c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce27ab7-7a56-4c87-95b1-5cf9afa20f24", "name": "network-vif-deleted", "tag": "b1a81c55-5504-4e91-812f-a4ea821e79f4"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:14.768799 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-59330999-7d2a-41dc-a7e4-4caf62545bbd req-9d164a7a-5b4c-4857-9058-ab42412241c8 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:14.769297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-59330999-7d2a-41dc-a7e4-4caf62545bbd req-9d164a7a-5b4c-4857-9058-ab42412241c8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:14.769732 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-59330999-7d2a-41dc-a7e4-4caf62545bbd req-9d164a7a-5b4c-4857-9058-ab42412241c8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:14.784826 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-59330999-7d2a-41dc-a7e4-4caf62545bbd req-9d164a7a-5b4c-4857-9058-ab42412241c8 service nova] Creating event network-vif-deleted:b1a81c55-5504-4e91-812f-a4ea821e79f4 for instance fce27ab7-7a56-4c87-95b1-5cf9afa20f24 on n-h1-860863-1 Oct 10 18:59:14.801049 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-59330999-7d2a-41dc-a7e4-4caf62545bbd req-9d164a7a-5b4c-4857-9058-ab42412241c8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092258 Oct 10 18:59:14.811521 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1021/2284] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:15.492844 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6a116530-ef53-48d6-9d00-c7b1fc782423 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921c6160>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:15.541348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c44a4db5-5e4d-4b73-ad98-cbf027f1d697 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:15.550371 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c44a4db5-5e4d-4b73-ad98-cbf027f1d697 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1468 microversion: 2.1 time: 0.974866 Oct 10 18:59:15.558306 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1264/2285] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:14 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1468 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:15.571508 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6a116530-ef53-48d6-9d00-c7b1fc782423 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.085929 Oct 10 18:59:15.572094 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1022/2286] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:15 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:15.735420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bd490d42-df95-4bac-8d83-bc03d16026aa tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:15.736596 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bd490d42-df95-4bac-8d83-bc03d16026aa tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:15.748827 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bd490d42-df95-4bac-8d83-bc03d16026aa tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:15.753050 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bd490d42-df95-4bac-8d83-bc03d16026aa tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:15.753050 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bd490d42-df95-4bac-8d83-bc03d16026aa tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:15.754553 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bd490d42-df95-4bac-8d83-bc03d16026aa tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:15.757276 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bd490d42-df95-4bac-8d83-bc03d16026aa tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:15.758764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bd490d42-df95-4bac-8d83-bc03d16026aa tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:15.860583 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bd490d42-df95-4bac-8d83-bc03d16026aa tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:15.880860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bd490d42-df95-4bac-8d83-bc03d16026aa tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:15.886639 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bd490d42-df95-4bac-8d83-bc03d16026aa tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:15.889040 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bd490d42-df95-4bac-8d83-bc03d16026aa tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1265 microversion: 2.25 time: 0.157797 Oct 10 18:59:15.893194 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1265/2287] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:15 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:16.586158 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6b6a3672-bad2-4699-92cc-738bf3ad6130 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:16.586897 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6b6a3672-bad2-4699-92cc-738bf3ad6130 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:16.598864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-eec6aeb8-d241-4595-9d3e-5f426dac305d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f3192384dc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:16.605480 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b6a3672-bad2-4699-92cc-738bf3ad6130 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:16.606326 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b6a3672-bad2-4699-92cc-738bf3ad6130 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:16.609428 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b6a3672-bad2-4699-92cc-738bf3ad6130 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:16.610807 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b6a3672-bad2-4699-92cc-738bf3ad6130 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:16.613696 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b6a3672-bad2-4699-92cc-738bf3ad6130 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:16.617341 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b6a3672-bad2-4699-92cc-738bf3ad6130 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:16.705383 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:16.747223 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-eec6aeb8-d241-4595-9d3e-5f426dac305d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.161555 Oct 10 18:59:16.757653 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1266/2288] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:16 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:16.921757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cee8c528-07dc-429a-aaed-6ddc57430f21 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:16.922917 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cee8c528-07dc-429a-aaed-6ddc57430f21 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:16.937628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cee8c528-07dc-429a-aaed-6ddc57430f21 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:16.940844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cee8c528-07dc-429a-aaed-6ddc57430f21 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:16.942973 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cee8c528-07dc-429a-aaed-6ddc57430f21 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:16.946137 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cee8c528-07dc-429a-aaed-6ddc57430f21 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:16.948177 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cee8c528-07dc-429a-aaed-6ddc57430f21 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:16.951425 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cee8c528-07dc-429a-aaed-6ddc57430f21 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:17.016762 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:17.276114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cee8c528-07dc-429a-aaed-6ddc57430f21 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:17.300212 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cee8c528-07dc-429a-aaed-6ddc57430f21 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:17.309926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cee8c528-07dc-429a-aaed-6ddc57430f21 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:17.317306 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cee8c528-07dc-429a-aaed-6ddc57430f21 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1265 microversion: 2.25 time: 0.395323 Oct 10 18:59:17.323901 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1267/2289] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:16 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1265 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:59:17.440388 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6b6a3672-bad2-4699-92cc-738bf3ad6130 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:17.450150 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-b67d7785-1126-4062-b846-e69243efb9e2 req-588a2ece-5d17-4699-a214-4574f1dbf375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e0cf03a-8264-4848-a454-36ca690765b1", "name": "network-vif-deleted", "tag": "d09a97aa-e8a8-470e-9283-8477f779ba27"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:17.461701 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6b6a3672-bad2-4699-92cc-738bf3ad6130 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1468 microversion: 2.1 time: 0.880250 Oct 10 18:59:17.462313 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1023/2290] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:16 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1468 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:17.483551 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b67d7785-1126-4062-b846-e69243efb9e2 req-588a2ece-5d17-4699-a214-4574f1dbf375 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:17.490096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b67d7785-1126-4062-b846-e69243efb9e2 req-588a2ece-5d17-4699-a214-4574f1dbf375 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:17.490581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b67d7785-1126-4062-b846-e69243efb9e2 req-588a2ece-5d17-4699-a214-4574f1dbf375 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:17.558528 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-b67d7785-1126-4062-b846-e69243efb9e2 req-588a2ece-5d17-4699-a214-4574f1dbf375 service nova] Creating event network-vif-deleted:d09a97aa-e8a8-470e-9283-8477f779ba27 for instance 2e0cf03a-8264-4848-a454-36ca690765b1 on n-h2-860863-1 Oct 10 18:59:17.585708 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-b67d7785-1126-4062-b846-e69243efb9e2 req-588a2ece-5d17-4699-a214-4574f1dbf375 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141648 Oct 10 18:59:17.600858 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1268/2291] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:17.764005 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-54d1a4b8-1cd3-4118-946e-b7c6429f6b7b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31922d10d0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:17.835090 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-54d1a4b8-1cd3-4118-946e-b7c6429f6b7b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.074929 Oct 10 18:59:17.835744 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1024/2292] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:17 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:18.356461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1841780b-a1b4-4c37-ad04-a197f151fc62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:18.357198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1841780b-a1b4-4c37-ad04-a197f151fc62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:18.378904 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1841780b-a1b4-4c37-ad04-a197f151fc62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:18.379307 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1841780b-a1b4-4c37-ad04-a197f151fc62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:18.379740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1841780b-a1b4-4c37-ad04-a197f151fc62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:18.380449 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1841780b-a1b4-4c37-ad04-a197f151fc62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:18.380927 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1841780b-a1b4-4c37-ad04-a197f151fc62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:18.381396 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1841780b-a1b4-4c37-ad04-a197f151fc62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:18.489511 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d96d9344-8982-4382-b9c3-b070159d0bac tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:18.490317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d96d9344-8982-4382-b9c3-b070159d0bac tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:18.509802 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d96d9344-8982-4382-b9c3-b070159d0bac tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:18.511700 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d96d9344-8982-4382-b9c3-b070159d0bac tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:18.513075 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d96d9344-8982-4382-b9c3-b070159d0bac tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:18.515096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d96d9344-8982-4382-b9c3-b070159d0bac tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:18.516567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d96d9344-8982-4382-b9c3-b070159d0bac tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:18.517166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d96d9344-8982-4382-b9c3-b070159d0bac tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:18.597224 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d96d9344-8982-4382-b9c3-b070159d0bac tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:18.603191 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d96d9344-8982-4382-b9c3-b070159d0bac tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:18.613195 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d96d9344-8982-4382-b9c3-b070159d0bac tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:18.614396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-d96d9344-8982-4382-b9c3-b070159d0bac tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lazy-loading 'fault' on Instance uuid 2e0cf03a-8264-4848-a454-36ca690765b1 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:59:18.676357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1841780b-a1b4-4c37-ad04-a197f151fc62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:18.690214 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1841780b-a1b4-4c37-ad04-a197f151fc62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:18.696347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1841780b-a1b4-4c37-ad04-a197f151fc62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:18.701736 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1841780b-a1b4-4c37-ad04-a197f151fc62 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1265 microversion: 2.25 time: 0.350317 Oct 10 18:59:18.717130 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1269/2293] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:18 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1265 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:18.776976 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d96d9344-8982-4382-b9c3-b070159d0bac tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bff97a46d3245adb48d3dfbd7333590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b84921346941a69fa1ae60fc2d7823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:18.801187 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d96d9344-8982-4382-b9c3-b070159d0bac tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 200 len: 1303 microversion: 2.1 time: 0.303415 Oct 10 18:59:18.801187 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1025/2294] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:18 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 1303 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:59:18.859418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-74d684b4-1977-4f02-885b-c1975da1d158 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318e2c5af0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:18.987193 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-74d684b4-1977-4f02-885b-c1975da1d158 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.139723 Oct 10 18:59:18.987797 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1270/2295] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:18 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:19.738591 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2b3ed6f5-ae00-44e5-ba14-ce66fb1a5263 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:19.739541 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2b3ed6f5-ae00-44e5-ba14-ce66fb1a5263 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:19.752030 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2b3ed6f5-ae00-44e5-ba14-ce66fb1a5263 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:19.757618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2b3ed6f5-ae00-44e5-ba14-ce66fb1a5263 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:19.759434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2b3ed6f5-ae00-44e5-ba14-ce66fb1a5263 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:19.760360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2b3ed6f5-ae00-44e5-ba14-ce66fb1a5263 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:19.761311 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2b3ed6f5-ae00-44e5-ba14-ce66fb1a5263 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:19.765886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2b3ed6f5-ae00-44e5-ba14-ce66fb1a5263 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:19.816057 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7c326fe9-45e9-48ef-90fa-e64b21f50e41 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:19.817103 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7c326fe9-45e9-48ef-90fa-e64b21f50e41 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] [instance: 2e0cf03a-8264-4848-a454-36ca690765b1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:19.842754 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7c326fe9-45e9-48ef-90fa-e64b21f50e41 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:19.843274 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7c326fe9-45e9-48ef-90fa-e64b21f50e41 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:19.855690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7c326fe9-45e9-48ef-90fa-e64b21f50e41 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:19.858950 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7c326fe9-45e9-48ef-90fa-e64b21f50e41 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:19.859454 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7c326fe9-45e9-48ef-90fa-e64b21f50e41 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:19.859903 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7c326fe9-45e9-48ef-90fa-e64b21f50e41 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:19.951863 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-7c326fe9-45e9-48ef-90fa-e64b21f50e41 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] HTTP exception thrown: Instance 2e0cf03a-8264-4848-a454-36ca690765b1 could not be found. Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7c326fe9-45e9-48ef-90fa-e64b21f50e41 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Request method failure captured: Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 HTTP/1.1 Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGtl7tihqtrUqXV7QHWe5V-LR2-FfIwab8AoV6g32ntrg0w42gCa6OF0eb9u7IKN7IWyCdVusav8BzAui6DHCIPZFkDsYKYPF-J192VwahIRp7RPWFHnb3JQaitWFifCG4IeFCr8TvcPlcTpGjQYUMbXgr2yQDlqANGX1bunb0XDa-I Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 18b84921346941a69fa1ae60fc2d7823 Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-TenantUsagesTestJSON-1041758948 Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_18b84921346941a69fa1ae60fc2d7823", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/18b84921346941a69fa1ae60fc2d7823"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/18b84921346941a69fa1ae60fc2d7823"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/18b84921346941a69fa1ae60fc2d7823"}]}] Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-TenantUsagesTestJSON-1041758948 Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 18b84921346941a69fa1ae60fc2d7823 Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1041758948 Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-TenantUsagesTestJSON-1041758948-project Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 6bff97a46d3245adb48d3dfbd7333590 Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-TenantUsagesTestJSON-1041758948-project Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 2e0cf03a-8264-4848-a454-36ca690765b1 could not be found. Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '2e0cf03a-8264-4848-a454-36ca690765b1'} Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e0cf03a-8264-4848-a454-36ca690765b1 could not be found. Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e0cf03a-8264-4848-a454-36ca690765b1 could not be found. Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:19.958933 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:19.963530 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:19.963530 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:19.963530 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:19.963530 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:59:19.963530 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:59:19.963530 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e0cf03a-8264-4848-a454-36ca690765b1 could not be found. Oct 10 18:59:19.963530 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:19.963530 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7c326fe9-45e9-48ef-90fa-e64b21f50e41 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] Returning 404 to user: Instance 2e0cf03a-8264-4848-a454-36ca690765b1 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:59:19.966067 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7c326fe9-45e9-48ef-90fa-e64b21f50e41 tempest-TenantUsagesTestJSON-1041758948 tempest-TenantUsagesTestJSON-1041758948-project] 10.222.0.43 "GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1" status: 404 len: 111 microversion: 2.1 time: 0.154800 Oct 10 18:59:19.970498 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1271/2296] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:19 2022] GET /compute/v2.1/servers/2e0cf03a-8264-4848-a454-36ca690765b1 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 18:59:20.003816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-31603d25-be0f-431e-b778-9c2a3ae7ba1b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318ddc34c0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:20.056405 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2b3ed6f5-ae00-44e5-ba14-ce66fb1a5263 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:20.133142 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2b3ed6f5-ae00-44e5-ba14-ce66fb1a5263 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:20.135561 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2b3ed6f5-ae00-44e5-ba14-ce66fb1a5263 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:20.143847 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2b3ed6f5-ae00-44e5-ba14-ce66fb1a5263 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1265 microversion: 2.25 time: 0.416292 Oct 10 18:59:20.148165 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-31603d25-be0f-431e-b778-9c2a3ae7ba1b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.148693 Oct 10 18:59:20.164568 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1272/2297] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:19 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:20.164779 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1026/2298] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:19 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1265 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:20.619776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-fa05fe5b-f0e9-46d7-a639-ba83e11e2bb6 req-a11678ea-375e-43ce-a7f2-d30518d7cf59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f", "name": "network-vif-plugged", "status": "completed", "tag": "5bffc937-d058-4e1d-89e3-1fcc517f98e7"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:20.666993 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-fa05fe5b-f0e9-46d7-a639-ba83e11e2bb6 req-a11678ea-375e-43ce-a7f2-d30518d7cf59 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:20.668461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-fa05fe5b-f0e9-46d7-a639-ba83e11e2bb6 req-a11678ea-375e-43ce-a7f2-d30518d7cf59 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:20.670766 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-fa05fe5b-f0e9-46d7-a639-ba83e11e2bb6 req-a11678ea-375e-43ce-a7f2-d30518d7cf59 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:20.722087 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-fa05fe5b-f0e9-46d7-a639-ba83e11e2bb6 req-a11678ea-375e-43ce-a7f2-d30518d7cf59 service nova] Creating event network-vif-plugged:5bffc937-d058-4e1d-89e3-1fcc517f98e7 for instance bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f on n-h1-860863-1 Oct 10 18:59:20.739173 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-fa05fe5b-f0e9-46d7-a639-ba83e11e2bb6 req-a11678ea-375e-43ce-a7f2-d30518d7cf59 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126958 Oct 10 18:59:20.741439 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1273/2299] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 18:59:21.170008 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-12284f36-76ab-49fc-95fe-998aa5af5fb1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319221f4c0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:21.186982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-dd390150-4ed0-43cb-9776-60fb4dd810c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:21.189009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-dd390150-4ed0-43cb-9776-60fb4dd810c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:21.227430 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd390150-4ed0-43cb-9776-60fb4dd810c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:21.236587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd390150-4ed0-43cb-9776-60fb4dd810c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:21.243793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd390150-4ed0-43cb-9776-60fb4dd810c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:21.243793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd390150-4ed0-43cb-9776-60fb4dd810c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:21.243793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd390150-4ed0-43cb-9776-60fb4dd810c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:21.243793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd390150-4ed0-43cb-9776-60fb4dd810c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:21.301266 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-12284f36-76ab-49fc-95fe-998aa5af5fb1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.134085 Oct 10 18:59:21.302368 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1027/2300] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:21 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:21.638508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dd390150-4ed0-43cb-9776-60fb4dd810c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:21.659584 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dd390150-4ed0-43cb-9776-60fb4dd810c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:21.666110 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dd390150-4ed0-43cb-9776-60fb4dd810c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:21.668583 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-dd390150-4ed0-43cb-9776-60fb4dd810c3 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1265 microversion: 2.25 time: 0.492168 Oct 10 18:59:21.671774 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1274/2301] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:21 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1265 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:22.320332 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-185209be-67f4-4abe-b478-780833e52003 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921c65e0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:22.396247 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-185209be-67f4-4abe-b478-780833e52003 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.080911 Oct 10 18:59:22.399276 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1028/2302] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:22 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:22.698927 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1adafa4e-9d3c-47a9-90e6-de906bd48fff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:22.701164 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1adafa4e-9d3c-47a9-90e6-de906bd48fff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:22.725723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1adafa4e-9d3c-47a9-90e6-de906bd48fff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:22.726508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1adafa4e-9d3c-47a9-90e6-de906bd48fff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:22.732004 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1adafa4e-9d3c-47a9-90e6-de906bd48fff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:22.735945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1adafa4e-9d3c-47a9-90e6-de906bd48fff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:22.736677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1adafa4e-9d3c-47a9-90e6-de906bd48fff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:22.737732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1adafa4e-9d3c-47a9-90e6-de906bd48fff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:22.917566 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1adafa4e-9d3c-47a9-90e6-de906bd48fff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:22.935802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1adafa4e-9d3c-47a9-90e6-de906bd48fff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:22.937429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1adafa4e-9d3c-47a9-90e6-de906bd48fff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:22.946837 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1adafa4e-9d3c-47a9-90e6-de906bd48fff tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1265 microversion: 2.25 time: 0.250644 Oct 10 18:59:22.952601 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1275/2303] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:22 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:23.410959 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=6 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:23.418542 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6b1a6373-7dd3-43c9-883c-c06b3c5db875 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319221f4c0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:23.510131 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6b1a6373-7dd3-43c9-883c-c06b3c5db875 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.100436 Oct 10 18:59:23.513251 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1029/2304] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:23 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:23.981445 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e2cef8aa-f94f-45c9-8a85-f7e6abddf072 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:23.983391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e2cef8aa-f94f-45c9-8a85-f7e6abddf072 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:24.010689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2cef8aa-f94f-45c9-8a85-f7e6abddf072 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:24.017025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2cef8aa-f94f-45c9-8a85-f7e6abddf072 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:24.020487 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2cef8aa-f94f-45c9-8a85-f7e6abddf072 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:24.021514 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2cef8aa-f94f-45c9-8a85-f7e6abddf072 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:24.028770 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2cef8aa-f94f-45c9-8a85-f7e6abddf072 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:24.029998 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2cef8aa-f94f-45c9-8a85-f7e6abddf072 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:24.344024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e2cef8aa-f94f-45c9-8a85-f7e6abddf072 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:24.368028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e2cef8aa-f94f-45c9-8a85-f7e6abddf072 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:24.372636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e2cef8aa-f94f-45c9-8a85-f7e6abddf072 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:24.380059 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e2cef8aa-f94f-45c9-8a85-f7e6abddf072 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1265 microversion: 2.25 time: 0.400020 Oct 10 18:59:24.383077 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1276/2305] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:23 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1265 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:24.529687 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5f8263f0-343e-4fa5-bfc6-12d6a38f1c18 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921c6280>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:24.655353 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5f8263f0-343e-4fa5-bfc6-12d6a38f1c18 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.130661 Oct 10 18:59:24.655940 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1030/2306] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:24 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:25.374264 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-161b4ede-18da-4291-97f3-dbc57eae5c63 tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] Calling method '.version_select at 0x7f318ddc3700>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:25.391767 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-161b4ede-18da-4291-97f3-dbc57eae5c63 tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:25.392687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-161b4ede-18da-4291-97f3-dbc57eae5c63 tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:25.393900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-161b4ede-18da-4291-97f3-dbc57eae5c63 tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:25.395079 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-161b4ede-18da-4291-97f3-dbc57eae5c63 tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:25.395738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-161b4ede-18da-4291-97f3-dbc57eae5c63 tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:25.396367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-161b4ede-18da-4291-97f3-dbc57eae5c63 tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:25.411247 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6235175e-7389-42b7-9087-cbfa01054a90 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:25.412130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6235175e-7389-42b7-9087-cbfa01054a90 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:25.438384 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-161b4ede-18da-4291-97f3-dbc57eae5c63 tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] 10.222.0.43 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.504209 Oct 10 18:59:25.439118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6235175e-7389-42b7-9087-cbfa01054a90 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:25.439721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6235175e-7389-42b7-9087-cbfa01054a90 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:25.440171 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6235175e-7389-42b7-9087-cbfa01054a90 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:25.443892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6235175e-7389-42b7-9087-cbfa01054a90 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:25.444371 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6235175e-7389-42b7-9087-cbfa01054a90 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:25.444834 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6235175e-7389-42b7-9087-cbfa01054a90 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:25.446119 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1277/2307] 10.222.0.43 () {58 vars in 1122 bytes} [Mon Oct 10 18:59:24 2022] GET /compute/v2.1/limits => generated 511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:25.582202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9c2baa05-8065-4f48-b95c-2796e008095a tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-80069033", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:25.734663 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-9c2baa05-8065-4f48-b95c-2796e008095a tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] validate_networks() for None {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:59:25.836120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6235175e-7389-42b7-9087-cbfa01054a90 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:25.849499 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6235175e-7389-42b7-9087-cbfa01054a90 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:25.871403 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6235175e-7389-42b7-9087-cbfa01054a90 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:25.875652 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6235175e-7389-42b7-9087-cbfa01054a90 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1265 microversion: 2.25 time: 0.468263 Oct 10 18:59:25.876255 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1031/2308] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:25 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1265 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:59:25.901538 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0ebdbf56-1049-40f3-9a81-53a33df62430 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319220fee0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:25.967237 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0ebdbf56-1049-40f3-9a81-53a33df62430 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.075955 Oct 10 18:59:25.968324 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1032/2309] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:25 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:26.799485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-9c2baa05-8065-4f48-b95c-2796e008095a tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] Getting quotas for project 1a4b0645311d4128b18c426ef1a78ddc. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:59:26.817167 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-9c2baa05-8065-4f48-b95c-2796e008095a tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] Getting quotas for user ec12d15cb075455bbfd2e82aad647763 and project 1a4b0645311d4128b18c426ef1a78ddc. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:59:26.855331 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-9c2baa05-8065-4f48-b95c-2796e008095a tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9c2baa05-8065-4f48-b95c-2796e008095a tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] Request method failure captured: Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 1750 Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGuMJxIvn88IBaCwqvKl9kcEFZQyWb7SO3QFjNE6bKCdDuwpafrJiPh3qmod2YdEpIVjJjU-cHTp3n8IDMQUIogbXygUnx-a0rwbDpW-n7hs-8QxU94RRyPlqRqAyb36LgsDuAbW8MLQwHwYF8MatJJQK7_7JpVS_45lN1cCicmvkig Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 1a4b0645311d4128b18c426ef1a78ddc Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-2012736527 Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1a4b0645311d4128b18c426ef1a78ddc", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1a4b0645311d4128b18c426ef1a78ddc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a4b0645311d4128b18c426ef1a78ddc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1a4b0645311d4128b18c426ef1a78ddc"}]}] Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-2012736527 Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 1a4b0645311d4128b18c426ef1a78ddc Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-2012736527 Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: ec12d15cb075455bbfd2e82aad647763 Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-80069033", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 18:59:26.866910 n-d-860863-1 devstack@n-api.service[127288]: exception: Maximum number of metadata items exceeds 128 Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-80069033', 'imageRef': 'b0a280ee-26ee-4c9a-8155-4326e368ccc9', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:59:26.869154 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 10 18:59:26.871747 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 18:59:26.874566 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9c2baa05-8065-4f48-b95c-2796e008095a tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:59:26.880862 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9c2baa05-8065-4f48-b95c-2796e008095a tempest-AbsoluteLimitsNegativeTestJSON-2012736527 tempest-AbsoluteLimitsNegativeTestJSON-2012736527-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.303319 Oct 10 18:59:26.885513 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1278/2310] 10.222.0.43 () {60 vars in 1148 bytes} [Mon Oct 10 18:59:25 2022] POST /compute/v2.1/servers => generated 87 bytes in 1309 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Oct 10 18:59:26.903708 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a97fa740-8d0c-4ada-9211-2b8cbe67463d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:26.904437 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a97fa740-8d0c-4ada-9211-2b8cbe67463d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:26.935726 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a97fa740-8d0c-4ada-9211-2b8cbe67463d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:26.936335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a97fa740-8d0c-4ada-9211-2b8cbe67463d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:26.936806 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a97fa740-8d0c-4ada-9211-2b8cbe67463d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:26.937650 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a97fa740-8d0c-4ada-9211-2b8cbe67463d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:26.937991 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a97fa740-8d0c-4ada-9211-2b8cbe67463d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:26.938422 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a97fa740-8d0c-4ada-9211-2b8cbe67463d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:26.983050 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-24fbe422-b839-4890-8c36-eb6c0350c746 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d662310>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:27.090728 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-24fbe422-b839-4890-8c36-eb6c0350c746 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.111444 Oct 10 18:59:27.091319 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1279/2311] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:26 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:59:27.382130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a97fa740-8d0c-4ada-9211-2b8cbe67463d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:27.402995 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a97fa740-8d0c-4ada-9211-2b8cbe67463d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:27.417109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a97fa740-8d0c-4ada-9211-2b8cbe67463d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:27.427261 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a97fa740-8d0c-4ada-9211-2b8cbe67463d tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1265 microversion: 2.25 time: 0.523696 Oct 10 18:59:27.433770 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1033/2312] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:26 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1265 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:28.107939 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ff4a225c-e83c-4bb2-94dd-4c717b495865 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318e2c5160>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:28.183515 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ff4a225c-e83c-4bb2-94dd-4c717b495865 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.080295 Oct 10 18:59:28.186149 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1280/2313] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:28 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:28.458053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:28.459918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:28.499761 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:28.501703 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:28.502442 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:28.503311 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:28.507669 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:28.509512 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:28.646600 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:28.646600 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:28.646600 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:28.646600 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lazy-loading 'fault' on Instance uuid fce27ab7-7a56-4c87-95b1-5cf9afa20f24 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:59:28.768555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:28.782500 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:28.793111 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:28.795606 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5d124c54-5c72-49f2-825f-38ff911979af tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 200 len: 1270 microversion: 2.25 time: 0.340482 Oct 10 18:59:28.795606 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1034/2314] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:28 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 1270 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:29.087017 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1368619747", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "472b8abb-e92b-4e24-8d15-9ea81e05fe68"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:29.200381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1e1d8286-6251-4766-ac8a-8575a5667f82 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319220ff70>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:29.211603 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] validate_networks() for [('472b8abb-e92b-4e24-8d15-9ea81e05fe68', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:59:29.307561 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1e1d8286-6251-4766-ac8a-8575a5667f82 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.111244 Oct 10 18:59:29.308471 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1035/2315] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:29 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:59:29.827342 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0f2e9a73-4b7d-44a2-a8dc-619f282cba4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:29.828874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0f2e9a73-4b7d-44a2-a8dc-619f282cba4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: fce27ab7-7a56-4c87-95b1-5cf9afa20f24] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:29.850891 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f2e9a73-4b7d-44a2-a8dc-619f282cba4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:29.851781 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f2e9a73-4b7d-44a2-a8dc-619f282cba4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:29.852453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f2e9a73-4b7d-44a2-a8dc-619f282cba4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:29.853423 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f2e9a73-4b7d-44a2-a8dc-619f282cba4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:29.854079 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f2e9a73-4b7d-44a2-a8dc-619f282cba4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:29.854708 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0f2e9a73-4b7d-44a2-a8dc-619f282cba4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:29.901693 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-0f2e9a73-4b7d-44a2-a8dc-619f282cba4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] HTTP exception thrown: Instance fce27ab7-7a56-4c87-95b1-5cf9afa20f24 could not be found. Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0f2e9a73-4b7d-44a2-a8dc-619f282cba4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Request method failure captured: Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 HTTP/1.1 Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGnT74k3jz6Wa3pVJ9ZcmChqa1oL8HCHZkX6SpHPwSHLQBVyzr9Zeld4-bJk6nTBopnJ7frY84hkg0yHAgEYqC7YxphYQ1Zc_oeJrc_LnVexerBe0ggImFM7jD1c56DBEpM-m7xTb4GcdGxbn6BPhealjMNmOuwebHjUGz1MpRwC9WI Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Openstack-Nova-Api-Version: 2.25 Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 8ca11fe18cc64adfbc06166601106c7c Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-601943355 Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ca11fe18cc64adfbc06166601106c7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ca11fe18cc64adfbc06166601106c7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ca11fe18cc64adfbc06166601106c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ca11fe18cc64adfbc06166601106c7c"}]}] Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-601943355 Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 8ca11fe18cc64adfbc06166601106c7c Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-601943355 Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-LiveAutoBlockMigrationV225Test-601943355-project Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 789ef7a66ff042b9abebe36823008f8f Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-601943355-project Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance fce27ab7-7a56-4c87-95b1-5cf9afa20f24 could not be found. Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'fce27ab7-7a56-4c87-95b1-5cf9afa20f24'} Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce27ab7-7a56-4c87-95b1-5cf9afa20f24 could not be found. Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce27ab7-7a56-4c87-95b1-5cf9afa20f24 could not be found. Oct 10 18:59:29.910714 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:29.915661 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:29.915661 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:29.915661 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:29.915661 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:29.915661 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:29.915661 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:59:29.915661 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:59:29.915661 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce27ab7-7a56-4c87-95b1-5cf9afa20f24 could not be found. Oct 10 18:59:29.915661 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:29.915661 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0f2e9a73-4b7d-44a2-a8dc-619f282cba4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Returning 404 to user: Instance fce27ab7-7a56-4c87-95b1-5cf9afa20f24 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:59:29.927841 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0f2e9a73-4b7d-44a2-a8dc-619f282cba4c tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24" status: 404 len: 111 microversion: 2.25 time: 0.090462 Oct 10 18:59:29.931894 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1036/2316] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:29 2022] GET /compute/v2.1/servers/fce27ab7-7a56-4c87-95b1-5cf9afa20f24 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:59:30.329009 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-21443105-416f-49e0-a661-98cf06f5ab9d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319220f4c0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:30.870274 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:59:30.871223 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:59:30.871865 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:59:30.871986 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-21443105-416f-49e0-a661-98cf06f5ab9d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.552040 Oct 10 18:59:30.872486 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1037/2317] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:30 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:30.881428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:59:30.881834 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:59:30.909902 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:30.910394 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:30.910893 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:30.912935 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:30.913413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:30.913847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:30.992677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Getting quotas for project e2cfbbf586f5441e80930980df18d471. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:59:31.019349 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Getting quotas for user b83cb923e3064ac7aeb1bd6883415e9f and project e2cfbbf586f5441e80930980df18d471. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:59:31.069835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:59:31.075706 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:59:31.266461 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b228394c-9dbb-4179-b8db-52db46baec83 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.675714 Oct 10 18:59:31.267394 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1281/2318] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:59:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:59:31.279481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4cdb8436-31bb-4d10-95ed-6aefb9feb7fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:31.280104 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4cdb8436-31bb-4d10-95ed-6aefb9feb7fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:31.779533 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4cdb8436-31bb-4d10-95ed-6aefb9feb7fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:31.781294 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4cdb8436-31bb-4d10-95ed-6aefb9feb7fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1218 microversion: 2.1 time: 0.505877 Oct 10 18:59:31.790218 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1038/2319] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:31 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1218 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:31.888158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2352de75-17c8-4b8e-a471-0054eb7c296d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318deb7310>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:31.968691 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2352de75-17c8-4b8e-a471-0054eb7c296d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.084543 Oct 10 18:59:31.969954 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1282/2320] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:31 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:32.815866 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-31b337aa-87b0-42d4-a3e6-52242c56b440 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:32.817117 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-31b337aa-87b0-42d4-a3e6-52242c56b440 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:32.984507 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-dd24ef1c-3856-4a6d-bb16-6edd8d48fa72 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318e2cec10>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:33.064066 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-dd24ef1c-3856-4a6d-bb16-6edd8d48fa72 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.083273 Oct 10 18:59:33.067015 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1283/2321] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:32 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:33.214846 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-31b337aa-87b0-42d4-a3e6-52242c56b440 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:33.215672 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-31b337aa-87b0-42d4-a3e6-52242c56b440 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1218 microversion: 2.1 time: 0.403875 Oct 10 18:59:33.237414 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1039/2322] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:32 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1218 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:34.087363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5aea6dad-c5a0-4e38-aa44-f64dcf213551 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318deb7ee0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:34.180062 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5aea6dad-c5a0-4e38-aa44-f64dcf213551 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.104692 Oct 10 18:59:34.186799 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1284/2323] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:34 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:34.244165 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-34308633-d8b9-4a5f-a266-53c1abb5a016 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:34.244808 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-34308633-d8b9-4a5f-a266-53c1abb5a016 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:34.255671 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-34308633-d8b9-4a5f-a266-53c1abb5a016 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:34.255846 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-34308633-d8b9-4a5f-a266-53c1abb5a016 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:34.256166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-34308633-d8b9-4a5f-a266-53c1abb5a016 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:34.256913 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-34308633-d8b9-4a5f-a266-53c1abb5a016 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:34.257367 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-34308633-d8b9-4a5f-a266-53c1abb5a016 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:34.260752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-34308633-d8b9-4a5f-a266-53c1abb5a016 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:34.886506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-34308633-d8b9-4a5f-a266-53c1abb5a016 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:34.901178 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-34308633-d8b9-4a5f-a266-53c1abb5a016 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1214 microversion: 2.1 time: 0.658688 Oct 10 18:59:34.914232 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1040/2324] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:34 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1214 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:35.196051 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9fd61c42-82a7-401f-a74f-49b0b1b3995a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921dc8b0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:35.754220 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9fd61c42-82a7-401f-a74f-49b0b1b3995a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.557770 Oct 10 18:59:35.764986 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1285/2325] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:35 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:35.932283 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-26c5e13c-f4ea-4b60-9851-3a08c68eb23e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:35.932930 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-26c5e13c-f4ea-4b60-9851-3a08c68eb23e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:35.947578 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26c5e13c-f4ea-4b60-9851-3a08c68eb23e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:35.949550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26c5e13c-f4ea-4b60-9851-3a08c68eb23e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:35.950867 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26c5e13c-f4ea-4b60-9851-3a08c68eb23e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:35.969125 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26c5e13c-f4ea-4b60-9851-3a08c68eb23e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:35.973770 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26c5e13c-f4ea-4b60-9851-3a08c68eb23e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:35.974324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26c5e13c-f4ea-4b60-9851-3a08c68eb23e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:36.176520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-26c5e13c-f4ea-4b60-9851-3a08c68eb23e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:36.185626 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-26c5e13c-f4ea-4b60-9851-3a08c68eb23e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1278 microversion: 2.1 time: 0.258092 Oct 10 18:59:36.191664 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1041/2326] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:35 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:36.775647 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e21b0264-45bb-41a7-aab4-1cdccbf045a9 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318ddbc280>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:36.882520 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e21b0264-45bb-41a7-aab4-1cdccbf045a9 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.116275 Oct 10 18:59:36.887059 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1286/2327] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:36 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:37.220658 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4c3f7c45-672a-46a6-8b7e-17ab8c29f823 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:37.221316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4c3f7c45-672a-46a6-8b7e-17ab8c29f823 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:37.243027 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c3f7c45-672a-46a6-8b7e-17ab8c29f823 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:37.245033 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c3f7c45-672a-46a6-8b7e-17ab8c29f823 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:37.248285 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c3f7c45-672a-46a6-8b7e-17ab8c29f823 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:37.255884 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c3f7c45-672a-46a6-8b7e-17ab8c29f823 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:37.258431 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c3f7c45-672a-46a6-8b7e-17ab8c29f823 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:37.263946 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4c3f7c45-672a-46a6-8b7e-17ab8c29f823 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:37.545185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4c3f7c45-672a-46a6-8b7e-17ab8c29f823 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:37.562091 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4c3f7c45-672a-46a6-8b7e-17ab8c29f823 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1276 microversion: 2.1 time: 0.344848 Oct 10 18:59:37.566575 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1042/2328] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:37 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1276 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:37.903626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bff070b2-cc0b-4845-97f5-106435341647 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921dcc10>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:38.020813 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bff070b2-cc0b-4845-97f5-106435341647 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.117873 Oct 10 18:59:38.020813 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1287/2329] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:37 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:38.107416 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1271823087", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "3a76f1a7-ba6a-4668-83ac-16b121b4f649"}, {"uuid": "903ea8b3-43b5-4a4f-8728-c334a152bb89"}, {"uuid": "3a76f1a7-ba6a-4668-83ac-16b121b4f649"}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:38.289023 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] validate_networks() for [('3a76f1a7-ba6a-4668-83ac-16b121b4f649', None, None, None, None, None), ('903ea8b3-43b5-4a4f-8728-c334a152bb89', None, None, None, None, None), ('3a76f1a7-ba6a-4668-83ac-16b121b4f649', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:59:38.591477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bdc49c6f-2c71-48e0-a750-092cc7da3f48 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:38.592382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bdc49c6f-2c71-48e0-a750-092cc7da3f48 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:38.619121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bdc49c6f-2c71-48e0-a750-092cc7da3f48 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:38.625714 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bdc49c6f-2c71-48e0-a750-092cc7da3f48 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:38.626153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bdc49c6f-2c71-48e0-a750-092cc7da3f48 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:38.636987 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bdc49c6f-2c71-48e0-a750-092cc7da3f48 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:38.645084 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bdc49c6f-2c71-48e0-a750-092cc7da3f48 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:38.645084 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bdc49c6f-2c71-48e0-a750-092cc7da3f48 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:39.529257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bdc49c6f-2c71-48e0-a750-092cc7da3f48 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:39.564470 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bdc49c6f-2c71-48e0-a750-092cc7da3f48 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1318 microversion: 2.1 time: 0.977696 Oct 10 18:59:39.576250 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1288/2330] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:38 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1318 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:59:39.607151 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-62292516-99e3-4da6-8b29-50d0c89f4179 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318ddc3790>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:39.721044 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-62292516-99e3-4da6-8b29-50d0c89f4179 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.145250 Oct 10 18:59:39.730346 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1289/2331] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:39 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:39.735775 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cf20cb13-cf98-4388-8a49-641f530b4ba4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:39.740254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cf20cb13-cf98-4388-8a49-641f530b4ba4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:39.746927 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cf20cb13-cf98-4388-8a49-641f530b4ba4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:39.748212 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cf20cb13-cf98-4388-8a49-641f530b4ba4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:39.748928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cf20cb13-cf98-4388-8a49-641f530b4ba4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:39.749927 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cf20cb13-cf98-4388-8a49-641f530b4ba4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:39.750626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cf20cb13-cf98-4388-8a49-641f530b4ba4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:39.751276 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cf20cb13-cf98-4388-8a49-641f530b4ba4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:39.815447 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cf20cb13-cf98-4388-8a49-641f530b4ba4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:59:40.618524 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cf20cb13-cf98-4388-8a49-641f530b4ba4 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "DELETE /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 204 len: 0 microversion: 2.25 time: 0.886423 Oct 10 18:59:40.621275 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1290/2332] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:59:39 2022] DELETE /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 18:59:40.637511 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8cc7bfd6-3bf1-4747-b1dc-cbbc2618e3f1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:40.638377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8cc7bfd6-3bf1-4747-b1dc-cbbc2618e3f1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:40.654806 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8cc7bfd6-3bf1-4747-b1dc-cbbc2618e3f1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:40.663165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8cc7bfd6-3bf1-4747-b1dc-cbbc2618e3f1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:40.663646 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8cc7bfd6-3bf1-4747-b1dc-cbbc2618e3f1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:40.664408 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8cc7bfd6-3bf1-4747-b1dc-cbbc2618e3f1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:40.665076 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8cc7bfd6-3bf1-4747-b1dc-cbbc2618e3f1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:40.665797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8cc7bfd6-3bf1-4747-b1dc-cbbc2618e3f1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:40.939263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:41.058417 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=12 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:42.125024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8cc7bfd6-3bf1-4747-b1dc-cbbc2618e3f1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:42.143079 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8cc7bfd6-3bf1-4747-b1dc-cbbc2618e3f1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1318 microversion: 2.1 time: 1.518931 Oct 10 18:59:42.145341 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1291/2333] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:40 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1318 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:42.175124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-dbd6200f-59b8-4e55-88ff-c6fccb0e8c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:42.175124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-dbd6200f-59b8-4e55-88ff-c6fccb0e8c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:42.185893 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:42.189731 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dbd6200f-59b8-4e55-88ff-c6fccb0e8c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:42.196773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dbd6200f-59b8-4e55-88ff-c6fccb0e8c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:42.198675 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dbd6200f-59b8-4e55-88ff-c6fccb0e8c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:42.201558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dbd6200f-59b8-4e55-88ff-c6fccb0e8c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:42.206573 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dbd6200f-59b8-4e55-88ff-c6fccb0e8c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:42.207258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dbd6200f-59b8-4e55-88ff-c6fccb0e8c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:42.895189 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dbd6200f-59b8-4e55-88ff-c6fccb0e8c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:42.909961 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dbd6200f-59b8-4e55-88ff-c6fccb0e8c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:42.911467 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dbd6200f-59b8-4e55-88ff-c6fccb0e8c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:42.921268 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-dbd6200f-59b8-4e55-88ff-c6fccb0e8c59 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1731 microversion: 2.25 time: 0.771675 Oct 10 18:59:42.923508 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1292/2334] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:42 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1731 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:42.935114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-191645af-b97b-4ae8-a0d1-b09fecbff960 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31923844c0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:43.031093 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-191645af-b97b-4ae8-a0d1-b09fecbff960 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.106169 Oct 10 18:59:43.033981 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1293/2335] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:42 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:43.215877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=4 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:43.322531 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1561889264", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "2644db74-48bc-4b4d-b64d-989a0dce66e9"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:43.503490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] validate_networks() for [('2644db74-48bc-4b4d-b64d-989a0dce66e9', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:59:43.540719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:59:43.544905 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:59:43.545715 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:59:43.546347 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:59:43.546973 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:59:43.563485 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:43.568898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:43.569652 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:43.570653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:43.571335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:43.572686 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:43.627141 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Getting quotas for project 1206fcb7f08f4c09a019a4a560ccac71. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:59:43.642285 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Getting quotas for user f5d2fecfd1eb43dc9e050393017dede3 and project 1206fcb7f08f4c09a019a4a560ccac71. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:59:43.669599 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:59:43.672272 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:59:43.862508 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7b71fec6-6524-405e-abd9-c3b9035e0024 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.759696 Oct 10 18:59:43.864921 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1043/2336] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:59:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 5765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:59:43.881351 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bacd2a7b-3474-4dce-a9f6-7ef08520bfee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:43.885078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bacd2a7b-3474-4dce-a9f6-7ef08520bfee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:43.907490 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bacd2a7b-3474-4dce-a9f6-7ef08520bfee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:43.909580 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bacd2a7b-3474-4dce-a9f6-7ef08520bfee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:43.910497 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bacd2a7b-3474-4dce-a9f6-7ef08520bfee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:43.953544 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bacd2a7b-3474-4dce-a9f6-7ef08520bfee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:43.956170 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bacd2a7b-3474-4dce-a9f6-7ef08520bfee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:43.960233 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bacd2a7b-3474-4dce-a9f6-7ef08520bfee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:44.654863 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bacd2a7b-3474-4dce-a9f6-7ef08520bfee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:44.677406 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bacd2a7b-3474-4dce-a9f6-7ef08520bfee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1318 microversion: 2.1 time: 0.797640 Oct 10 18:59:44.677406 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1044/2337] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:43 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1318 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:44.705051 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5e2b0123-3fc6-43af-8828-e6b2766081d3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:44.705748 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5e2b0123-3fc6-43af-8828-e6b2766081d3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:44.860035 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5e2b0123-3fc6-43af-8828-e6b2766081d3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:44.883045 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5e2b0123-3fc6-43af-8828-e6b2766081d3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1213 microversion: 2.1 time: 0.203594 Oct 10 18:59:44.885798 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1045/2338] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:44 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1213 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:44.910550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-eaeadb21-92ec-43bf-a2fb-1d9fdc63de8f req-c122983f-dfcb-4ea8-b280-85237d135974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "625d4b03-2441-4576-a0e2-6c266b24b1e9", "tag": "f2875240-f490-44c6-8bd6-6fe609be5a6c"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:44.941747 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-eaeadb21-92ec-43bf-a2fb-1d9fdc63de8f req-c122983f-dfcb-4ea8-b280-85237d135974 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:44.942535 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-eaeadb21-92ec-43bf-a2fb-1d9fdc63de8f req-c122983f-dfcb-4ea8-b280-85237d135974 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:44.946058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-eaeadb21-92ec-43bf-a2fb-1d9fdc63de8f req-c122983f-dfcb-4ea8-b280-85237d135974 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:45.015265 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-eaeadb21-92ec-43bf-a2fb-1d9fdc63de8f req-c122983f-dfcb-4ea8-b280-85237d135974 service nova] Creating event network-changed:f2875240-f490-44c6-8bd6-6fe609be5a6c for instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 on n-h2-860863-1 Oct 10 18:59:45.031120 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-eaeadb21-92ec-43bf-a2fb-1d9fdc63de8f req-c122983f-dfcb-4ea8-b280-85237d135974 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140645 Oct 10 18:59:45.033155 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1046/2339] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:45.050859 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-22fc28f4-adf2-41bc-bfdc-ce0bc694629e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:45.055299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-22fc28f4-adf2-41bc-bfdc-ce0bc694629e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:45.072774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22fc28f4-adf2-41bc-bfdc-ce0bc694629e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:45.073673 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22fc28f4-adf2-41bc-bfdc-ce0bc694629e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:45.081871 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22fc28f4-adf2-41bc-bfdc-ce0bc694629e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:45.081871 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22fc28f4-adf2-41bc-bfdc-ce0bc694629e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:45.081871 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22fc28f4-adf2-41bc-bfdc-ce0bc694629e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:45.081871 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-22fc28f4-adf2-41bc-bfdc-ce0bc694629e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:45.200749 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-22fc28f4-adf2-41bc-bfdc-ce0bc694629e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:45.251774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-22fc28f4-adf2-41bc-bfdc-ce0bc694629e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:45.268945 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-22fc28f4-adf2-41bc-bfdc-ce0bc694629e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:45.271449 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-22fc28f4-adf2-41bc-bfdc-ce0bc694629e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1663 microversion: 2.25 time: 0.235659 Oct 10 18:59:45.291134 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1047/2340] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:45 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1663 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:45.306790 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c487197f-f6c8-41d7-bbb6-4833100451fc tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319221f160>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:45.372707 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c487197f-f6c8-41d7-bbb6-4833100451fc tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.079096 Oct 10 18:59:45.382248 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1048/2341] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:45 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:45.691381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-709dbd72-0642-4731-a63c-ecf2d9401aa4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:45.691998 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-709dbd72-0642-4731-a63c-ecf2d9401aa4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:45.694545 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:45.721144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:59:45.721653 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:59:45.722267 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:59:45.722780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:59:45.723747 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:59:45.729717 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-709dbd72-0642-4731-a63c-ecf2d9401aa4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:45.738950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-709dbd72-0642-4731-a63c-ecf2d9401aa4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:45.738950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-709dbd72-0642-4731-a63c-ecf2d9401aa4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:45.739973 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-709dbd72-0642-4731-a63c-ecf2d9401aa4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:45.744861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-709dbd72-0642-4731-a63c-ecf2d9401aa4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:45.746325 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-709dbd72-0642-4731-a63c-ecf2d9401aa4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:45.757535 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:45.758317 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:45.759771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:45.760830 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:45.763837 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:45.767603 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:45.825232 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Getting quotas for project b94e8833aa35458ea401de2ae6b0ba12. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:59:45.848423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Getting quotas for user adb4474eb77141ce942d1ad170fee56b and project b94e8833aa35458ea401de2ae6b0ba12. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:59:45.890881 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:59:45.899664 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:59:46.130104 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c44ba1a4-f6c9-435a-93b1-c49e53554166 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.094715 Oct 10 18:59:46.134031 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1294/2342] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:59:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:59:46.153693 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-dd7a5476-aa3f-4d0c-b83b-d416066adc2f req-babf4cc8-db35-49eb-b87e-44c73056a3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d79eab-1807-4467-b325-fe5f723ac559", "name": "network-vif-deleted", "tag": "d4cf66ab-04c3-441b-9f60-e83abdbe71aa"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:46.170683 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-709dbd72-0642-4731-a63c-ecf2d9401aa4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:46.185777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-dd7a5476-aa3f-4d0c-b83b-d416066adc2f req-babf4cc8-db35-49eb-b87e-44c73056a3c6 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:46.187080 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-709dbd72-0642-4731-a63c-ecf2d9401aa4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1318 microversion: 2.1 time: 0.500762 Oct 10 18:59:46.192966 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-dd7a5476-aa3f-4d0c-b83b-d416066adc2f req-babf4cc8-db35-49eb-b87e-44c73056a3c6 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:46.194232 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-dd7a5476-aa3f-4d0c-b83b-d416066adc2f req-babf4cc8-db35-49eb-b87e-44c73056a3c6 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:46.194648 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1049/2343] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:45 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:46.215571 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-36ffe747-d00d-4ee0-a8e5-d7ba240d9509 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:46.221868 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-36ffe747-d00d-4ee0-a8e5-d7ba240d9509 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:46.247273 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-dd7a5476-aa3f-4d0c-b83b-d416066adc2f req-babf4cc8-db35-49eb-b87e-44c73056a3c6 service nova] Creating event network-vif-deleted:d4cf66ab-04c3-441b-9f60-e83abdbe71aa for instance 96d79eab-1807-4467-b325-fe5f723ac559 on n-h2-860863-1 Oct 10 18:59:46.271528 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-dd7a5476-aa3f-4d0c-b83b-d416066adc2f req-babf4cc8-db35-49eb-b87e-44c73056a3c6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128467 Oct 10 18:59:46.271528 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1295/2344] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:46.315508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1ba70b85-e39f-494e-98f8-da69fcf0adac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:46.316149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1ba70b85-e39f-494e-98f8-da69fcf0adac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:46.333952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba70b85-e39f-494e-98f8-da69fcf0adac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:46.341126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba70b85-e39f-494e-98f8-da69fcf0adac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:46.341884 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba70b85-e39f-494e-98f8-da69fcf0adac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:46.345963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba70b85-e39f-494e-98f8-da69fcf0adac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:46.345963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba70b85-e39f-494e-98f8-da69fcf0adac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:46.345963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1ba70b85-e39f-494e-98f8-da69fcf0adac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:46.390417 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-36ffe747-d00d-4ee0-a8e5-d7ba240d9509 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:46.398669 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-36ffe747-d00d-4ee0-a8e5-d7ba240d9509 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1213 microversion: 2.1 time: 0.202811 Oct 10 18:59:46.421232 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1050/2345] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:46 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1213 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:46.433543 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-598e5bd6-ae62-4e0d-a11c-32b46e884a46 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921c6dc0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:46.528150 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-598e5bd6-ae62-4e0d-a11c-32b46e884a46 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.105354 Oct 10 18:59:46.540680 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1051/2346] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:46 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:46.547285 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1577818128", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "2644db74-48bc-4b4d-b64d-989a0dce66e9"}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:46.690292 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] validate_networks() for [('2644db74-48bc-4b4d-b64d-989a0dce66e9', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:59:46.929728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1ba70b85-e39f-494e-98f8-da69fcf0adac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:46.946476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1ba70b85-e39f-494e-98f8-da69fcf0adac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:46.947998 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1ba70b85-e39f-494e-98f8-da69fcf0adac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:46.961073 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1ba70b85-e39f-494e-98f8-da69fcf0adac tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 200 len: 1663 microversion: 2.25 time: 0.645057 Oct 10 18:59:46.965029 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1296/2347] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:46 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 1663 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:47.220967 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-65909b68-2761-47d5-9330-8dc62382086d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:47.220967 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-65909b68-2761-47d5-9330-8dc62382086d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:47.224107 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65909b68-2761-47d5-9330-8dc62382086d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:47.234157 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65909b68-2761-47d5-9330-8dc62382086d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:47.236986 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65909b68-2761-47d5-9330-8dc62382086d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:47.237865 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65909b68-2761-47d5-9330-8dc62382086d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:47.238499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65909b68-2761-47d5-9330-8dc62382086d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:47.238972 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65909b68-2761-47d5-9330-8dc62382086d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:47.755181 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:59:47.757767 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:59:47.758427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:59:47.759005 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:59:47.759680 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:59:47.780574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:47.784390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:47.785093 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:47.787381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:47.789323 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:47.792029 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:47.850972 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Getting quotas for project b94e8833aa35458ea401de2ae6b0ba12. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:59:47.862498 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Getting quotas for user adb4474eb77141ce942d1ad170fee56b and project b94e8833aa35458ea401de2ae6b0ba12. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:59:47.899178 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:59:47.907135 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: c22fa54d-372c-4887-8875-a3c56b3850b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:59:48.119750 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6ebe5e7b-db0a-4680-b151-ef5ef7843a53 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576451 Oct 10 18:59:48.123942 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1052/2348] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:59:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:59:48.150170 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d3193589-c5c4-4988-a162-c3c28f8d9bb3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:48.157394 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d3193589-c5c4-4988-a162-c3c28f8d9bb3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:48.183784 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3193589-c5c4-4988-a162-c3c28f8d9bb3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:48.187481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3193589-c5c4-4988-a162-c3c28f8d9bb3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:48.189957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3193589-c5c4-4988-a162-c3c28f8d9bb3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:48.194204 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3193589-c5c4-4988-a162-c3c28f8d9bb3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:48.195664 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3193589-c5c4-4988-a162-c3c28f8d9bb3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:48.196935 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d3193589-c5c4-4988-a162-c3c28f8d9bb3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:48.381558 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d3193589-c5c4-4988-a162-c3c28f8d9bb3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:48.390081 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d3193589-c5c4-4988-a162-c3c28f8d9bb3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1265 microversion: 2.1 time: 0.263283 Oct 10 18:59:48.394102 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1053/2349] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:48 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:48.404401 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dc124c45-75da-4010-82bf-33ba4fd4a45f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319225d940>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:48.496696 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dc124c45-75da-4010-82bf-33ba4fd4a45f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.101218 Oct 10 18:59:48.504920 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1054/2350] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:48 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:48.519270 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2866bf37-5b80-4ebe-ab9b-f6690ba0bc22 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:48.522320 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2866bf37-5b80-4ebe-ab9b-f6690ba0bc22 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 96d79eab-1807-4467-b325-fe5f723ac559] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:48.541677 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2866bf37-5b80-4ebe-ab9b-f6690ba0bc22 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:48.548296 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2866bf37-5b80-4ebe-ab9b-f6690ba0bc22 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:48.548296 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2866bf37-5b80-4ebe-ab9b-f6690ba0bc22 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:48.548296 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2866bf37-5b80-4ebe-ab9b-f6690ba0bc22 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:48.548296 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2866bf37-5b80-4ebe-ab9b-f6690ba0bc22 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:48.548296 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2866bf37-5b80-4ebe-ab9b-f6690ba0bc22 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:48.604016 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-2866bf37-5b80-4ebe-ab9b-f6690ba0bc22 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] HTTP exception thrown: Instance 96d79eab-1807-4467-b325-fe5f723ac559 could not be found. Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2866bf37-5b80-4ebe-ab9b-f6690ba0bc22 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Request method failure captured: Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 HTTP/1.1 Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGnT74k3jz6Wa3pVJ9ZcmChqa1oL8HCHZkX6SpHPwSHLQBVyzr9Zeld4-bJk6nTBopnJ7frY84hkg0yHAgEYqC7YxphYQ1Zc_oeJrc_LnVexerBe0ggImFM7jD1c56DBEpM-m7xTb4GcdGxbn6BPhealjMNmOuwebHjUGz1MpRwC9WI Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Openstack-Nova-Api-Version: 2.25 Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 8ca11fe18cc64adfbc06166601106c7c Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-601943355 Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ca11fe18cc64adfbc06166601106c7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ca11fe18cc64adfbc06166601106c7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ca11fe18cc64adfbc06166601106c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ca11fe18cc64adfbc06166601106c7c"}]}] Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-601943355 Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 8ca11fe18cc64adfbc06166601106c7c Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-601943355 Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-LiveAutoBlockMigrationV225Test-601943355-project Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 789ef7a66ff042b9abebe36823008f8f Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-601943355-project Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 96d79eab-1807-4467-b325-fe5f723ac559 could not be found. Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '96d79eab-1807-4467-b325-fe5f723ac559'} Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96d79eab-1807-4467-b325-fe5f723ac559 could not be found. Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96d79eab-1807-4467-b325-fe5f723ac559 could not be found. Oct 10 18:59:48.617555 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:48.622868 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:48.622868 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:48.622868 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:48.622868 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:48.622868 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:48.622868 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:59:48.622868 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:59:48.622868 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96d79eab-1807-4467-b325-fe5f723ac559 could not be found. Oct 10 18:59:48.622868 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:48.622868 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2866bf37-5b80-4ebe-ab9b-f6690ba0bc22 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Returning 404 to user: Instance 96d79eab-1807-4467-b325-fe5f723ac559 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:59:48.622868 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2866bf37-5b80-4ebe-ab9b-f6690ba0bc22 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559" status: 404 len: 111 microversion: 2.25 time: 0.120659 Oct 10 18:59:48.627548 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1055/2351] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:48 2022] GET /compute/v2.1/servers/96d79eab-1807-4467-b325-fe5f723ac559 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:59:48.645625 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-366220648", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "451", "networks": [{"uuid": "2644db74-48bc-4b4d-b64d-989a0dce66e9"}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:48.773044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] validate_networks() for [('2644db74-48bc-4b4d-b64d-989a0dce66e9', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:59:49.464106 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-65909b68-2761-47d5-9330-8dc62382086d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:49.475550 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-65909b68-2761-47d5-9330-8dc62382086d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1318 microversion: 2.1 time: 2.264726 Oct 10 18:59:49.494869 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1297/2352] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:47 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1318 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:59:49.500565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0a6f27b4-29d0-461f-9276-09634f8ff6f2 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '.version_select at 0x7f318e7e85e0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:49.673442 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:59:49.674118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:59:49.674757 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:59:49.675479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:59:49.676636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:59:49.676744 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0a6f27b4-29d0-461f-9276-09634f8ff6f2 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-292837945" status: 204 len: 0 microversion: 2.25 time: 0.179945 Oct 10 18:59:49.681729 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1298/2353] 10.222.0.43 () {60 vars in 1259 bytes} [Mon Oct 10 18:59:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-292837945 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 18:59:49.687400 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c757742d-c6f6-488e-9e01-ad0852714b77 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:49.690545 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c757742d-c6f6-488e-9e01-ad0852714b77 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:49.704861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:49.707507 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:49.708160 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:49.708579 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c757742d-c6f6-488e-9e01-ad0852714b77 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:49.709417 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c757742d-c6f6-488e-9e01-ad0852714b77 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:49.709734 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:49.711518 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c757742d-c6f6-488e-9e01-ad0852714b77 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:49.713193 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c757742d-c6f6-488e-9e01-ad0852714b77 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:49.713385 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:49.714131 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:49.715457 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c757742d-c6f6-488e-9e01-ad0852714b77 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:49.717778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c757742d-c6f6-488e-9e01-ad0852714b77 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:49.738716 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=89 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:49.768044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Getting quotas for project b94e8833aa35458ea401de2ae6b0ba12. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:59:49.782596 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Getting quotas for user adb4474eb77141ce942d1ad170fee56b and project b94e8833aa35458ea401de2ae6b0ba12. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:59:49.834941 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:59:49.839650 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:59:49.904189 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c757742d-c6f6-488e-9e01-ad0852714b77 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:49.921602 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c757742d-c6f6-488e-9e01-ad0852714b77 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1271 microversion: 2.1 time: 0.233020 Oct 10 18:59:49.933217 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1299/2354] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:49 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1271 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:49.953745 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fca41bf1-a7e6-436f-a04e-b4d642be4181 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318ddbde50>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:50.041051 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fca41bf1-a7e6-436f-a04e-b4d642be4181 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.105547 Oct 10 18:59:50.048307 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1300/2355] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:49 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:50.109497 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-db635eb8-5fce-467b-b6e8-33739457e57c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.477928 Oct 10 18:59:50.119884 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1056/2356] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:59:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:59:50.124983 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d481c4e8-d0b2-40c6-86bf-dd94e9dc46da tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:50.126275 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d481c4e8-d0b2-40c6-86bf-dd94e9dc46da tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:50.277815 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d481c4e8-d0b2-40c6-86bf-dd94e9dc46da tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:50.297393 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d481c4e8-d0b2-40c6-86bf-dd94e9dc46da tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1220 microversion: 2.1 time: 0.173844 Oct 10 18:59:50.300922 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1301/2357] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:50 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1220 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:59:50.503145 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-522fe4ab-f3b4-4521-bfb1-60ab27f9846e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:50.506471 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-522fe4ab-f3b4-4521-bfb1-60ab27f9846e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:50.517392 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-522fe4ab-f3b4-4521-bfb1-60ab27f9846e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:50.519496 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-522fe4ab-f3b4-4521-bfb1-60ab27f9846e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:50.520184 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-522fe4ab-f3b4-4521-bfb1-60ab27f9846e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:50.524317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-522fe4ab-f3b4-4521-bfb1-60ab27f9846e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:50.526475 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-522fe4ab-f3b4-4521-bfb1-60ab27f9846e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:50.527902 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-522fe4ab-f3b4-4521-bfb1-60ab27f9846e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:50.948219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-434c1b21-0b7d-4c54-85bc-97892cdaedf7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:50.949535 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-434c1b21-0b7d-4c54-85bc-97892cdaedf7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:50.973688 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-434c1b21-0b7d-4c54-85bc-97892cdaedf7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:50.974624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-434c1b21-0b7d-4c54-85bc-97892cdaedf7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:50.975223 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-434c1b21-0b7d-4c54-85bc-97892cdaedf7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:50.976426 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-434c1b21-0b7d-4c54-85bc-97892cdaedf7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:50.983034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-434c1b21-0b7d-4c54-85bc-97892cdaedf7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:50.990890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-434c1b21-0b7d-4c54-85bc-97892cdaedf7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:51.042836 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:51.289838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-434c1b21-0b7d-4c54-85bc-97892cdaedf7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:51.306468 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-434c1b21-0b7d-4c54-85bc-97892cdaedf7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1271 microversion: 2.1 time: 0.363121 Oct 10 18:59:51.307510 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1302/2358] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:50 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1271 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:59:51.321495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-17efae51-cdf5-4416-b394-3d548ffe80e7 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318ddbde50>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:51.432912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-522fe4ab-f3b4-4521-bfb1-60ab27f9846e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:51.463952 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-522fe4ab-f3b4-4521-bfb1-60ab27f9846e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1318 microversion: 2.1 time: 0.948104 Oct 10 18:59:51.477167 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1057/2359] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:50 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1318 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:51.483377 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-17efae51-cdf5-4416-b394-3d548ffe80e7 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.168895 Oct 10 18:59:51.487576 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1303/2360] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:51 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:51.497573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0d3ad8ea-9490-4862-8e21-6ccdb68b75b1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:51.668725 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0d3ad8ea-9490-4862-8e21-6ccdb68b75b1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:51.671122 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0d3ad8ea-9490-4862-8e21-6ccdb68b75b1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:51.680713 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0d3ad8ea-9490-4862-8e21-6ccdb68b75b1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1220 microversion: 2.1 time: 0.194632 Oct 10 18:59:51.682083 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1058/2361] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:51 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1220 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:52.124134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3e58783f-cc14-4657-b776-ecaf1a440e06 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:52.124919 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3e58783f-cc14-4657-b776-ecaf1a440e06 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:52.138792 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e58783f-cc14-4657-b776-ecaf1a440e06 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:52.151124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e58783f-cc14-4657-b776-ecaf1a440e06 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:52.153217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e58783f-cc14-4657-b776-ecaf1a440e06 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:52.155962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e58783f-cc14-4657-b776-ecaf1a440e06 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:52.169825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e58783f-cc14-4657-b776-ecaf1a440e06 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:52.171328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3e58783f-cc14-4657-b776-ecaf1a440e06 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:52.298044 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3e58783f-cc14-4657-b776-ecaf1a440e06 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:59:52.329968 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-37fe5a78-f932-4e3f-8280-35a3f8a2fb66 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:52.330974 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-37fe5a78-f932-4e3f-8280-35a3f8a2fb66 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:52.366622 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37fe5a78-f932-4e3f-8280-35a3f8a2fb66 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:52.367373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37fe5a78-f932-4e3f-8280-35a3f8a2fb66 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:52.369772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37fe5a78-f932-4e3f-8280-35a3f8a2fb66 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:52.375147 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37fe5a78-f932-4e3f-8280-35a3f8a2fb66 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:52.379082 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37fe5a78-f932-4e3f-8280-35a3f8a2fb66 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:52.381689 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37fe5a78-f932-4e3f-8280-35a3f8a2fb66 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:52.972198 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3e58783f-cc14-4657-b776-ecaf1a440e06 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 204 len: 0 microversion: 2.25 time: 0.853268 Oct 10 18:59:52.979058 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1304/2362] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:59:52 2022] DELETE /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 18:59:52.984859 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-456334ab-dda5-4700-af6e-392a4e7c0921 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318df914c0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:53.084719 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-456334ab-dda5-4700-af6e-392a4e7c0921 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1455 microversion: 2.1 time: 0.103941 Oct 10 18:59:53.093890 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1305/2363] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:52 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:53.106874 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1e02bae4-4cde-4552-b4a9-d69eeba1eb59 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:53.108075 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1e02bae4-4cde-4552-b4a9-d69eeba1eb59 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:53.128480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e02bae4-4cde-4552-b4a9-d69eeba1eb59 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:53.142419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e02bae4-4cde-4552-b4a9-d69eeba1eb59 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:53.143153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e02bae4-4cde-4552-b4a9-d69eeba1eb59 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:53.144154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e02bae4-4cde-4552-b4a9-d69eeba1eb59 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:53.144904 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e02bae4-4cde-4552-b4a9-d69eeba1eb59 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:53.146307 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1e02bae4-4cde-4552-b4a9-d69eeba1eb59 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:53.715282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1e02bae4-4cde-4552-b4a9-d69eeba1eb59 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:53.716872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-37fe5a78-f932-4e3f-8280-35a3f8a2fb66 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:53.725629 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1e02bae4-4cde-4552-b4a9-d69eeba1eb59 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1318 microversion: 2.1 time: 0.630217 Oct 10 18:59:53.729314 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1306/2364] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:53 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:53.734246 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-37fe5a78-f932-4e3f-8280-35a3f8a2fb66 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1313 microversion: 2.1 time: 1.408001 Oct 10 18:59:53.737699 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1059/2365] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:52 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1313 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:53.740500 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-969fa48e-f3b6-42aa-a9b7-b9d9a1ddf7b4 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:53.743953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-969fa48e-f3b6-42aa-a9b7-b9d9a1ddf7b4 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:53.752868 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d47d4ee8-ac06-4079-bd3a-949fabe12204 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:53.753761 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d47d4ee8-ac06-4079-bd3a-949fabe12204 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:53.754800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-969fa48e-f3b6-42aa-a9b7-b9d9a1ddf7b4 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:53.756859 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-969fa48e-f3b6-42aa-a9b7-b9d9a1ddf7b4 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:53.759214 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-969fa48e-f3b6-42aa-a9b7-b9d9a1ddf7b4 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:53.760218 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-969fa48e-f3b6-42aa-a9b7-b9d9a1ddf7b4 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:53.760880 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-969fa48e-f3b6-42aa-a9b7-b9d9a1ddf7b4 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:53.762397 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-969fa48e-f3b6-42aa-a9b7-b9d9a1ddf7b4 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:53.769563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d47d4ee8-ac06-4079-bd3a-949fabe12204 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:53.770211 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d47d4ee8-ac06-4079-bd3a-949fabe12204 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:53.772279 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d47d4ee8-ac06-4079-bd3a-949fabe12204 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:53.774968 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d47d4ee8-ac06-4079-bd3a-949fabe12204 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:53.775535 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d47d4ee8-ac06-4079-bd3a-949fabe12204 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:53.775967 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d47d4ee8-ac06-4079-bd3a-949fabe12204 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:53.957431 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-969fa48e-f3b6-42aa-a9b7-b9d9a1ddf7b4 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:53.983059 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-969fa48e-f3b6-42aa-a9b7-b9d9a1ddf7b4 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1272 microversion: 2.1 time: 0.250384 Oct 10 18:59:54.000129 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1307/2366] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:53 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:54.183387 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1211118847", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "66c8ea36-6ebd-4d4c-b51b-1928dacdf136"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:54.269164 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] validate_networks() for [('66c8ea36-6ebd-4d4c-b51b-1928dacdf136', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 18:59:55.016107 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 18:59:55.016526 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 18:59:55.017027 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 18:59:55.017632 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 18:59:55.017846 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 18:59:55.032784 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:55.035437 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:55.039262 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:55.039262 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:55.039262 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:55.039262 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:55.066974 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Getting quotas for project bd2cfdbce62b4c72b773d5312d02ab40. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 18:59:55.072698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Getting quotas for user 76ba48b4475d429f884546750a467e14 and project bd2cfdbce62b4c72b773d5312d02ab40. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 18:59:55.086232 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 18:59:55.088701 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 18:59:55.129966 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d47d4ee8-ac06-4079-bd3a-949fabe12204 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:55.143453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d47d4ee8-ac06-4079-bd3a-949fabe12204 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:55.149603 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d47d4ee8-ac06-4079-bd3a-949fabe12204 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:55.151310 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d47d4ee8-ac06-4079-bd3a-949fabe12204 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1548 microversion: 2.25 time: 1.410994 Oct 10 18:59:55.153093 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1060/2367] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:53 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1548 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:55.162987 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-4322f853-5537-40e7-b01d-fde7a1d6a25a req-02d33e97-de19-4c4d-909c-5aab3f2eaa09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625d4b03-2441-4576-a0e2-6c266b24b1e9", "name": "network-vif-plugged", "status": "completed", "tag": "f2875240-f490-44c6-8bd6-6fe609be5a6c"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:55.183724 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4322f853-5537-40e7-b01d-fde7a1d6a25a req-02d33e97-de19-4c4d-909c-5aab3f2eaa09 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:55.188216 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4322f853-5537-40e7-b01d-fde7a1d6a25a req-02d33e97-de19-4c4d-909c-5aab3f2eaa09 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:55.190674 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4322f853-5537-40e7-b01d-fde7a1d6a25a req-02d33e97-de19-4c4d-909c-5aab3f2eaa09 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:55.229141 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-629eaba8-711d-4931-b396-a4bfa09814b4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.227324 Oct 10 18:59:55.230181 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1308/2368] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 18:59:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 18:59:55.235603 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e5bad88e-4c9d-4b33-b253-084a5569848d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318e2ce040>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:55.253646 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-4322f853-5537-40e7-b01d-fde7a1d6a25a req-02d33e97-de19-4c4d-909c-5aab3f2eaa09 service nova] Creating event network-vif-plugged:f2875240-f490-44c6-8bd6-6fe609be5a6c for instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 on n-h2-860863-1 Oct 10 18:59:55.259810 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-4322f853-5537-40e7-b01d-fde7a1d6a25a req-02d33e97-de19-4c4d-909c-5aab3f2eaa09 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105397 Oct 10 18:59:55.268507 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1061/2369] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:55.272416 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f01aea06-ed88-4d70-a96e-a3b3c5a4a3da tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:55.273345 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f01aea06-ed88-4d70-a96e-a3b3c5a4a3da tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:55.312702 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f01aea06-ed88-4d70-a96e-a3b3c5a4a3da tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:55.314244 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f01aea06-ed88-4d70-a96e-a3b3c5a4a3da tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:55.314886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f01aea06-ed88-4d70-a96e-a3b3c5a4a3da tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:55.316101 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f01aea06-ed88-4d70-a96e-a3b3c5a4a3da tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:55.317226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f01aea06-ed88-4d70-a96e-a3b3c5a4a3da tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:55.317876 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f01aea06-ed88-4d70-a96e-a3b3c5a4a3da tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:55.338216 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e5bad88e-4c9d-4b33-b253-084a5569848d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1464 microversion: 2.1 time: 0.106675 Oct 10 18:59:55.347185 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1309/2370] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:55 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1464 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:55.355797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-98bf47e0-4103-4a83-8467-834ffac02fc3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:55.361455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-98bf47e0-4103-4a83-8467-834ffac02fc3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:55.377518 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98bf47e0-4103-4a83-8467-834ffac02fc3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:55.378030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98bf47e0-4103-4a83-8467-834ffac02fc3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:55.378465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98bf47e0-4103-4a83-8467-834ffac02fc3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:55.379171 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98bf47e0-4103-4a83-8467-834ffac02fc3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:55.384345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98bf47e0-4103-4a83-8467-834ffac02fc3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:55.384964 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98bf47e0-4103-4a83-8467-834ffac02fc3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:55.734237 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f01aea06-ed88-4d70-a96e-a3b3c5a4a3da tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:55.744179 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f01aea06-ed88-4d70-a96e-a3b3c5a4a3da tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1334 microversion: 2.1 time: 0.477285 Oct 10 18:59:55.745709 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1062/2371] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:55 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1334 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:55.756075 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-33fce3f6-7f37-45a8-be99-78dd7da39aa0 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:55.756075 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-33fce3f6-7f37-45a8-be99-78dd7da39aa0 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:55.763614 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33fce3f6-7f37-45a8-be99-78dd7da39aa0 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:55.764218 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33fce3f6-7f37-45a8-be99-78dd7da39aa0 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:55.764791 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33fce3f6-7f37-45a8-be99-78dd7da39aa0 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:55.765842 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33fce3f6-7f37-45a8-be99-78dd7da39aa0 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:55.766433 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33fce3f6-7f37-45a8-be99-78dd7da39aa0 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:55.766994 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33fce3f6-7f37-45a8-be99-78dd7da39aa0 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:55.830553 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-98bf47e0-4103-4a83-8467-834ffac02fc3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:55.881336 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-98bf47e0-4103-4a83-8467-834ffac02fc3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1318 microversion: 2.1 time: 0.521823 Oct 10 18:59:55.884633 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1310/2372] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:55 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:55.887164 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9fc5ac50-7133-46f9-a1df-048647e14049 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:55.887772 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9fc5ac50-7133-46f9-a1df-048647e14049 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:55.950783 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-33fce3f6-7f37-45a8-be99-78dd7da39aa0 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:55.965528 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-33fce3f6-7f37-45a8-be99-78dd7da39aa0 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1278 microversion: 2.1 time: 0.218437 Oct 10 18:59:55.968045 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1063/2373] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:55 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:55.980170 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8a441daa-ec6c-408d-9172-0ec9db2fffbf tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f3192229a60>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:56.031137 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9fc5ac50-7133-46f9-a1df-048647e14049 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:56.040435 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9fc5ac50-7133-46f9-a1df-048647e14049 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1208 microversion: 2.1 time: 0.155021 Oct 10 18:59:56.041724 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1311/2374] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:55 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1208 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:56.069934 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8a441daa-ec6c-408d-9172-0ec9db2fffbf tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 200 len: 1464 microversion: 2.1 time: 0.100071 Oct 10 18:59:56.071573 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1064/2375] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:55 2022] GET /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 1464 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:56.088056 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6d0b5566-e941-4188-bc71-2d6214ef5e3f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:56.089063 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6d0b5566-e941-4188-bc71-2d6214ef5e3f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:56.095796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d0b5566-e941-4188-bc71-2d6214ef5e3f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:56.096665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d0b5566-e941-4188-bc71-2d6214ef5e3f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:56.097919 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d0b5566-e941-4188-bc71-2d6214ef5e3f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:56.098354 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d0b5566-e941-4188-bc71-2d6214ef5e3f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:56.099643 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d0b5566-e941-4188-bc71-2d6214ef5e3f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:56.100355 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6d0b5566-e941-4188-bc71-2d6214ef5e3f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:56.180271 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bc6dbec0-5973-482f-9dd0-6b656a475f31 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:56.181044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bc6dbec0-5973-482f-9dd0-6b656a475f31 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:56.197011 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc6dbec0-5973-482f-9dd0-6b656a475f31 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:56.197725 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc6dbec0-5973-482f-9dd0-6b656a475f31 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:56.198898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc6dbec0-5973-482f-9dd0-6b656a475f31 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:56.199437 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc6dbec0-5973-482f-9dd0-6b656a475f31 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:56.200018 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc6dbec0-5973-482f-9dd0-6b656a475f31 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:56.201769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc6dbec0-5973-482f-9dd0-6b656a475f31 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:56.444932 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bc6dbec0-5973-482f-9dd0-6b656a475f31 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:56.453765 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bc6dbec0-5973-482f-9dd0-6b656a475f31 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:56.460191 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bc6dbec0-5973-482f-9dd0-6b656a475f31 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:56.467622 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bc6dbec0-5973-482f-9dd0-6b656a475f31 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1506 microversion: 2.25 time: 0.292096 Oct 10 18:59:56.472566 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1065/2376] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:56 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 18:59:56.648010 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-11163ba6-8c9e-4132-844a-a8fbf1734c3a req-b78e2cf4-1c89-41d9-aa0c-1c07eee3806e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89b360b-2f7e-4f80-9247-559c3b0cf714", "name": "network-vif-deleted", "tag": "1442dec7-2556-4073-a34d-d9c24dea3b48"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:56.663872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-11163ba6-8c9e-4132-844a-a8fbf1734c3a req-b78e2cf4-1c89-41d9-aa0c-1c07eee3806e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:56.671350 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-11163ba6-8c9e-4132-844a-a8fbf1734c3a req-b78e2cf4-1c89-41d9-aa0c-1c07eee3806e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:56.672053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-11163ba6-8c9e-4132-844a-a8fbf1734c3a req-b78e2cf4-1c89-41d9-aa0c-1c07eee3806e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:56.711071 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-11163ba6-8c9e-4132-844a-a8fbf1734c3a req-b78e2cf4-1c89-41d9-aa0c-1c07eee3806e service nova] Creating event network-vif-deleted:1442dec7-2556-4073-a34d-d9c24dea3b48 for instance d89b360b-2f7e-4f80-9247-559c3b0cf714 on n-h2-860863-1 Oct 10 18:59:56.721683 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-11163ba6-8c9e-4132-844a-a8fbf1734c3a req-b78e2cf4-1c89-41d9-aa0c-1c07eee3806e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251551 Oct 10 18:59:56.729065 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1066/2377] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:56.770333 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-464c5652-b98d-47c3-91c5-e87025222bc8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:56.771720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-464c5652-b98d-47c3-91c5-e87025222bc8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:56.778319 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-464c5652-b98d-47c3-91c5-e87025222bc8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:56.780655 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-464c5652-b98d-47c3-91c5-e87025222bc8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:56.780655 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-464c5652-b98d-47c3-91c5-e87025222bc8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:56.780655 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-464c5652-b98d-47c3-91c5-e87025222bc8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:56.780933 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-464c5652-b98d-47c3-91c5-e87025222bc8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:56.781283 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-464c5652-b98d-47c3-91c5-e87025222bc8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:56.925738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6d0b5566-e941-4188-bc71-2d6214ef5e3f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:56.939556 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6d0b5566-e941-4188-bc71-2d6214ef5e3f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f" status: 200 len: 1468 microversion: 2.1 time: 0.855210 Oct 10 18:59:56.940440 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1312/2378] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:56 2022] GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f => generated 1468 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:56.945576 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fc3707cf-8e68-44c2-8a84-c13cad6cb638 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:56.950867 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fc3707cf-8e68-44c2-8a84-c13cad6cb638 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:56.968735 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fc3707cf-8e68-44c2-8a84-c13cad6cb638 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:56.973223 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fc3707cf-8e68-44c2-8a84-c13cad6cb638 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:56.975869 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fc3707cf-8e68-44c2-8a84-c13cad6cb638 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:56.976809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fc3707cf-8e68-44c2-8a84-c13cad6cb638 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:56.978784 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fc3707cf-8e68-44c2-8a84-c13cad6cb638 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:56.979215 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fc3707cf-8e68-44c2-8a84-c13cad6cb638 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:56.980807 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-464c5652-b98d-47c3-91c5-e87025222bc8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:56.990240 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-464c5652-b98d-47c3-91c5-e87025222bc8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1334 microversion: 2.1 time: 0.224449 Oct 10 18:59:56.992077 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1067/2379] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:56 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1334 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 18:59:56.999192 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4519ffd4-a108-492f-9cf3-d815bc4c3ac8 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1800504692"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:57.009020 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4519ffd4-a108-492f-9cf3-d815bc4c3ac8 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:57.019357 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4519ffd4-a108-492f-9cf3-d815bc4c3ac8 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:57.020758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4519ffd4-a108-492f-9cf3-d815bc4c3ac8 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:57.021773 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4519ffd4-a108-492f-9cf3-d815bc4c3ac8 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:57.022647 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4519ffd4-a108-492f-9cf3-d815bc4c3ac8 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:57.023253 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4519ffd4-a108-492f-9cf3-d815bc4c3ac8 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:57.023907 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4519ffd4-a108-492f-9cf3-d815bc4c3ac8 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:57.427876 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fc3707cf-8e68-44c2-8a84-c13cad6cb638 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:57.442496 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fc3707cf-8e68-44c2-8a84-c13cad6cb638 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1318 microversion: 2.1 time: 0.500558 Oct 10 18:59:57.446106 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1313/2380] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:56 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:57.454350 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-74148ee4-f6b4-487b-b46b-96f75eb7a8b8 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:57.456855 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-74148ee4-f6b4-487b-b46b-96f75eb7a8b8 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:57.473445 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-74148ee4-f6b4-487b-b46b-96f75eb7a8b8 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:57.474515 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-74148ee4-f6b4-487b-b46b-96f75eb7a8b8 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:57.475154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-74148ee4-f6b4-487b-b46b-96f75eb7a8b8 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:57.476906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-74148ee4-f6b4-487b-b46b-96f75eb7a8b8 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:57.478215 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-74148ee4-f6b4-487b-b46b-96f75eb7a8b8 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:57.482043 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-74148ee4-f6b4-487b-b46b-96f75eb7a8b8 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:57.597818 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-74148ee4-f6b4-487b-b46b-96f75eb7a8b8 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:57.607044 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-74148ee4-f6b4-487b-b46b-96f75eb7a8b8 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1278 microversion: 2.1 time: 0.159603 Oct 10 18:59:57.607644 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1314/2381] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:57 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:57.612410 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-dd97c496-b0a2-4689-aab7-74c77b7bd0de tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:57.613090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-dd97c496-b0a2-4689-aab7-74c77b7bd0de tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:57.623933 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd97c496-b0a2-4689-aab7-74c77b7bd0de tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:57.631203 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd97c496-b0a2-4689-aab7-74c77b7bd0de tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:57.631203 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd97c496-b0a2-4689-aab7-74c77b7bd0de tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:57.631203 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd97c496-b0a2-4689-aab7-74c77b7bd0de tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:57.631203 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd97c496-b0a2-4689-aab7-74c77b7bd0de tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:57.631203 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dd97c496-b0a2-4689-aab7-74c77b7bd0de tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:57.691446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dd97c496-b0a2-4689-aab7-74c77b7bd0de tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:57.726527 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-dd97c496-b0a2-4689-aab7-74c77b7bd0de tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1204 microversion: 2.1 time: 0.108777 Oct 10 18:59:57.728680 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1315/2382] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:57 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1204 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:57.742438 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:57.745472 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:57.758038 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:57.761042 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:57.761808 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:57.762785 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:57.772712 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:57.772712 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:57.834338 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:57.835156 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:57.835845 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:57.836139 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4519ffd4-a108-492f-9cf3-d815bc4c3ac8 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "POST /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231/action" status: 202 len: 0 microversion: 2.1 time: 0.831903 Oct 10 18:59:57.837708 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lazy-loading 'fault' on Instance uuid d89b360b-2f7e-4f80-9247-559c3b0cf714 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 18:59:57.841946 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1068/2383] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 18:59:56 2022] POST /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231/action => generated 0 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 18:59:57.854828 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0c4300f3-9a8e-4d16-9120-d92081e694e1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31922ab5e0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:57.936142 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0c4300f3-9a8e-4d16-9120-d92081e694e1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.082081 Oct 10 18:59:57.945212 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1069/2384] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:57 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:57.945492 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:57.956072 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:57.959921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:57.968763 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9dc070a2-7059-4b28-9b30-451bbb29162e tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 200 len: 1352 microversion: 2.25 time: 0.230730 Oct 10 18:59:57.968763 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1316/2385] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:57 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 1352 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 18:59:58.019335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f68dab56-058e-4810-bc48-3e7547afbf6b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:58.020255 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f68dab56-058e-4810-bc48-3e7547afbf6b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:58.059022 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f68dab56-058e-4810-bc48-3e7547afbf6b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:58.060113 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f68dab56-058e-4810-bc48-3e7547afbf6b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:58.060865 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f68dab56-058e-4810-bc48-3e7547afbf6b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:58.063108 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f68dab56-058e-4810-bc48-3e7547afbf6b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:58.066791 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f68dab56-058e-4810-bc48-3e7547afbf6b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:58.067887 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f68dab56-058e-4810-bc48-3e7547afbf6b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:58.468039 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f368577a-91f4-44cc-9019-c6b37d577176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:58.468779 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f368577a-91f4-44cc-9019-c6b37d577176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:58.478280 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f368577a-91f4-44cc-9019-c6b37d577176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:58.478772 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f368577a-91f4-44cc-9019-c6b37d577176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:58.481799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f368577a-91f4-44cc-9019-c6b37d577176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:58.488429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f368577a-91f4-44cc-9019-c6b37d577176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:58.489196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f368577a-91f4-44cc-9019-c6b37d577176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:58.493364 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f368577a-91f4-44cc-9019-c6b37d577176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:58.520373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f68dab56-058e-4810-bc48-3e7547afbf6b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:58.542369 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f68dab56-058e-4810-bc48-3e7547afbf6b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.530071 Oct 10 18:59:58.547029 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1070/2386] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:58 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:58.631720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-16083d4c-0a1f-4b8e-85cd-27e9df057ccd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:58.632389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-16083d4c-0a1f-4b8e-85cd-27e9df057ccd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:58.639786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-16083d4c-0a1f-4b8e-85cd-27e9df057ccd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:58.640276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-16083d4c-0a1f-4b8e-85cd-27e9df057ccd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:58.640839 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-16083d4c-0a1f-4b8e-85cd-27e9df057ccd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:58.641767 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-16083d4c-0a1f-4b8e-85cd-27e9df057ccd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:58.642305 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-16083d4c-0a1f-4b8e-85cd-27e9df057ccd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:58.643106 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-16083d4c-0a1f-4b8e-85cd-27e9df057ccd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:58.844136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-16083d4c-0a1f-4b8e-85cd-27e9df057ccd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:58.872109 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-16083d4c-0a1f-4b8e-85cd-27e9df057ccd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1278 microversion: 2.1 time: 0.245654 Oct 10 18:59:58.874574 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1071/2387] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:58 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1278 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:58.883104 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f1ca727d-2ad3-46e3-aed8-c92f057da1e5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:58.884166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f1ca727d-2ad3-46e3-aed8-c92f057da1e5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:58.890070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1ca727d-2ad3-46e3-aed8-c92f057da1e5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:58.890549 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1ca727d-2ad3-46e3-aed8-c92f057da1e5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:58.891169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1ca727d-2ad3-46e3-aed8-c92f057da1e5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:58.892032 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1ca727d-2ad3-46e3-aed8-c92f057da1e5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:58.892814 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1ca727d-2ad3-46e3-aed8-c92f057da1e5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:58.893392 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1ca727d-2ad3-46e3-aed8-c92f057da1e5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:58.914667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f368577a-91f4-44cc-9019-c6b37d577176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:58.929205 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f368577a-91f4-44cc-9019-c6b37d577176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1508 microversion: 2.1 time: 0.465327 Oct 10 18:59:58.941361 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1317/2388] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:58 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1508 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:58.958658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b8b92ca3-fb44-48db-982d-e5f56f78aaed tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318de713a0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:59.025860 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f1ca727d-2ad3-46e3-aed8-c92f057da1e5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:59.026705 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b8b92ca3-fb44-48db-982d-e5f56f78aaed tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.066732 Oct 10 18:59:59.026705 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1318/2389] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 18:59:58 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:59.026705 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-82cca8a5-3c30-4e1e-b185-a98b9f1bc2cd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:59.026705 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-82cca8a5-3c30-4e1e-b185-a98b9f1bc2cd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:59.029860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-82cca8a5-3c30-4e1e-b185-a98b9f1bc2cd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:59.030629 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-82cca8a5-3c30-4e1e-b185-a98b9f1bc2cd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:59.031287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-82cca8a5-3c30-4e1e-b185-a98b9f1bc2cd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:59.032219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-82cca8a5-3c30-4e1e-b185-a98b9f1bc2cd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:59.032577 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f1ca727d-2ad3-46e3-aed8-c92f057da1e5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1260 microversion: 2.1 time: 0.156885 Oct 10 18:59:59.033433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-82cca8a5-3c30-4e1e-b185-a98b9f1bc2cd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:59.034083 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-82cca8a5-3c30-4e1e-b185-a98b9f1bc2cd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:59.038840 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1072/2390] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:58 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:59.047086 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-05221107-c07b-4573-866f-a2654d8f60f7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:59.048010 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-05221107-c07b-4573-866f-a2654d8f60f7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: d89b360b-2f7e-4f80-9247-559c3b0cf714] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:59.057626 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05221107-c07b-4573-866f-a2654d8f60f7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:59.058376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05221107-c07b-4573-866f-a2654d8f60f7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:59.058988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05221107-c07b-4573-866f-a2654d8f60f7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:59.061774 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05221107-c07b-4573-866f-a2654d8f60f7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:59.062446 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05221107-c07b-4573-866f-a2654d8f60f7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:59.063129 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05221107-c07b-4573-866f-a2654d8f60f7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:59.084880 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-05221107-c07b-4573-866f-a2654d8f60f7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] HTTP exception thrown: Instance d89b360b-2f7e-4f80-9247-559c3b0cf714 could not be found. Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-05221107-c07b-4573-866f-a2654d8f60f7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Request method failure captured: Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 HTTP/1.1 Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGnT74k3jz6Wa3pVJ9ZcmChqa1oL8HCHZkX6SpHPwSHLQBVyzr9Zeld4-bJk6nTBopnJ7frY84hkg0yHAgEYqC7YxphYQ1Zc_oeJrc_LnVexerBe0ggImFM7jD1c56DBEpM-m7xTb4GcdGxbn6BPhealjMNmOuwebHjUGz1MpRwC9WI Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Openstack-Nova-Api-Version: 2.25 Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 8ca11fe18cc64adfbc06166601106c7c Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-601943355 Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ca11fe18cc64adfbc06166601106c7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ca11fe18cc64adfbc06166601106c7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ca11fe18cc64adfbc06166601106c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ca11fe18cc64adfbc06166601106c7c"}]}] Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-601943355 Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 8ca11fe18cc64adfbc06166601106c7c Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-601943355 Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-LiveAutoBlockMigrationV225Test-601943355-project Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: 789ef7a66ff042b9abebe36823008f8f Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-601943355-project Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance d89b360b-2f7e-4f80-9247-559c3b0cf714 could not be found. Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'd89b360b-2f7e-4f80-9247-559c3b0cf714'} Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d89b360b-2f7e-4f80-9247-559c3b0cf714 could not be found. Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d89b360b-2f7e-4f80-9247-559c3b0cf714 could not be found. Oct 10 18:59:59.086975 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:59.091511 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 18:59:59.091511 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:59.091511 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 18:59:59.091511 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 18:59:59.091511 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 18:59:59.091511 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 18:59:59.091511 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 18:59:59.091511 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d89b360b-2f7e-4f80-9247-559c3b0cf714 could not be found. Oct 10 18:59:59.091511 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 18:59:59.099514 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-05221107-c07b-4573-866f-a2654d8f60f7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Returning 404 to user: Instance d89b360b-2f7e-4f80-9247-559c3b0cf714 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 18:59:59.101119 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-05221107-c07b-4573-866f-a2654d8f60f7 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714" status: 404 len: 111 microversion: 2.25 time: 0.059213 Oct 10 18:59:59.101932 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1073/2391] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:59 2022] GET /compute/v2.1/servers/d89b360b-2f7e-4f80-9247-559c3b0cf714 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 18:59:59.118252 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c9c02e79-d243-4074-9c7a-23568d801ec8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:59.118795 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c9c02e79-d243-4074-9c7a-23568d801ec8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:59.125252 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9c02e79-d243-4074-9c7a-23568d801ec8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:59.125731 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9c02e79-d243-4074-9c7a-23568d801ec8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:59.126160 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9c02e79-d243-4074-9c7a-23568d801ec8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:59.126856 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9c02e79-d243-4074-9c7a-23568d801ec8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:59.127301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9c02e79-d243-4074-9c7a-23568d801ec8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:59.127721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c9c02e79-d243-4074-9c7a-23568d801ec8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:59.160099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c9c02e79-d243-4074-9c7a-23568d801ec8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 18:59:59.598029 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c9c02e79-d243-4074-9c7a-23568d801ec8 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 204 len: 0 microversion: 2.25 time: 0.478600 Oct 10 18:59:59.599020 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1074/2392] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 18:59:59 2022] DELETE /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 18:59:59.606052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-8b7a558e-2a84-41ba-ae15-576f34f3ea86 req-c9d85bfc-1e1a-4d75-a43a-56ccc9c45238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd4c6e16-56ef-4eb0-861f-f0da22f85d58", "tag": "e9e14bef-c25f-4b3e-a8dc-fc782f23d82a"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:59.618702 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-8b7a558e-2a84-41ba-ae15-576f34f3ea86 req-c9d85bfc-1e1a-4d75-a43a-56ccc9c45238 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:59.619181 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-8b7a558e-2a84-41ba-ae15-576f34f3ea86 req-c9d85bfc-1e1a-4d75-a43a-56ccc9c45238 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:59.619607 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-8b7a558e-2a84-41ba-ae15-576f34f3ea86 req-c9d85bfc-1e1a-4d75-a43a-56ccc9c45238 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:59.641866 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-8b7a558e-2a84-41ba-ae15-576f34f3ea86 req-c9d85bfc-1e1a-4d75-a43a-56ccc9c45238 service nova] Creating event network-changed:e9e14bef-c25f-4b3e-a8dc-fc782f23d82a for instance fd4c6e16-56ef-4eb0-861f-f0da22f85d58 on n-h1-860863-1 Oct 10 18:59:59.649820 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-8b7a558e-2a84-41ba-ae15-576f34f3ea86 req-c9d85bfc-1e1a-4d75-a43a-56ccc9c45238 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048431 Oct 10 18:59:59.650836 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1075/2393] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:59.656925 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-3d8c7737-e273-4bf8-84cc-2a016c9c4bd6 req-83ff46ce-c618-467c-8b18-91d482a4a5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f", "name": "network-vif-unplugged", "status": "completed", "tag": "5bffc937-d058-4e1d-89e3-1fcc517f98e7"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 18:59:59.674058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-3d8c7737-e273-4bf8-84cc-2a016c9c4bd6 req-83ff46ce-c618-467c-8b18-91d482a4a5f8 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:59.677352 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-3d8c7737-e273-4bf8-84cc-2a016c9c4bd6 req-83ff46ce-c618-467c-8b18-91d482a4a5f8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:59.677352 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-3d8c7737-e273-4bf8-84cc-2a016c9c4bd6 req-83ff46ce-c618-467c-8b18-91d482a4a5f8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:59.681219 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:59.689415 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-3d8c7737-e273-4bf8-84cc-2a016c9c4bd6 req-83ff46ce-c618-467c-8b18-91d482a4a5f8 service nova] Creating event network-vif-unplugged:5bffc937-d058-4e1d-89e3-1fcc517f98e7 for instance bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f on n-h1-860863-1 Oct 10 18:59:59.695581 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-3d8c7737-e273-4bf8-84cc-2a016c9c4bd6 req-83ff46ce-c618-467c-8b18-91d482a4a5f8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043390 Oct 10 18:59:59.696865 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1076/2394] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 18:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 18:59:59.703602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a9e99d3b-7927-4326-8fe6-8e9bae44adac tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:59.704929 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a9e99d3b-7927-4326-8fe6-8e9bae44adac tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:59.712837 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9e99d3b-7927-4326-8fe6-8e9bae44adac tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:59.713637 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9e99d3b-7927-4326-8fe6-8e9bae44adac tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:59.714261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9e99d3b-7927-4326-8fe6-8e9bae44adac tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:59.715158 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9e99d3b-7927-4326-8fe6-8e9bae44adac tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:59.715849 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9e99d3b-7927-4326-8fe6-8e9bae44adac tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:59.716453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9e99d3b-7927-4326-8fe6-8e9bae44adac tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:59.740894 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=6 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 18:59:59.951620 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-82cca8a5-3c30-4e1e-b185-a98b9f1bc2cd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 18:59:59.962697 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-82cca8a5-3c30-4e1e-b185-a98b9f1bc2cd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1508 microversion: 2.1 time: 0.944791 Oct 10 18:59:59.965498 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1319/2395] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:59 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1508 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 18:59:59.969703 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a73a9517-24d1-43cf-b7ef-dec34f356f28 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 18:59:59.970568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a73a9517-24d1-43cf-b7ef-dec34f356f28 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 18:59:59.977815 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a73a9517-24d1-43cf-b7ef-dec34f356f28 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:59.978654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a73a9517-24d1-43cf-b7ef-dec34f356f28 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:59.979423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a73a9517-24d1-43cf-b7ef-dec34f356f28 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:59.980315 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a73a9517-24d1-43cf-b7ef-dec34f356f28 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 18:59:59.981033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a73a9517-24d1-43cf-b7ef-dec34f356f28 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 18:59:59.982010 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a73a9517-24d1-43cf-b7ef-dec34f356f28 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 18:59:59.990322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a9e99d3b-7927-4326-8fe6-8e9bae44adac tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:00.000122 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a9e99d3b-7927-4326-8fe6-8e9bae44adac tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.301837 Oct 10 19:00:00.000739 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1077/2396] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 18:59:59 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:00.006525 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4b9f1fa3-9e06-450c-a61a-7c25163c9162 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:00.011102 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4b9f1fa3-9e06-450c-a61a-7c25163c9162 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:00.013228 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4b9f1fa3-9e06-450c-a61a-7c25163c9162 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:00.013908 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4b9f1fa3-9e06-450c-a61a-7c25163c9162 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:00.014506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4b9f1fa3-9e06-450c-a61a-7c25163c9162 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:00.015376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4b9f1fa3-9e06-450c-a61a-7c25163c9162 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:00.015998 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4b9f1fa3-9e06-450c-a61a-7c25163c9162 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:00.016656 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4b9f1fa3-9e06-450c-a61a-7c25163c9162 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:00.440632 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a73a9517-24d1-43cf-b7ef-dec34f356f28 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:00.476154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a73a9517-24d1-43cf-b7ef-dec34f356f28 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:00.486517 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a73a9517-24d1-43cf-b7ef-dec34f356f28 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:00.490888 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a73a9517-24d1-43cf-b7ef-dec34f356f28 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1562 microversion: 2.25 time: 0.524790 Oct 10 19:00:00.492145 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1320/2397] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 18:59:59 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1562 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:00:00.500136 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:00.506376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:00.535359 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:00.536412 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:00.536989 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:00.541284 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:00.564837 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:00.565964 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:00.671977 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 19:00:00.672719 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 19:00:00.673402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 19:00:00.674032 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 19:00:00.674653 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 19:00:00.713889 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:00.841157 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4b9f1fa3-9e06-450c-a61a-7c25163c9162 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:00.855602 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4b9f1fa3-9e06-450c-a61a-7c25163c9162 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1320 microversion: 2.1 time: 0.853096 Oct 10 19:00:00.857251 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1078/2398] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:00 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1320 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:00.863369 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6813e2a8-f236-4c24-af95-d1c101dadc47 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319220f310>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:00.916837 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6813e2a8-f236-4c24-af95-d1c101dadc47 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.058232 Oct 10 19:00:00.925007 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1079/2399] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:00 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:00.925007 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5129941d-7dad-4abe-a0c2-580e9a82277c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:00.925007 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5129941d-7dad-4abe-a0c2-580e9a82277c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:00.933920 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5129941d-7dad-4abe-a0c2-580e9a82277c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:00.934918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5129941d-7dad-4abe-a0c2-580e9a82277c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:00.940198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5129941d-7dad-4abe-a0c2-580e9a82277c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:00.940198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5129941d-7dad-4abe-a0c2-580e9a82277c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:00.940198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5129941d-7dad-4abe-a0c2-580e9a82277c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:00.941028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:00.941249 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5129941d-7dad-4abe-a0c2-580e9a82277c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:00.951468 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:00.952025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:00.955089 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:00.955992 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:00.959648 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:00.960301 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:01.002545 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f7a30b48-da66-4125-8b26-ed621ac38f8d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "POST /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9/action" status: 202 len: 1110 microversion: 2.1 time: 0.507782 Oct 10 19:00:01.003913 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1321/2400] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:00:00 2022] POST /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9/action => generated 1110 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 10 19:00:01.009707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-0f2b57d1-2ef7-47bf-9f2d-36d4d154d944 req-0b8315e5-570b-4015-9a38-550f2785afeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22fa54d-372c-4887-8875-a3c56b3850b1", "tag": "22ce5b61-90fe-4432-bece-f8ea63b95965"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:01.019899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0f2b57d1-2ef7-47bf-9f2d-36d4d154d944 req-0b8315e5-570b-4015-9a38-550f2785afeb service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:01.020500 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0f2b57d1-2ef7-47bf-9f2d-36d4d154d944 req-0b8315e5-570b-4015-9a38-550f2785afeb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:01.020900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0f2b57d1-2ef7-47bf-9f2d-36d4d154d944 req-0b8315e5-570b-4015-9a38-550f2785afeb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:01.034139 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-0f2b57d1-2ef7-47bf-9f2d-36d4d154d944 req-0b8315e5-570b-4015-9a38-550f2785afeb service nova] Creating event network-changed:22ce5b61-90fe-4432-bece-f8ea63b95965 for instance c22fa54d-372c-4887-8875-a3c56b3850b1 on n-h2-860863-1 Oct 10 19:00:01.043116 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-0f2b57d1-2ef7-47bf-9f2d-36d4d154d944 req-0b8315e5-570b-4015-9a38-550f2785afeb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037700 Oct 10 19:00:01.049500 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1322/2401] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:01.049500 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-24ee6208-c754-4d6e-9222-25dbae82a45e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:01.049871 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-24ee6208-c754-4d6e-9222-25dbae82a45e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:01.058067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24ee6208-c754-4d6e-9222-25dbae82a45e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:01.058883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24ee6208-c754-4d6e-9222-25dbae82a45e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:01.059653 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24ee6208-c754-4d6e-9222-25dbae82a45e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:01.061208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24ee6208-c754-4d6e-9222-25dbae82a45e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:01.061964 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24ee6208-c754-4d6e-9222-25dbae82a45e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:01.062588 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24ee6208-c754-4d6e-9222-25dbae82a45e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:01.067874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5129941d-7dad-4abe-a0c2-580e9a82277c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:01.075648 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5129941d-7dad-4abe-a0c2-580e9a82277c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1266 microversion: 2.1 time: 0.157070 Oct 10 19:00:01.089323 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1080/2402] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:00 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:01.095311 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8709b90c-1f96-4d7c-b663-00a94888d2a9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:01.095311 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8709b90c-1f96-4d7c-b663-00a94888d2a9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:01.101271 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8709b90c-1f96-4d7c-b663-00a94888d2a9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:01.101756 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8709b90c-1f96-4d7c-b663-00a94888d2a9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:01.102189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8709b90c-1f96-4d7c-b663-00a94888d2a9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:01.102886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8709b90c-1f96-4d7c-b663-00a94888d2a9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:01.113421 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8709b90c-1f96-4d7c-b663-00a94888d2a9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:01.113876 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8709b90c-1f96-4d7c-b663-00a94888d2a9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:01.369526 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-24ee6208-c754-4d6e-9222-25dbae82a45e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:01.382018 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-24ee6208-c754-4d6e-9222-25dbae82a45e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.336641 Oct 10 19:00:01.399687 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1323/2403] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:01 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:01.527873 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0613c333-c10d-4ad7-9968-94c65d8d6f79 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:01.528655 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0613c333-c10d-4ad7-9968-94c65d8d6f79 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:01.540293 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0613c333-c10d-4ad7-9968-94c65d8d6f79 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:01.551695 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0613c333-c10d-4ad7-9968-94c65d8d6f79 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:01.559359 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0613c333-c10d-4ad7-9968-94c65d8d6f79 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:01.560448 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0613c333-c10d-4ad7-9968-94c65d8d6f79 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:01.561159 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0613c333-c10d-4ad7-9968-94c65d8d6f79 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:01.561820 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0613c333-c10d-4ad7-9968-94c65d8d6f79 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:01.672297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8709b90c-1f96-4d7c-b663-00a94888d2a9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:01.682405 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=24 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:01.688472 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8709b90c-1f96-4d7c-b663-00a94888d2a9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.597155 Oct 10 19:00:01.701205 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1081/2404] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:01 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:01.887835 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a3485835-9620-440a-b9b3-ba7d302da8fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:01.888449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a3485835-9620-440a-b9b3-ba7d302da8fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:01.899053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3485835-9620-440a-b9b3-ba7d302da8fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:01.899738 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3485835-9620-440a-b9b3-ba7d302da8fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:01.903819 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3485835-9620-440a-b9b3-ba7d302da8fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:01.904917 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3485835-9620-440a-b9b3-ba7d302da8fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:01.905549 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3485835-9620-440a-b9b3-ba7d302da8fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:01.906123 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3485835-9620-440a-b9b3-ba7d302da8fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:02.053750 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0613c333-c10d-4ad7-9968-94c65d8d6f79 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:02.066263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0613c333-c10d-4ad7-9968-94c65d8d6f79 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:02.069607 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0613c333-c10d-4ad7-9968-94c65d8d6f79 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:02.070966 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0613c333-c10d-4ad7-9968-94c65d8d6f79 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1562 microversion: 2.25 time: 0.555361 Oct 10 19:00:02.071822 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1324/2405] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:00:01 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1562 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 19:00:02.076660 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9ab8aee8-3d45-4e5a-a7f9-8e50b70da004 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d582310>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:02.140361 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9ab8aee8-3d45-4e5a-a7f9-8e50b70da004 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.067078 Oct 10 19:00:02.141226 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1325/2406] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:02 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:02.147653 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-27bc62d7-4a3d-4d23-8cf6-03c01d1fe21b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:02.153749 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-27bc62d7-4a3d-4d23-8cf6-03c01d1fe21b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:02.161476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:02.163712 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27bc62d7-4a3d-4d23-8cf6-03c01d1fe21b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:02.164279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27bc62d7-4a3d-4d23-8cf6-03c01d1fe21b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:02.164812 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27bc62d7-4a3d-4d23-8cf6-03c01d1fe21b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:02.165932 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27bc62d7-4a3d-4d23-8cf6-03c01d1fe21b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:02.166496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27bc62d7-4a3d-4d23-8cf6-03c01d1fe21b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:02.167144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-27bc62d7-4a3d-4d23-8cf6-03c01d1fe21b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:02.395337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a3485835-9620-440a-b9b3-ba7d302da8fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:02.403703 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a3485835-9620-440a-b9b3-ba7d302da8fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1320 microversion: 2.1 time: 0.519703 Oct 10 19:00:02.405291 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1082/2407] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:01 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1320 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:02.410462 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-209ba44f-2f0d-4901-b9d3-ed29bbf5088e req-054d28e4-5720-471c-81eb-b35ae7b0502f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fa4cba0-5184-462b-ab0b-c03f2a104ae6", "name": "network-vif-deleted", "tag": "aa9423e0-a4d9-48ba-8535-6f8ecab069a0"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:02.430974 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-209ba44f-2f0d-4901-b9d3-ed29bbf5088e req-054d28e4-5720-471c-81eb-b35ae7b0502f service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:02.431536 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-209ba44f-2f0d-4901-b9d3-ed29bbf5088e req-054d28e4-5720-471c-81eb-b35ae7b0502f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:02.431957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-209ba44f-2f0d-4901-b9d3-ed29bbf5088e req-054d28e4-5720-471c-81eb-b35ae7b0502f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:02.450905 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-209ba44f-2f0d-4901-b9d3-ed29bbf5088e req-054d28e4-5720-471c-81eb-b35ae7b0502f service nova] Creating event network-vif-deleted:aa9423e0-a4d9-48ba-8535-6f8ecab069a0 for instance 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 on n-h2-860863-1 Oct 10 19:00:02.461382 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-209ba44f-2f0d-4901-b9d3-ed29bbf5088e req-054d28e4-5720-471c-81eb-b35ae7b0502f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050286 Oct 10 19:00:02.461382 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1083/2408] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:02.464618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5dda0890-c3a2-431a-92d1-a9c3763917c7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:02.465663 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5dda0890-c3a2-431a-92d1-a9c3763917c7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:02.475599 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5dda0890-c3a2-431a-92d1-a9c3763917c7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:02.481604 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5dda0890-c3a2-431a-92d1-a9c3763917c7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:02.482381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5dda0890-c3a2-431a-92d1-a9c3763917c7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:02.483288 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5dda0890-c3a2-431a-92d1-a9c3763917c7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:02.483898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5dda0890-c3a2-431a-92d1-a9c3763917c7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:02.485987 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5dda0890-c3a2-431a-92d1-a9c3763917c7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:02.869535 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-27bc62d7-4a3d-4d23-8cf6-03c01d1fe21b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:02.879201 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-27bc62d7-4a3d-4d23-8cf6-03c01d1fe21b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1308 microversion: 2.1 time: 0.736518 Oct 10 19:00:02.879782 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1326/2409] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:02 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1308 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:02.885459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-20e9cd71-a298-4695-aff7-4f55be378979 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:02.886341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-20e9cd71-a298-4695-aff7-4f55be378979 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:02.893060 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-20e9cd71-a298-4695-aff7-4f55be378979 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:02.894332 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-20e9cd71-a298-4695-aff7-4f55be378979 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:02.894940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-20e9cd71-a298-4695-aff7-4f55be378979 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:02.895854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-20e9cd71-a298-4695-aff7-4f55be378979 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:02.896898 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-20e9cd71-a298-4695-aff7-4f55be378979 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:02.897323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-20e9cd71-a298-4695-aff7-4f55be378979 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:02.913618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5dda0890-c3a2-431a-92d1-a9c3763917c7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:02.924286 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5dda0890-c3a2-431a-92d1-a9c3763917c7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.464550 Oct 10 19:00:02.937618 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1084/2410] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:02 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:03.088169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-267d00a8-e725-4b3d-982c-b801e9e19460 req-9050f5da-3fd4-43cc-b828-695de0b96fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b24fdb-281e-478a-8aca-665e35082ba4", "tag": "9fb205c6-4673-44b4-86aa-fdaf03c74fb8"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:03.094306 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:03.098613 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-267d00a8-e725-4b3d-982c-b801e9e19460 req-9050f5da-3fd4-43cc-b828-695de0b96fe1 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:03.101645 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-267d00a8-e725-4b3d-982c-b801e9e19460 req-9050f5da-3fd4-43cc-b828-695de0b96fe1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:03.101645 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-267d00a8-e725-4b3d-982c-b801e9e19460 req-9050f5da-3fd4-43cc-b828-695de0b96fe1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:03.136374 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-267d00a8-e725-4b3d-982c-b801e9e19460 req-9050f5da-3fd4-43cc-b828-695de0b96fe1 service nova] Creating event network-changed:9fb205c6-4673-44b4-86aa-fdaf03c74fb8 for instance c3b24fdb-281e-478a-8aca-665e35082ba4 on n-h1-860863-1 Oct 10 19:00:03.161548 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-267d00a8-e725-4b3d-982c-b801e9e19460 req-9050f5da-3fd4-43cc-b828-695de0b96fe1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069901 Oct 10 19:00:03.161548 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1085/2411] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 19:00:03.165725 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:03.168100 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:03.179696 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:03.186970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:03.186970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:03.186970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:03.186970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:03.186970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:03.224813 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:03.225502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:03.226120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:03.226994 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lazy-loading 'fault' on Instance uuid 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:00:03.362504 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:03.376863 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:03.379114 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '789ef7a66ff042b9abebe36823008f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca11fe18cc64adfbc06166601106c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:03.383648 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cf0d8f4e-3aee-449d-bfed-61e5ae1fe802 tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 200 len: 1351 microversion: 2.25 time: 0.227736 Oct 10 19:00:03.391026 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1086/2412] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:00:03 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 1351 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:00:03.400830 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3a0e50ab-2317-46ba-aca5-58b66da290b7 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f3192196af0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:03.518392 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3a0e50ab-2317-46ba-aca5-58b66da290b7 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.127798 Oct 10 19:00:03.519420 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1087/2413] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:03 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:03.527329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1bce1300-ab88-4124-b51f-c1d3931024d1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:03.529103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1bce1300-ab88-4124-b51f-c1d3931024d1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:03.537809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1bce1300-ab88-4124-b51f-c1d3931024d1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:03.538616 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1bce1300-ab88-4124-b51f-c1d3931024d1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:03.540111 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1bce1300-ab88-4124-b51f-c1d3931024d1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:03.541110 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1bce1300-ab88-4124-b51f-c1d3931024d1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:03.541907 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1bce1300-ab88-4124-b51f-c1d3931024d1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:03.543179 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1bce1300-ab88-4124-b51f-c1d3931024d1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:03.904356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-20e9cd71-a298-4695-aff7-4f55be378979 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:03.919787 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-20e9cd71-a298-4695-aff7-4f55be378979 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 1.037535 Oct 10 19:00:03.931127 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1327/2414] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:02 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:03.948420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-72580fc2-50c1-4f30-b5ce-5cf70d231a3f req-42f709b0-1f4f-4bf6-a870-0620b114fd95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4098c038-9bbe-4f57-8b58-a6b33603f231", "name": "network-vif-plugged", "status": "completed", "tag": "f24f31eb-483d-4f5b-a6a5-8c0d1e1cce67"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:03.977006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-72580fc2-50c1-4f30-b5ce-5cf70d231a3f req-42f709b0-1f4f-4bf6-a870-0620b114fd95 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:03.980068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1bce1300-ab88-4124-b51f-c1d3931024d1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:03.981687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-72580fc2-50c1-4f30-b5ce-5cf70d231a3f req-42f709b0-1f4f-4bf6-a870-0620b114fd95 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:03.982367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-72580fc2-50c1-4f30-b5ce-5cf70d231a3f req-42f709b0-1f4f-4bf6-a870-0620b114fd95 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:03.995553 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1bce1300-ab88-4124-b51f-c1d3931024d1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1320 microversion: 2.1 time: 0.472054 Oct 10 19:00:03.995553 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1088/2415] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:03 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1320 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:04.012353 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6dd44a3e-4891-42d1-8e41-6ddf2052ac69 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:04.013083 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6dd44a3e-4891-42d1-8e41-6ddf2052ac69 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:04.017787 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-72580fc2-50c1-4f30-b5ce-5cf70d231a3f req-42f709b0-1f4f-4bf6-a870-0620b114fd95 service nova] Creating event network-vif-plugged:f24f31eb-483d-4f5b-a6a5-8c0d1e1cce67 for instance 4098c038-9bbe-4f57-8b58-a6b33603f231 on n-h1-860863-1 Oct 10 19:00:04.019104 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6dd44a3e-4891-42d1-8e41-6ddf2052ac69 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:04.019610 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6dd44a3e-4891-42d1-8e41-6ddf2052ac69 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:04.020103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6dd44a3e-4891-42d1-8e41-6ddf2052ac69 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:04.021418 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6dd44a3e-4891-42d1-8e41-6ddf2052ac69 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:04.023198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6dd44a3e-4891-42d1-8e41-6ddf2052ac69 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:04.024441 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6dd44a3e-4891-42d1-8e41-6ddf2052ac69 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:04.026541 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-72580fc2-50c1-4f30-b5ce-5cf70d231a3f req-42f709b0-1f4f-4bf6-a870-0620b114fd95 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089994 Oct 10 19:00:04.029871 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1328/2416] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:04.040260 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-478e9ef8-1fd0-4ce7-ba30-9a4a69a8a0ee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:04.042020 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-478e9ef8-1fd0-4ce7-ba30-9a4a69a8a0ee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:04.050031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-478e9ef8-1fd0-4ce7-ba30-9a4a69a8a0ee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:04.050764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-478e9ef8-1fd0-4ce7-ba30-9a4a69a8a0ee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:04.051951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-478e9ef8-1fd0-4ce7-ba30-9a4a69a8a0ee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:04.053252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-478e9ef8-1fd0-4ce7-ba30-9a4a69a8a0ee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:04.053904 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-478e9ef8-1fd0-4ce7-ba30-9a4a69a8a0ee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:04.054486 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-478e9ef8-1fd0-4ce7-ba30-9a4a69a8a0ee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:04.262716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-478e9ef8-1fd0-4ce7-ba30-9a4a69a8a0ee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:04.274510 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-478e9ef8-1fd0-4ce7-ba30-9a4a69a8a0ee tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.242373 Oct 10 19:00:04.292186 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1329/2417] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:04 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:04.373924 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6dd44a3e-4891-42d1-8e41-6ddf2052ac69 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:04.384941 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6dd44a3e-4891-42d1-8e41-6ddf2052ac69 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1308 microversion: 2.1 time: 0.389375 Oct 10 19:00:04.385751 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1089/2418] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:03 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1308 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:04.418726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0b70af6f-6ca7-4375-a4db-e5f059159bcf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:04.419705 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0b70af6f-6ca7-4375-a4db-e5f059159bcf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] [instance: 7fa4cba0-5184-462b-ab0b-c03f2a104ae6] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:04.460944 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b70af6f-6ca7-4375-a4db-e5f059159bcf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:04.460944 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b70af6f-6ca7-4375-a4db-e5f059159bcf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:04.461385 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b70af6f-6ca7-4375-a4db-e5f059159bcf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:04.464565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b70af6f-6ca7-4375-a4db-e5f059159bcf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:04.465515 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b70af6f-6ca7-4375-a4db-e5f059159bcf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:04.469082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b70af6f-6ca7-4375-a4db-e5f059159bcf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:04.520090 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-4ca77fa0-fe72-4a54-9ea5-7803e19ee9a3 req-121d80c3-aad5-472f-b94e-28c46825ecc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f7fa2bf-4c6b-4023-b935-69aa11ef98b5", "tag": "15e57f63-4842-479a-9767-e8443587cdb2"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:04.524202 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-0b70af6f-6ca7-4375-a4db-e5f059159bcf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] HTTP exception thrown: Instance 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 could not be found. Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0b70af6f-6ca7-4375-a4db-e5f059159bcf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Request method failure captured: Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 HTTP/1.1 Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGnT74k3jz6Wa3pVJ9ZcmChqa1oL8HCHZkX6SpHPwSHLQBVyzr9Zeld4-bJk6nTBopnJ7frY84hkg0yHAgEYqC7YxphYQ1Zc_oeJrc_LnVexerBe0ggImFM7jD1c56DBEpM-m7xTb4GcdGxbn6BPhealjMNmOuwebHjUGz1MpRwC9WI Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Openstack-Nova-Api-Version: 2.25 Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 8ca11fe18cc64adfbc06166601106c7c Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-601943355 Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ca11fe18cc64adfbc06166601106c7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ca11fe18cc64adfbc06166601106c7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ca11fe18cc64adfbc06166601106c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ca11fe18cc64adfbc06166601106c7c"}]}] Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-601943355 Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 8ca11fe18cc64adfbc06166601106c7c Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-601943355 Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-LiveAutoBlockMigrationV225Test-601943355-project Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 789ef7a66ff042b9abebe36823008f8f Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-601943355-project Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 could not be found. Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '7fa4cba0-5184-462b-ab0b-c03f2a104ae6'} Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 could not be found. Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 could not be found. Oct 10 19:00:04.526504 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:00:04.531237 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:00:04.531237 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:00:04.531237 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:00:04.531237 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:00:04.531237 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:00:04.531237 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:00:04.531237 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:00:04.531237 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 could not be found. Oct 10 19:00:04.531237 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:00:04.531237 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0b70af6f-6ca7-4375-a4db-e5f059159bcf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] Returning 404 to user: Instance 7fa4cba0-5184-462b-ab0b-c03f2a104ae6 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:00:04.532442 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0b70af6f-6ca7-4375-a4db-e5f059159bcf tempest-LiveAutoBlockMigrationV225Test-601943355 tempest-LiveAutoBlockMigrationV225Test-601943355-project] 10.222.0.43 "GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6" status: 404 len: 111 microversion: 2.25 time: 0.118799 Oct 10 19:00:04.533041 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1330/2419] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:00:04 2022] GET /compute/v2.1/servers/7fa4cba0-5184-462b-ab0b-c03f2a104ae6 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 10 19:00:04.552130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4ca77fa0-fe72-4a54-9ea5-7803e19ee9a3 req-121d80c3-aad5-472f-b94e-28c46825ecc2 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:04.552857 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4ca77fa0-fe72-4a54-9ea5-7803e19ee9a3 req-121d80c3-aad5-472f-b94e-28c46825ecc2 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:04.553898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4ca77fa0-fe72-4a54-9ea5-7803e19ee9a3 req-121d80c3-aad5-472f-b94e-28c46825ecc2 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:04.561348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bf9a8d14-523f-4ab5-a0c0-960f3424eaa4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318e9d8280>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:04.578083 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-4ca77fa0-fe72-4a54-9ea5-7803e19ee9a3 req-121d80c3-aad5-472f-b94e-28c46825ecc2 service nova] Creating event network-changed:15e57f63-4842-479a-9767-e8443587cdb2 for instance 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 on n-h2-860863-1 Oct 10 19:00:04.592078 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-4ca77fa0-fe72-4a54-9ea5-7803e19ee9a3 req-121d80c3-aad5-472f-b94e-28c46825ecc2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080158 Oct 10 19:00:04.593441 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1090/2420] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:04.639623 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bf9a8d14-523f-4ab5-a0c0-960f3424eaa4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.105378 Oct 10 19:00:04.648458 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1331/2421] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:04 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:04.959686 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ec50f915-76f2-41b0-b4c6-6dceab3b8800 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:04.960373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ec50f915-76f2-41b0-b4c6-6dceab3b8800 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:04.974072 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec50f915-76f2-41b0-b4c6-6dceab3b8800 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:04.974816 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec50f915-76f2-41b0-b4c6-6dceab3b8800 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:04.977201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec50f915-76f2-41b0-b4c6-6dceab3b8800 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:04.981469 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec50f915-76f2-41b0-b4c6-6dceab3b8800 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:04.981469 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec50f915-76f2-41b0-b4c6-6dceab3b8800 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:04.981469 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec50f915-76f2-41b0-b4c6-6dceab3b8800 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:05.018870 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bdea3cb0-c263-4c5b-8f50-f76105664043 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:05.020371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bdea3cb0-c263-4c5b-8f50-f76105664043 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:05.036859 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bdea3cb0-c263-4c5b-8f50-f76105664043 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:05.040387 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bdea3cb0-c263-4c5b-8f50-f76105664043 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:05.041227 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bdea3cb0-c263-4c5b-8f50-f76105664043 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:05.044232 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bdea3cb0-c263-4c5b-8f50-f76105664043 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:05.044949 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bdea3cb0-c263-4c5b-8f50-f76105664043 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:05.045531 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bdea3cb0-c263-4c5b-8f50-f76105664043 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:05.058125 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:05.392888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bdea3cb0-c263-4c5b-8f50-f76105664043 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:05.403456 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bdea3cb0-c263-4c5b-8f50-f76105664043 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1320 microversion: 2.1 time: 0.388485 Oct 10 19:00:05.407841 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1332/2422] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:05 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1320 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:05.418131 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-68b34ce7-fdf2-4d8d-b1e1-c6b7d16730b2 req-c8b11b38-c281-4e5d-88a7-7f1feabe55ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b24fdb-281e-478a-8aca-665e35082ba4", "tag": "95c07e43-0ca4-462d-926e-60121c79a4aa"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:05.438103 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-68b34ce7-fdf2-4d8d-b1e1-c6b7d16730b2 req-c8b11b38-c281-4e5d-88a7-7f1feabe55ab service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:05.441505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-68b34ce7-fdf2-4d8d-b1e1-c6b7d16730b2 req-c8b11b38-c281-4e5d-88a7-7f1feabe55ab service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:05.442162 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-68b34ce7-fdf2-4d8d-b1e1-c6b7d16730b2 req-c8b11b38-c281-4e5d-88a7-7f1feabe55ab service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:05.458933 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-68b34ce7-fdf2-4d8d-b1e1-c6b7d16730b2 req-c8b11b38-c281-4e5d-88a7-7f1feabe55ab service nova] Creating event network-changed:95c07e43-0ca4-462d-926e-60121c79a4aa for instance c3b24fdb-281e-478a-8aca-665e35082ba4 on n-h1-860863-1 Oct 10 19:00:05.468711 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-68b34ce7-fdf2-4d8d-b1e1-c6b7d16730b2 req-c8b11b38-c281-4e5d-88a7-7f1feabe55ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056323 Oct 10 19:00:05.470400 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1333/2423] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:05.479620 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5f138a4f-e298-4484-a7de-e4cc37e711f8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:05.480602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5f138a4f-e298-4484-a7de-e4cc37e711f8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:05.493707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f138a4f-e298-4484-a7de-e4cc37e711f8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:05.494874 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f138a4f-e298-4484-a7de-e4cc37e711f8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:05.495651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f138a4f-e298-4484-a7de-e4cc37e711f8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:05.496778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f138a4f-e298-4484-a7de-e4cc37e711f8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:05.497701 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f138a4f-e298-4484-a7de-e4cc37e711f8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:05.498309 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5f138a4f-e298-4484-a7de-e4cc37e711f8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:05.861985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5f138a4f-e298-4484-a7de-e4cc37e711f8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:05.874443 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5f138a4f-e298-4484-a7de-e4cc37e711f8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.399271 Oct 10 19:00:05.888565 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1334/2424] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:05 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:05.888565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a25b6a91-f4f5-465e-bc49-f89b71c99bdb tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:05.888565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a25b6a91-f4f5-465e-bc49-f89b71c99bdb tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:05.901149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a25b6a91-f4f5-465e-bc49-f89b71c99bdb tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:05.901640 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a25b6a91-f4f5-465e-bc49-f89b71c99bdb tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:05.905447 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a25b6a91-f4f5-465e-bc49-f89b71c99bdb tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:05.906202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a25b6a91-f4f5-465e-bc49-f89b71c99bdb tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:05.906678 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a25b6a91-f4f5-465e-bc49-f89b71c99bdb tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:05.907115 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a25b6a91-f4f5-465e-bc49-f89b71c99bdb tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:05.915668 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ec50f915-76f2-41b0-b4c6-6dceab3b8800 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:05.926529 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ec50f915-76f2-41b0-b4c6-6dceab3b8800 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.972411 Oct 10 19:00:05.929382 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1091/2425] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:04 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:05.934231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-82f35dbb-bf0a-4c1c-9bed-7d00d75c1801 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319220f700>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:06.042092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=16 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:06.048055 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-82f35dbb-bf0a-4c1c-9bed-7d00d75c1801 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.117563 Oct 10 19:00:06.051417 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1092/2426] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:05 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:06.068574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-1839627d-cfae-4480-a4fd-8197dd32bc2b req-c12f814c-85fc-447f-9276-b70c881f7aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd4c6e16-56ef-4eb0-861f-f0da22f85d58", "name": "network-vif-plugged", "status": "completed", "tag": "e9e14bef-c25f-4b3e-a8dc-fc782f23d82a"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:06.090908 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1839627d-cfae-4480-a4fd-8197dd32bc2b req-c12f814c-85fc-447f-9276-b70c881f7aa0 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:06.091836 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1839627d-cfae-4480-a4fd-8197dd32bc2b req-c12f814c-85fc-447f-9276-b70c881f7aa0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:06.094328 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1839627d-cfae-4480-a4fd-8197dd32bc2b req-c12f814c-85fc-447f-9276-b70c881f7aa0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:06.121648 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-1839627d-cfae-4480-a4fd-8197dd32bc2b req-c12f814c-85fc-447f-9276-b70c881f7aa0 service nova] Creating event network-vif-plugged:e9e14bef-c25f-4b3e-a8dc-fc782f23d82a for instance fd4c6e16-56ef-4eb0-861f-f0da22f85d58 on n-h1-860863-1 Oct 10 19:00:06.133843 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-1839627d-cfae-4480-a4fd-8197dd32bc2b req-c12f814c-85fc-447f-9276-b70c881f7aa0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079748 Oct 10 19:00:06.139854 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1093/2427] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:06.188736 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a25b6a91-f4f5-465e-bc49-f89b71c99bdb tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:06.202327 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a25b6a91-f4f5-465e-bc49-f89b71c99bdb tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1308 microversion: 2.1 time: 0.325768 Oct 10 19:00:06.205043 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1335/2428] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:05 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1308 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:06.434951 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e36dbb58-997c-4bbe-9f7d-99f775c5167f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:06.436885 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e36dbb58-997c-4bbe-9f7d-99f775c5167f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:06.447248 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e36dbb58-997c-4bbe-9f7d-99f775c5167f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:06.448025 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e36dbb58-997c-4bbe-9f7d-99f775c5167f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:06.448644 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e36dbb58-997c-4bbe-9f7d-99f775c5167f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:06.449705 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e36dbb58-997c-4bbe-9f7d-99f775c5167f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:06.450308 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e36dbb58-997c-4bbe-9f7d-99f775c5167f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:06.451060 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e36dbb58-997c-4bbe-9f7d-99f775c5167f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:06.635783 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-9cda1ebc-8c47-4bc9-8e73-447093df1e04 req-acd7fbdb-ed98-4340-8e0c-eefb43926cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e295c8-6ffa-4153-a9ae-1a2ce81a1b72", "tag": "e11576b3-4ac1-481a-b46a-0785fc909905"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:06.652564 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-9cda1ebc-8c47-4bc9-8e73-447093df1e04 req-acd7fbdb-ed98-4340-8e0c-eefb43926cb5 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:06.655010 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-9cda1ebc-8c47-4bc9-8e73-447093df1e04 req-acd7fbdb-ed98-4340-8e0c-eefb43926cb5 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:06.656857 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-9cda1ebc-8c47-4bc9-8e73-447093df1e04 req-acd7fbdb-ed98-4340-8e0c-eefb43926cb5 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:06.689916 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-9cda1ebc-8c47-4bc9-8e73-447093df1e04 req-acd7fbdb-ed98-4340-8e0c-eefb43926cb5 service nova] Creating event network-changed:e11576b3-4ac1-481a-b46a-0785fc909905 for instance 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 on n-h1-860863-1 Oct 10 19:00:06.706399 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-9cda1ebc-8c47-4bc9-8e73-447093df1e04 req-acd7fbdb-ed98-4340-8e0c-eefb43926cb5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071868 Oct 10 19:00:06.710622 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1336/2429] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 19:00:06.903053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4ddfc77e-a912-4111-b71d-7e4e3c14630a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:06.903757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4ddfc77e-a912-4111-b71d-7e4e3c14630a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:06.920722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ddfc77e-a912-4111-b71d-7e4e3c14630a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:06.928202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ddfc77e-a912-4111-b71d-7e4e3c14630a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:06.928202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ddfc77e-a912-4111-b71d-7e4e3c14630a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:06.928202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ddfc77e-a912-4111-b71d-7e4e3c14630a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:06.928202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ddfc77e-a912-4111-b71d-7e4e3c14630a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:06.928202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4ddfc77e-a912-4111-b71d-7e4e3c14630a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:06.960213 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e36dbb58-997c-4bbe-9f7d-99f775c5167f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:06.969933 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e36dbb58-997c-4bbe-9f7d-99f775c5167f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1320 microversion: 2.1 time: 0.540251 Oct 10 19:00:06.986496 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1094/2430] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:06 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1320 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:06.990376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2b520043-3bdb-47b4-a8e5-64a6211eaa9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:06.991348 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2b520043-3bdb-47b4-a8e5-64a6211eaa9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:07.010832 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2b520043-3bdb-47b4-a8e5-64a6211eaa9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:07.011579 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2b520043-3bdb-47b4-a8e5-64a6211eaa9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:07.012162 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2b520043-3bdb-47b4-a8e5-64a6211eaa9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:07.013161 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2b520043-3bdb-47b4-a8e5-64a6211eaa9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:07.013837 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2b520043-3bdb-47b4-a8e5-64a6211eaa9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:07.014512 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2b520043-3bdb-47b4-a8e5-64a6211eaa9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:07.134859 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4ddfc77e-a912-4111-b71d-7e4e3c14630a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:07.143392 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4ddfc77e-a912-4111-b71d-7e4e3c14630a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.244479 Oct 10 19:00:07.157170 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1337/2431] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:06 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:07.168040 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7deaa7ba-c84f-4506-b988-3f8289cb7bf1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318deb7310>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:07.263820 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7deaa7ba-c84f-4506-b988-3f8289cb7bf1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.105376 Oct 10 19:00:07.265515 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1338/2432] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:07 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:07.270493 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fca51193-7662-4188-9442-5a9aaa5cd695 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:07.271368 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fca51193-7662-4188-9442-5a9aaa5cd695 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:07.278064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fca51193-7662-4188-9442-5a9aaa5cd695 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:07.278756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fca51193-7662-4188-9442-5a9aaa5cd695 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:07.279395 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fca51193-7662-4188-9442-5a9aaa5cd695 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:07.280289 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fca51193-7662-4188-9442-5a9aaa5cd695 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:07.280981 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fca51193-7662-4188-9442-5a9aaa5cd695 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:07.281557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fca51193-7662-4188-9442-5a9aaa5cd695 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:07.588166 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fca51193-7662-4188-9442-5a9aaa5cd695 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:07.601887 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fca51193-7662-4188-9442-5a9aaa5cd695 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1308 microversion: 2.1 time: 0.334782 Oct 10 19:00:07.621175 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1339/2433] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:07 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:07.727054 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2b520043-3bdb-47b4-a8e5-64a6211eaa9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:07.738652 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2b520043-3bdb-47b4-a8e5-64a6211eaa9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.755364 Oct 10 19:00:07.743373 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1095/2434] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:06 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:08.011162 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2ba3949c-99f0-437d-8996-c9d92391dbe1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:08.011793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2ba3949c-99f0-437d-8996-c9d92391dbe1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:08.023589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2ba3949c-99f0-437d-8996-c9d92391dbe1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:08.026847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2ba3949c-99f0-437d-8996-c9d92391dbe1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:08.026847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2ba3949c-99f0-437d-8996-c9d92391dbe1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:08.026847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2ba3949c-99f0-437d-8996-c9d92391dbe1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:08.026847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2ba3949c-99f0-437d-8996-c9d92391dbe1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:08.026847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2ba3949c-99f0-437d-8996-c9d92391dbe1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:08.170484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-853b6090-08d2-462b-a2bd-6b4c8b1234fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:08.171084 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-853b6090-08d2-462b-a2bd-6b4c8b1234fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:08.182990 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-853b6090-08d2-462b-a2bd-6b4c8b1234fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:08.189226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-853b6090-08d2-462b-a2bd-6b4c8b1234fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:08.189909 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-853b6090-08d2-462b-a2bd-6b4c8b1234fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:08.190823 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-853b6090-08d2-462b-a2bd-6b4c8b1234fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:08.191281 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-853b6090-08d2-462b-a2bd-6b4c8b1234fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:08.191693 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-853b6090-08d2-462b-a2bd-6b4c8b1234fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:08.302913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2ba3949c-99f0-437d-8996-c9d92391dbe1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:08.311221 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2ba3949c-99f0-437d-8996-c9d92391dbe1 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1320 microversion: 2.1 time: 0.306430 Oct 10 19:00:08.330910 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1340/2435] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:08 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1320 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:08.336312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5b15c368-d9b6-4473-8955-82d320f0ada6 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318df91b80>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:08.420566 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5b15c368-d9b6-4473-8955-82d320f0ada6 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.087885 Oct 10 19:00:08.428432 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1341/2436] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:08 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:08.627679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-388c55d8-33d0-4051-b352-27f7a462e855 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:08.629680 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-853b6090-08d2-462b-a2bd-6b4c8b1234fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:08.634495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-388c55d8-33d0-4051-b352-27f7a462e855 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:08.641804 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-853b6090-08d2-462b-a2bd-6b4c8b1234fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.475077 Oct 10 19:00:08.651960 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-388c55d8-33d0-4051-b352-27f7a462e855 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:08.652803 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1096/2437] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:08 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:08.657723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-388c55d8-33d0-4051-b352-27f7a462e855 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:08.658477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-388c55d8-33d0-4051-b352-27f7a462e855 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:08.659447 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-388c55d8-33d0-4051-b352-27f7a462e855 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:08.659978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-388c55d8-33d0-4051-b352-27f7a462e855 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:08.660471 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-388c55d8-33d0-4051-b352-27f7a462e855 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:08.772411 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fd9d834c-54bd-4c24-99bc-0932a96020bc tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:08.773065 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fd9d834c-54bd-4c24-99bc-0932a96020bc tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:08.783495 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd9d834c-54bd-4c24-99bc-0932a96020bc tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:08.784011 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd9d834c-54bd-4c24-99bc-0932a96020bc tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:08.787537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd9d834c-54bd-4c24-99bc-0932a96020bc tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:08.787537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd9d834c-54bd-4c24-99bc-0932a96020bc tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:08.787537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd9d834c-54bd-4c24-99bc-0932a96020bc tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:08.787537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd9d834c-54bd-4c24-99bc-0932a96020bc tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:09.128407 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-388c55d8-33d0-4051-b352-27f7a462e855 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:09.143812 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-388c55d8-33d0-4051-b352-27f7a462e855 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1308 microversion: 2.1 time: 0.517205 Oct 10 19:00:09.153068 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1342/2438] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:08 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1308 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:09.171100 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-6de03530-e241-46d8-ac22-76344ff78578 req-ece88c18-1e96-4124-a358-227bd569d09c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b24fdb-281e-478a-8aca-665e35082ba4", "tag": "4fec9244-ae46-4042-9186-dcea2242c021"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:09.187060 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6de03530-e241-46d8-ac22-76344ff78578 req-ece88c18-1e96-4124-a358-227bd569d09c service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:09.188007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6de03530-e241-46d8-ac22-76344ff78578 req-ece88c18-1e96-4124-a358-227bd569d09c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:09.188740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-6de03530-e241-46d8-ac22-76344ff78578 req-ece88c18-1e96-4124-a358-227bd569d09c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:09.215519 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-6de03530-e241-46d8-ac22-76344ff78578 req-ece88c18-1e96-4124-a358-227bd569d09c service nova] Creating event network-changed:4fec9244-ae46-4042-9186-dcea2242c021 for instance c3b24fdb-281e-478a-8aca-665e35082ba4 on n-h1-860863-1 Oct 10 19:00:09.224066 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-6de03530-e241-46d8-ac22-76344ff78578 req-ece88c18-1e96-4124-a358-227bd569d09c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068692 Oct 10 19:00:09.225284 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1343/2439] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:09.264264 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-92cb740c-2c16-41bd-95ae-eb3d7cce1be9 req-0bb5ecf9-c433-4509-b05b-9c9dc2a2052e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22fa54d-372c-4887-8875-a3c56b3850b1", "name": "network-vif-plugged", "status": "completed", "tag": "22ce5b61-90fe-4432-bece-f8ea63b95965"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:09.281677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-92cb740c-2c16-41bd-95ae-eb3d7cce1be9 req-0bb5ecf9-c433-4509-b05b-9c9dc2a2052e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:09.283325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-92cb740c-2c16-41bd-95ae-eb3d7cce1be9 req-0bb5ecf9-c433-4509-b05b-9c9dc2a2052e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:09.284040 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-92cb740c-2c16-41bd-95ae-eb3d7cce1be9 req-0bb5ecf9-c433-4509-b05b-9c9dc2a2052e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:09.309132 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-92cb740c-2c16-41bd-95ae-eb3d7cce1be9 req-0bb5ecf9-c433-4509-b05b-9c9dc2a2052e service nova] Creating event network-vif-plugged:22ce5b61-90fe-4432-bece-f8ea63b95965 for instance c22fa54d-372c-4887-8875-a3c56b3850b1 on n-h2-860863-1 Oct 10 19:00:09.318580 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-92cb740c-2c16-41bd-95ae-eb3d7cce1be9 req-0bb5ecf9-c433-4509-b05b-9c9dc2a2052e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060634 Oct 10 19:00:09.320239 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1344/2440] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:09.342523 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1fe676cf-21f4-4a2a-af6c-1a2acc4b107c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:09.344270 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1fe676cf-21f4-4a2a-af6c-1a2acc4b107c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:09.367357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1fe676cf-21f4-4a2a-af6c-1a2acc4b107c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:09.368310 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1fe676cf-21f4-4a2a-af6c-1a2acc4b107c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:09.370022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1fe676cf-21f4-4a2a-af6c-1a2acc4b107c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:09.371818 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1fe676cf-21f4-4a2a-af6c-1a2acc4b107c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:09.372787 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1fe676cf-21f4-4a2a-af6c-1a2acc4b107c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:09.373522 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1fe676cf-21f4-4a2a-af6c-1a2acc4b107c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:09.673234 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1fe676cf-21f4-4a2a-af6c-1a2acc4b107c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:09.676378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:09.698528 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1fe676cf-21f4-4a2a-af6c-1a2acc4b107c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1320 microversion: 2.1 time: 0.366141 Oct 10 19:00:09.699054 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1345/2441] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:09 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1320 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:09.712749 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-93b7afc7-322e-4dd1-96a6-96d5c18700ec tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318eb03b80>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:09.811420 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-93b7afc7-322e-4dd1-96a6-96d5c18700ec tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.107989 Oct 10 19:00:09.811420 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1346/2442] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:09 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:09.828072 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-205b788c-ff5e-44ef-b24e-84eab377d3cb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:09.828764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-205b788c-ff5e-44ef-b24e-84eab377d3cb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:09.837235 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-205b788c-ff5e-44ef-b24e-84eab377d3cb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:09.837812 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-205b788c-ff5e-44ef-b24e-84eab377d3cb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:09.838440 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-205b788c-ff5e-44ef-b24e-84eab377d3cb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:09.839594 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-205b788c-ff5e-44ef-b24e-84eab377d3cb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:09.840061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-205b788c-ff5e-44ef-b24e-84eab377d3cb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:09.840485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-205b788c-ff5e-44ef-b24e-84eab377d3cb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:09.845100 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fd9d834c-54bd-4c24-99bc-0932a96020bc tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:09.863610 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fd9d834c-54bd-4c24-99bc-0932a96020bc tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 1.097120 Oct 10 19:00:09.872730 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1097/2443] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:08 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:10.190935 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4947c838-8f63-4d2d-87b1-ecf1ce0600aa tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:10.192842 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4947c838-8f63-4d2d-87b1-ecf1ce0600aa tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:10.208960 n-d-860863-1 devstack@n-api.service[127289]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 19:00:10.208960 n-d-860863-1 devstack@n-api.service[127289]: Mon Oct 10 19:00:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 (ip 10.222.0.43) !!! Oct 10 19:00:10.233957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4947c838-8f63-4d2d-87b1-ecf1ce0600aa tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:10.272939 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4947c838-8f63-4d2d-87b1-ecf1ce0600aa tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:10.272939 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4947c838-8f63-4d2d-87b1-ecf1ce0600aa tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:10.272939 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4947c838-8f63-4d2d-87b1-ecf1ce0600aa tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:10.272939 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4947c838-8f63-4d2d-87b1-ecf1ce0600aa tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:10.274701 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4947c838-8f63-4d2d-87b1-ecf1ce0600aa tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:10.320153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-205b788c-ff5e-44ef-b24e-84eab377d3cb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:10.338673 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-205b788c-ff5e-44ef-b24e-84eab377d3cb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.527922 Oct 10 19:00:10.339287 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1347/2444] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:09 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:10.601324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4947c838-8f63-4d2d-87b1-ecf1ce0600aa tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:10.603735 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:10.609821 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4947c838-8f63-4d2d-87b1-ecf1ce0600aa tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1308 microversion: 2.1 time: 0.429163 Oct 10 19:00:10.610432 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1098/2445] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:10 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1308 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:10.721560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a69d6eb5-a80a-4daf-8daf-1209ee4166db tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:10.722097 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a69d6eb5-a80a-4daf-8daf-1209ee4166db tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:10.728975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a69d6eb5-a80a-4daf-8daf-1209ee4166db tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:10.734665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a69d6eb5-a80a-4daf-8daf-1209ee4166db tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:10.734665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a69d6eb5-a80a-4daf-8daf-1209ee4166db tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:10.734665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a69d6eb5-a80a-4daf-8daf-1209ee4166db tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:10.734665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a69d6eb5-a80a-4daf-8daf-1209ee4166db tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:10.734665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a69d6eb5-a80a-4daf-8daf-1209ee4166db tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:10.824270 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-03f817af-2adf-43fe-8da4-28ed8d0b99a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921b09d0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:10.913389 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-03f817af-2adf-43fe-8da4-28ed8d0b99a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.093463 Oct 10 19:00:10.915806 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1099/2446] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:10 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:10.921286 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5b76134c-1c98-4e66-8d62-c3fe3a7a0c7b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:10.922749 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5b76134c-1c98-4e66-8d62-c3fe3a7a0c7b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:10.937227 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b76134c-1c98-4e66-8d62-c3fe3a7a0c7b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:10.938096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b76134c-1c98-4e66-8d62-c3fe3a7a0c7b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:10.938787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b76134c-1c98-4e66-8d62-c3fe3a7a0c7b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:10.939953 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b76134c-1c98-4e66-8d62-c3fe3a7a0c7b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:10.941210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b76134c-1c98-4e66-8d62-c3fe3a7a0c7b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:10.943600 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b76134c-1c98-4e66-8d62-c3fe3a7a0c7b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:11.271006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a69d6eb5-a80a-4daf-8daf-1209ee4166db tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:11.275881 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5b76134c-1c98-4e66-8d62-c3fe3a7a0c7b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:11.282453 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a69d6eb5-a80a-4daf-8daf-1209ee4166db tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1320 microversion: 2.1 time: 0.564846 Oct 10 19:00:11.286255 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1348/2447] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:10 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1320 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:11.287608 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5b76134c-1c98-4e66-8d62-c3fe3a7a0c7b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.368218 Oct 10 19:00:11.288987 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1100/2448] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:10 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:11.363542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-eb656aa9-5e54-47dd-85c0-9e1dfe9f6881 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:11.365546 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-eb656aa9-5e54-47dd-85c0-9e1dfe9f6881 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:11.375879 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eb656aa9-5e54-47dd-85c0-9e1dfe9f6881 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:11.377830 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eb656aa9-5e54-47dd-85c0-9e1dfe9f6881 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:11.378477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eb656aa9-5e54-47dd-85c0-9e1dfe9f6881 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:11.380110 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eb656aa9-5e54-47dd-85c0-9e1dfe9f6881 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:11.381963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eb656aa9-5e54-47dd-85c0-9e1dfe9f6881 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:11.383193 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-eb656aa9-5e54-47dd-85c0-9e1dfe9f6881 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:11.632484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fb59547d-9afd-4b99-b3e8-974d592645ea tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:11.633334 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fb59547d-9afd-4b99-b3e8-974d592645ea tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:11.645364 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb59547d-9afd-4b99-b3e8-974d592645ea tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:11.648779 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb59547d-9afd-4b99-b3e8-974d592645ea tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:11.648779 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb59547d-9afd-4b99-b3e8-974d592645ea tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:11.648779 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb59547d-9afd-4b99-b3e8-974d592645ea tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:11.648779 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb59547d-9afd-4b99-b3e8-974d592645ea tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:11.648779 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb59547d-9afd-4b99-b3e8-974d592645ea tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:11.767382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-eb656aa9-5e54-47dd-85c0-9e1dfe9f6881 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:11.785840 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-eb656aa9-5e54-47dd-85c0-9e1dfe9f6881 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.421814 Oct 10 19:00:11.789021 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1349/2449] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:11 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:11.932601 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a1acef2c-f604-41b5-a55b-097e7309685d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318eb399d0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:11.980573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fb59547d-9afd-4b99-b3e8-974d592645ea tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:11.989786 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fb59547d-9afd-4b99-b3e8-974d592645ea tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1308 microversion: 2.1 time: 0.361069 Oct 10 19:00:12.009077 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1101/2450] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:11 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:12.009077 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-ebb0297c-8690-46af-8aa5-f4d208a643d3 req-2c74c0c3-97ea-422f-8198-7756946c9aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7fa2bf-4c6b-4023-b935-69aa11ef98b5", "name": "network-vif-plugged", "status": "completed", "tag": "15e57f63-4842-479a-9767-e8443587cdb2"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:12.011021 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-ebb0297c-8690-46af-8aa5-f4d208a643d3 req-2c74c0c3-97ea-422f-8198-7756946c9aeb service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:12.012073 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-ebb0297c-8690-46af-8aa5-f4d208a643d3 req-2c74c0c3-97ea-422f-8198-7756946c9aeb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:12.012511 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-ebb0297c-8690-46af-8aa5-f4d208a643d3 req-2c74c0c3-97ea-422f-8198-7756946c9aeb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:12.026322 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a1acef2c-f604-41b5-a55b-097e7309685d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.097376 Oct 10 19:00:12.026322 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1350/2451] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:11 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:12.026557 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-ebb0297c-8690-46af-8aa5-f4d208a643d3 req-2c74c0c3-97ea-422f-8198-7756946c9aeb service nova] Creating event network-vif-plugged:15e57f63-4842-479a-9767-e8443587cdb2 for instance 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 on n-h2-860863-1 Oct 10 19:00:12.038043 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-ebb0297c-8690-46af-8aa5-f4d208a643d3 req-2c74c0c3-97ea-422f-8198-7756946c9aeb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042141 Oct 10 19:00:12.038648 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1102/2452] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:12.311090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0a79ff25-4fe5-4b05-bd6f-f75599c19875 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:12.311872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0a79ff25-4fe5-4b05-bd6f-f75599c19875 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:12.314945 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d919fdd4-0947-49e8-a808-67019f1344b1 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:12.315874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d919fdd4-0947-49e8-a808-67019f1344b1 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:12.321528 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0a79ff25-4fe5-4b05-bd6f-f75599c19875 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:12.323817 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0a79ff25-4fe5-4b05-bd6f-f75599c19875 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:12.323817 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0a79ff25-4fe5-4b05-bd6f-f75599c19875 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:12.323817 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0a79ff25-4fe5-4b05-bd6f-f75599c19875 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:12.324116 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d919fdd4-0947-49e8-a808-67019f1344b1 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:12.324213 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0a79ff25-4fe5-4b05-bd6f-f75599c19875 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:12.324313 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d919fdd4-0947-49e8-a808-67019f1344b1 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:12.324848 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d919fdd4-0947-49e8-a808-67019f1344b1 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:12.325723 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d919fdd4-0947-49e8-a808-67019f1344b1 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:12.326383 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d919fdd4-0947-49e8-a808-67019f1344b1 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:12.327163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d919fdd4-0947-49e8-a808-67019f1344b1 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:12.330034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0a79ff25-4fe5-4b05-bd6f-f75599c19875 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:12.590872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d919fdd4-0947-49e8-a808-67019f1344b1 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:12.604708 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d919fdd4-0947-49e8-a808-67019f1344b1 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.290631 Oct 10 19:00:12.609061 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1103/2453] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:12 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:12.649196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0a79ff25-4fe5-4b05-bd6f-f75599c19875 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:12.661260 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0a79ff25-4fe5-4b05-bd6f-f75599c19875 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1320 microversion: 2.1 time: 0.354207 Oct 10 19:00:12.678489 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1351/2454] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:12 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1320 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:12.813632 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-490b0a00-d033-4820-9123-4cac691d1d9b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:12.815152 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-490b0a00-d033-4820-9123-4cac691d1d9b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:12.832174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-490b0a00-d033-4820-9123-4cac691d1d9b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:12.836685 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-490b0a00-d033-4820-9123-4cac691d1d9b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:12.836685 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-490b0a00-d033-4820-9123-4cac691d1d9b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:12.836685 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-490b0a00-d033-4820-9123-4cac691d1d9b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:12.836685 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-490b0a00-d033-4820-9123-4cac691d1d9b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:12.836685 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-490b0a00-d033-4820-9123-4cac691d1d9b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:13.016428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7a0fc8db-2ca8-4a59-8ff5-73ddd51e4688 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:13.017316 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7a0fc8db-2ca8-4a59-8ff5-73ddd51e4688 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:13.025897 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a0fc8db-2ca8-4a59-8ff5-73ddd51e4688 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:13.027272 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a0fc8db-2ca8-4a59-8ff5-73ddd51e4688 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:13.027955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a0fc8db-2ca8-4a59-8ff5-73ddd51e4688 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:13.028779 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a0fc8db-2ca8-4a59-8ff5-73ddd51e4688 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:13.030918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-490b0a00-d033-4820-9123-4cac691d1d9b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:13.031409 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a0fc8db-2ca8-4a59-8ff5-73ddd51e4688 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:13.031409 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7a0fc8db-2ca8-4a59-8ff5-73ddd51e4688 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:13.036852 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-490b0a00-d033-4820-9123-4cac691d1d9b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.227831 Oct 10 19:00:13.038320 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1104/2455] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:12 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:13.043091 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dfae9034-8160-4d6b-bb90-a34fdb6c867e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d59a700>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:13.093656 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dfae9034-8160-4d6b-bb90-a34fdb6c867e tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.053922 Oct 10 19:00:13.095324 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1105/2456] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:13 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:13.407760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7a0fc8db-2ca8-4a59-8ff5-73ddd51e4688 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:13.418040 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7a0fc8db-2ca8-4a59-8ff5-73ddd51e4688 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1308 microversion: 2.1 time: 0.406432 Oct 10 19:00:13.432910 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1352/2457] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:13 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:13.638337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f8be442c-53cd-4d0c-9cf0-0fcf19c0dfa2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:13.640838 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f8be442c-53cd-4d0c-9cf0-0fcf19c0dfa2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:13.652715 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8be442c-53cd-4d0c-9cf0-0fcf19c0dfa2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:13.654364 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8be442c-53cd-4d0c-9cf0-0fcf19c0dfa2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:13.659135 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8be442c-53cd-4d0c-9cf0-0fcf19c0dfa2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:13.662306 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8be442c-53cd-4d0c-9cf0-0fcf19c0dfa2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:13.662306 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8be442c-53cd-4d0c-9cf0-0fcf19c0dfa2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:13.662306 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8be442c-53cd-4d0c-9cf0-0fcf19c0dfa2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:13.691129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-baa03cd8-4b85-4fca-a2ed-855a6b24c55f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:13.691129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-baa03cd8-4b85-4fca-a2ed-855a6b24c55f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:13.704448 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-baa03cd8-4b85-4fca-a2ed-855a6b24c55f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:13.705844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-baa03cd8-4b85-4fca-a2ed-855a6b24c55f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:13.707341 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-baa03cd8-4b85-4fca-a2ed-855a6b24c55f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:13.712872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-baa03cd8-4b85-4fca-a2ed-855a6b24c55f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:13.713770 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-baa03cd8-4b85-4fca-a2ed-855a6b24c55f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:13.715839 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-baa03cd8-4b85-4fca-a2ed-855a6b24c55f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:13.988259 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-baa03cd8-4b85-4fca-a2ed-855a6b24c55f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:14.000196 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-baa03cd8-4b85-4fca-a2ed-855a6b24c55f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1511 microversion: 2.1 time: 0.318787 Oct 10 19:00:14.002663 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1353/2458] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:13 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:14.034056 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3d952776-c9a3-4758-b641-6401ff1fcd62 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:14.035113 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3d952776-c9a3-4758-b641-6401ff1fcd62 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:14.049329 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d952776-c9a3-4758-b641-6401ff1fcd62 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:14.050036 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d952776-c9a3-4758-b641-6401ff1fcd62 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:14.050642 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d952776-c9a3-4758-b641-6401ff1fcd62 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:14.051742 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d952776-c9a3-4758-b641-6401ff1fcd62 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:14.052392 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d952776-c9a3-4758-b641-6401ff1fcd62 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:14.053154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3d952776-c9a3-4758-b641-6401ff1fcd62 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:14.107874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f8be442c-53cd-4d0c-9cf0-0fcf19c0dfa2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:14.121997 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f8be442c-53cd-4d0c-9cf0-0fcf19c0dfa2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.496138 Oct 10 19:00:14.135969 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1106/2459] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:13 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:14.147896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-b43ad37a-5a37-41da-a5c5-bfa2b6c361ca req-c0d058d5-470b-4ffd-863e-704c90b8c4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e295c8-6ffa-4153-a9ae-1a2ce81a1b72", "name": "network-vif-plugged", "status": "completed", "tag": "e11576b3-4ac1-481a-b46a-0785fc909905"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:14.162736 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-b43ad37a-5a37-41da-a5c5-bfa2b6c361ca req-c0d058d5-470b-4ffd-863e-704c90b8c4f0 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:14.164144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-b43ad37a-5a37-41da-a5c5-bfa2b6c361ca req-c0d058d5-470b-4ffd-863e-704c90b8c4f0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:14.164781 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-b43ad37a-5a37-41da-a5c5-bfa2b6c361ca req-c0d058d5-470b-4ffd-863e-704c90b8c4f0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:14.178684 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-b43ad37a-5a37-41da-a5c5-bfa2b6c361ca req-c0d058d5-470b-4ffd-863e-704c90b8c4f0 service nova] Creating event network-vif-plugged:e11576b3-4ac1-481a-b46a-0785fc909905 for instance 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 on n-h1-860863-1 Oct 10 19:00:14.186195 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-b43ad37a-5a37-41da-a5c5-bfa2b6c361ca req-c0d058d5-470b-4ffd-863e-704c90b8c4f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051304 Oct 10 19:00:14.187394 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1107/2460] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:14.194185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-446e19c2-3e09-4731-b687-ddfb51b6244f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:14.195070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-446e19c2-3e09-4731-b687-ddfb51b6244f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:14.201961 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-446e19c2-3e09-4731-b687-ddfb51b6244f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:14.202853 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-446e19c2-3e09-4731-b687-ddfb51b6244f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:14.203481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-446e19c2-3e09-4731-b687-ddfb51b6244f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:14.205104 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-446e19c2-3e09-4731-b687-ddfb51b6244f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:14.205721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-446e19c2-3e09-4731-b687-ddfb51b6244f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:14.206308 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-446e19c2-3e09-4731-b687-ddfb51b6244f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:14.414034 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3d952776-c9a3-4758-b641-6401ff1fcd62 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:14.426122 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3d952776-c9a3-4758-b641-6401ff1fcd62 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1512 microversion: 2.1 time: 0.401596 Oct 10 19:00:14.450380 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1354/2461] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:14 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1512 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:14.469910 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-aa3909cf-88b2-4d38-9c91-d8a021486db0 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318dd97790>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:14.583178 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-aa3909cf-88b2-4d38-9c91-d8a021486db0 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.153679 Oct 10 19:00:14.584927 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1355/2462] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:14 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:14.591494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c731f9ec-ffc4-4774-a080-5e14abb62bc6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:14.592513 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c731f9ec-ffc4-4774-a080-5e14abb62bc6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:14.601820 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c731f9ec-ffc4-4774-a080-5e14abb62bc6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:14.602496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c731f9ec-ffc4-4774-a080-5e14abb62bc6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:14.603776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c731f9ec-ffc4-4774-a080-5e14abb62bc6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:14.604773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c731f9ec-ffc4-4774-a080-5e14abb62bc6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:14.605450 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c731f9ec-ffc4-4774-a080-5e14abb62bc6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:14.606215 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c731f9ec-ffc4-4774-a080-5e14abb62bc6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:14.707647 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-446e19c2-3e09-4731-b687-ddfb51b6244f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:14.726338 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-446e19c2-3e09-4731-b687-ddfb51b6244f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.536250 Oct 10 19:00:14.731104 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1108/2463] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:14 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:14.741633 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3c98342e-dd70-47b6-882f-fd9624b75315 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:14.744699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3c98342e-dd70-47b6-882f-fd9624b75315 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: c22fa54d-372c-4887-8875-a3c56b3850b1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:14.758618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3c98342e-dd70-47b6-882f-fd9624b75315 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:14.761755 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3c98342e-dd70-47b6-882f-fd9624b75315 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:14.764906 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3c98342e-dd70-47b6-882f-fd9624b75315 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:14.773965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3c98342e-dd70-47b6-882f-fd9624b75315 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:14.775749 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3c98342e-dd70-47b6-882f-fd9624b75315 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:14.782255 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3c98342e-dd70-47b6-882f-fd9624b75315 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:14.893365 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c731f9ec-ffc4-4774-a080-5e14abb62bc6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:14.913108 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c731f9ec-ffc4-4774-a080-5e14abb62bc6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1308 microversion: 2.1 time: 0.326300 Oct 10 19:00:14.936676 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1356/2464] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:14 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1308 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:15.148852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a7c34691-eebb-4d74-91dd-e90253ac3aed tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:15.150033 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a7c34691-eebb-4d74-91dd-e90253ac3aed tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:15.158508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7c34691-eebb-4d74-91dd-e90253ac3aed tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:15.162615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7c34691-eebb-4d74-91dd-e90253ac3aed tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:15.163513 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7c34691-eebb-4d74-91dd-e90253ac3aed tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:15.167715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7c34691-eebb-4d74-91dd-e90253ac3aed tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:15.168502 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7c34691-eebb-4d74-91dd-e90253ac3aed tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:15.169204 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7c34691-eebb-4d74-91dd-e90253ac3aed tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:15.405270 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a7c34691-eebb-4d74-91dd-e90253ac3aed tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:15.417962 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a7c34691-eebb-4d74-91dd-e90253ac3aed tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.274327 Oct 10 19:00:15.418836 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1357/2465] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:15 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:15.605457 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2d04f731-5f4c-4a43-aab5-cf627f2d48e1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318dd97e50>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:15.678815 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2d04f731-5f4c-4a43-aab5-cf627f2d48e1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.083398 Oct 10 19:00:15.679975 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1358/2466] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:15 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:15.772432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5af61b9e-01f5-4adb-80fb-08b6b2d8d140 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:15.773088 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5af61b9e-01f5-4adb-80fb-08b6b2d8d140 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:15.788303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5af61b9e-01f5-4adb-80fb-08b6b2d8d140 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:15.788820 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5af61b9e-01f5-4adb-80fb-08b6b2d8d140 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:15.789862 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5af61b9e-01f5-4adb-80fb-08b6b2d8d140 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:15.790093 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5af61b9e-01f5-4adb-80fb-08b6b2d8d140 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:15.790418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5af61b9e-01f5-4adb-80fb-08b6b2d8d140 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:15.790846 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5af61b9e-01f5-4adb-80fb-08b6b2d8d140 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:15.824332 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3c98342e-dd70-47b6-882f-fd9624b75315 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:15.837486 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3c98342e-dd70-47b6-882f-fd9624b75315 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1" status: 200 len: 1511 microversion: 2.1 time: 1.103038 Oct 10 19:00:15.844677 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1109/2467] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:14 2022] GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1 => generated 1511 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:15.870319 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:15.891455 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:15.893408 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:00:15.915464 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:15.916292 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:15.917731 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:15.918706 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:15.919362 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:15.920084 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:16.032962 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.multi_cell_list [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127289) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:00:16.048864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5af61b9e-01f5-4adb-80fb-08b6b2d8d140 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:16.058741 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5af61b9e-01f5-4adb-80fb-08b6b2d8d140 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.290641 Oct 10 19:00:16.059332 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1359/2468] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:15 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:16.075928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ba583306-0343-478b-9d38-5f4ce8a05e4d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:16.076979 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ba583306-0343-478b-9d38-5f4ce8a05e4d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:16.086415 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba583306-0343-478b-9d38-5f4ce8a05e4d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:16.086912 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba583306-0343-478b-9d38-5f4ce8a05e4d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:16.087346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba583306-0343-478b-9d38-5f4ce8a05e4d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:16.088043 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba583306-0343-478b-9d38-5f4ce8a05e4d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:16.088488 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba583306-0343-478b-9d38-5f4ce8a05e4d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:16.088960 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba583306-0343-478b-9d38-5f4ce8a05e4d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:16.111049 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:16.117974 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:16.118491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:16.118929 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:16.233508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ba583306-0343-478b-9d38-5f4ce8a05e4d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:16.241643 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ba583306-0343-478b-9d38-5f4ce8a05e4d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1308 microversion: 2.1 time: 0.174915 Oct 10 19:00:16.242228 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1360/2469] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:16 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:16.446125 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1bdbdfad-87d1-4630-8ce8-9fa4a96943ab tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:16.446125 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1bdbdfad-87d1-4630-8ce8-9fa4a96943ab tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:16.454991 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-09742ef9-086a-4a10-98e1-a977e4ad548b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.595598 Oct 10 19:00:16.455921 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1110/2470] 10.222.0.43 () {58 vars in 1167 bytes} [Mon Oct 10 19:00:15 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:16.458926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1bdbdfad-87d1-4630-8ce8-9fa4a96943ab tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:16.459428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1bdbdfad-87d1-4630-8ce8-9fa4a96943ab tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:16.459869 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1bdbdfad-87d1-4630-8ce8-9fa4a96943ab tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:16.485663 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1bdbdfad-87d1-4630-8ce8-9fa4a96943ab tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:16.486061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1bdbdfad-87d1-4630-8ce8-9fa4a96943ab tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:16.486513 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1bdbdfad-87d1-4630-8ce8-9fa4a96943ab tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:16.487261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:16.501479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:16.502797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1561889264', 'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:00:16.515948 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:16.516654 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:16.517593 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:16.518552 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:16.523231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:16.523873 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:16.725973 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1bdbdfad-87d1-4630-8ce8-9fa4a96943ab tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:16.736974 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.multi_cell_list [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127289) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:00:16.740328 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1bdbdfad-87d1-4630-8ce8-9fa4a96943ab tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.298755 Oct 10 19:00:16.740328 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1361/2471] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:16 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:16.743691 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-eb916b0d-e1ff-4da7-81c2-43deec9130a5 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d582310>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:16.805892 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-eb916b0d-e1ff-4da7-81c2-43deec9130a5 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.066936 Oct 10 19:00:16.814406 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1362/2472] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:16 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:16.910255 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:16.918136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:16.918806 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:16.919403 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:17.086767 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a6c95579-d8fa-4607-b7a9-02c36ddb155f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:17.087396 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a6c95579-d8fa-4607-b7a9-02c36ddb155f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:17.101518 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6c95579-d8fa-4607-b7a9-02c36ddb155f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:17.102475 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6c95579-d8fa-4607-b7a9-02c36ddb155f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:17.102947 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6c95579-d8fa-4607-b7a9-02c36ddb155f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:17.103657 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6c95579-d8fa-4607-b7a9-02c36ddb155f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:17.104106 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6c95579-d8fa-4607-b7a9-02c36ddb155f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:17.104525 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6c95579-d8fa-4607-b7a9-02c36ddb155f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:17.159601 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-20ca59cd-972d-4c52-b8a4-3e452fc1ae21 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1561889264" status: 200 len: 1515 microversion: 2.1 time: 0.677091 Oct 10 19:00:17.160773 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1111/2473] 10.222.0.43 () {58 vars in 1263 bytes} [Mon Oct 10 19:00:16 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1561889264 => generated 1515 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:17.185821 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:17.194068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:17.198584 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:00:17.205704 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:17.206477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:17.207088 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:17.209538 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:17.210179 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:17.210990 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:17.426594 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a6c95579-d8fa-4607-b7a9-02c36ddb155f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:17.438627 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a6c95579-d8fa-4607-b7a9-02c36ddb155f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.356327 Oct 10 19:00:17.456325 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1363/2474] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:17 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:17.464713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ac7d68c4-0951-46c1-92e2-e6fc4563ecae tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:17.466410 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ac7d68c4-0951-46c1-92e2-e6fc4563ecae tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:17.474041 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac7d68c4-0951-46c1-92e2-e6fc4563ecae tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:17.474880 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac7d68c4-0951-46c1-92e2-e6fc4563ecae tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:17.475537 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac7d68c4-0951-46c1-92e2-e6fc4563ecae tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:17.477560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac7d68c4-0951-46c1-92e2-e6fc4563ecae tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:17.478200 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac7d68c4-0951-46c1-92e2-e6fc4563ecae tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:17.478941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac7d68c4-0951-46c1-92e2-e6fc4563ecae tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:17.603945 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.multi_cell_list [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127289) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:00:17.679683 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:17.687291 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:17.687772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:17.688207 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:17.921552 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ac7d68c4-0951-46c1-92e2-e6fc4563ecae tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:17.932635 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ac7d68c4-0951-46c1-92e2-e6fc4563ecae tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1488 microversion: 2.1 time: 0.474798 Oct 10 19:00:17.935870 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1364/2475] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:17 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1488 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:17.946244 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-03b3f654-f290-4bce-8e77-b09a22d7631f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.764261 Oct 10 19:00:17.955040 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1112/2476] 10.222.0.43 () {58 vars in 1173 bytes} [Mon Oct 10 19:00:17 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:17.955224 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-12367f62-dc15-4345-9e5c-01f6314e4917 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:17.955224 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-12367f62-dc15-4345-9e5c-01f6314e4917 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:17.958319 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0b4814bf-0849-4dcf-8dfb-e3da7158df82 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921969d0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:17.969383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12367f62-dc15-4345-9e5c-01f6314e4917 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:17.970049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12367f62-dc15-4345-9e5c-01f6314e4917 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:17.970575 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12367f62-dc15-4345-9e5c-01f6314e4917 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:17.971414 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12367f62-dc15-4345-9e5c-01f6314e4917 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:17.971987 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12367f62-dc15-4345-9e5c-01f6314e4917 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:17.973969 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12367f62-dc15-4345-9e5c-01f6314e4917 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:18.045095 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0b4814bf-0849-4dcf-8dfb-e3da7158df82 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.096479 Oct 10 19:00:18.054021 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1113/2477] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:17 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:18.061754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-134b25cd-2318-4d04-babc-cb427dd3f981 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:18.062303 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-134b25cd-2318-4d04-babc-cb427dd3f981 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:18.101304 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-134b25cd-2318-4d04-babc-cb427dd3f981 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:18.104052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-134b25cd-2318-4d04-babc-cb427dd3f981 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:18.104750 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-134b25cd-2318-4d04-babc-cb427dd3f981 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:18.108913 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-134b25cd-2318-4d04-babc-cb427dd3f981 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:18.109623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-134b25cd-2318-4d04-babc-cb427dd3f981 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:18.110907 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-134b25cd-2318-4d04-babc-cb427dd3f981 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:18.357354 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-12367f62-dc15-4345-9e5c-01f6314e4917 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:18.368637 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-12367f62-dc15-4345-9e5c-01f6314e4917 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.429996 Oct 10 19:00:18.369551 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1365/2478] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:17 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:18.378297 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:18.402769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:18.405504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.compute.servers [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Removing options 'limit' from query {{(pid=127288) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 10 19:00:18.408243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:00:18.415865 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:18.416716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:18.417400 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:18.418379 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:18.418834 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:18.419259 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:18.459031 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-134b25cd-2318-4d04-babc-cb427dd3f981 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "POST /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72/action" status: 202 len: 0 microversion: 2.1 time: 0.410324 Oct 10 19:00:18.460402 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1114/2479] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:00:18 2022] POST /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 19:00:18.464063 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:18.472999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:18.474702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:18.477307 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:18.720565 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0fd961bd-85ff-4279-85e9-5e0fa2658049 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:18.721303 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0fd961bd-85ff-4279-85e9-5e0fa2658049 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:18.732779 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fd961bd-85ff-4279-85e9-5e0fa2658049 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:18.733626 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fd961bd-85ff-4279-85e9-5e0fa2658049 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:18.734337 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fd961bd-85ff-4279-85e9-5e0fa2658049 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:18.737282 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fd961bd-85ff-4279-85e9-5e0fa2658049 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:18.737778 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fd961bd-85ff-4279-85e9-5e0fa2658049 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:18.738211 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fd961bd-85ff-4279-85e9-5e0fa2658049 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:18.967086 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7e1a58f5-910d-440c-acfe-b405d6566582 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.596101 Oct 10 19:00:18.968109 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1366/2480] 10.222.0.43 () {58 vars in 1161 bytes} [Mon Oct 10 19:00:18 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:18.974429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2fd49fa2-0759-4bf4-b232-faedb3b10f4c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:18.974905 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2fd49fa2-0759-4bf4-b232-faedb3b10f4c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:18.983975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd49fa2-0759-4bf4-b232-faedb3b10f4c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:18.984522 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd49fa2-0759-4bf4-b232-faedb3b10f4c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:18.986505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd49fa2-0759-4bf4-b232-faedb3b10f4c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:18.987352 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd49fa2-0759-4bf4-b232-faedb3b10f4c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:18.991894 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd49fa2-0759-4bf4-b232-faedb3b10f4c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:18.995402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2fd49fa2-0759-4bf4-b232-faedb3b10f4c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:19.049610 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:19.261747 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0fd961bd-85ff-4279-85e9-5e0fa2658049 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:19.281544 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0fd961bd-85ff-4279-85e9-5e0fa2658049 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:19.285750 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0fd961bd-85ff-4279-85e9-5e0fa2658049 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:19.290078 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0fd961bd-85ff-4279-85e9-5e0fa2658049 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 2952 microversion: 2.42 time: 0.827545 Oct 10 19:00:19.290679 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1115/2481] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:00:18 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 2952 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:00:19.300096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-241b72c3-f3cf-4d21-b7ac-20943036658c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:19.305514 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-241b72c3-f3cf-4d21-b7ac-20943036658c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:19.319910 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-241b72c3-f3cf-4d21-b7ac-20943036658c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:19.320401 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-241b72c3-f3cf-4d21-b7ac-20943036658c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:19.325028 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-241b72c3-f3cf-4d21-b7ac-20943036658c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:19.325860 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-241b72c3-f3cf-4d21-b7ac-20943036658c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:19.326329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-241b72c3-f3cf-4d21-b7ac-20943036658c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:19.333399 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-241b72c3-f3cf-4d21-b7ac-20943036658c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:19.414796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2fd49fa2-0759-4bf4-b232-faedb3b10f4c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:19.426060 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2fd49fa2-0759-4bf4-b232-faedb3b10f4c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.456414 Oct 10 19:00:19.430125 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1367/2482] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:18 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:19.437066 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f2df07c9-1c94-476b-8d32-d82896a39877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:19.458350 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f2df07c9-1c94-476b-8d32-d82896a39877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:19.463940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f2df07c9-1c94-476b-8d32-d82896a39877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:00:19.478966 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2df07c9-1c94-476b-8d32-d82896a39877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:19.490934 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2df07c9-1c94-476b-8d32-d82896a39877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:19.490934 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2df07c9-1c94-476b-8d32-d82896a39877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:19.490934 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2df07c9-1c94-476b-8d32-d82896a39877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:19.490934 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2df07c9-1c94-476b-8d32-d82896a39877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:19.490934 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2df07c9-1c94-476b-8d32-d82896a39877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:19.647721 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-f2df07c9-1c94-476b-8d32-d82896a39877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:00:19.753109 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f2df07c9-1c94-476b-8d32-d82896a39877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.320225 Oct 10 19:00:19.762301 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1368/2483] 10.222.0.43 () {58 vars in 1152 bytes} [Mon Oct 10 19:00:19 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:19.767197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-66dd1b92-386f-42af-9b3b-4b1ce10c03d7 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318dda4dc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:19.869960 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-66dd1b92-386f-42af-9b3b-4b1ce10c03d7 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.106371 Oct 10 19:00:19.870716 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1369/2484] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:19 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:19.888148 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-45f03a3b-4fec-4610-a80e-4407adc45d41 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:19.888671 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-45f03a3b-4fec-4610-a80e-4407adc45d41 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:19.895472 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-45f03a3b-4fec-4610-a80e-4407adc45d41 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:19.896184 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-45f03a3b-4fec-4610-a80e-4407adc45d41 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:19.896489 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-45f03a3b-4fec-4610-a80e-4407adc45d41 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:19.897503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-45f03a3b-4fec-4610-a80e-4407adc45d41 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:19.897975 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-45f03a3b-4fec-4610-a80e-4407adc45d41 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:19.898419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-45f03a3b-4fec-4610-a80e-4407adc45d41 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:19.938419 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-241b72c3-f3cf-4d21-b7ac-20943036658c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:19.941077 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:19.960036 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-241b72c3-f3cf-4d21-b7ac-20943036658c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 200 len: 1473 microversion: 2.1 time: 0.663646 Oct 10 19:00:19.972678 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1116/2485] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:19 2022] GET /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 1473 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:19.984894 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fe43e644-6a65-4f89-8450-365008ccf4d4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:19.989074 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fe43e644-6a65-4f89-8450-365008ccf4d4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:20.006720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe43e644-6a65-4f89-8450-365008ccf4d4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:20.007464 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe43e644-6a65-4f89-8450-365008ccf4d4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:20.008083 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe43e644-6a65-4f89-8450-365008ccf4d4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:20.009018 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe43e644-6a65-4f89-8450-365008ccf4d4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:20.009646 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe43e644-6a65-4f89-8450-365008ccf4d4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:20.010068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe43e644-6a65-4f89-8450-365008ccf4d4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:20.134231 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-45f03a3b-4fec-4610-a80e-4407adc45d41 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.249268 Oct 10 19:00:20.149724 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1370/2486] 10.222.0.43 () {60 vars in 1316 bytes} [Mon Oct 10 19:00:19 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582/os-interface => generated 1830 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:00:20.155620 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c0d82046-a156-4684-b22e-107740e4d775 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:20.163104 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c0d82046-a156-4684-b22e-107740e4d775 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:20.163713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.compute.servers [None req-c0d82046-a156-4684-b22e-107740e4d775 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Removing options 'limit' from query {{(pid=127288) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 10 19:00:20.164916 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c0d82046-a156-4684-b22e-107740e4d775 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:00:20.170641 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c0d82046-a156-4684-b22e-107740e4d775 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:20.171258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c0d82046-a156-4684-b22e-107740e4d775 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:20.171957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c0d82046-a156-4684-b22e-107740e4d775 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:20.172838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c0d82046-a156-4684-b22e-107740e4d775 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:20.173399 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c0d82046-a156-4684-b22e-107740e4d775 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:20.173922 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c0d82046-a156-4684-b22e-107740e4d775 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:20.208741 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-c0d82046-a156-4684-b22e-107740e4d775 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:00:20.278920 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c0d82046-a156-4684-b22e-107740e4d775 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.127216 Oct 10 19:00:20.280287 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1371/2487] 10.222.0.43 () {58 vars in 1150 bytes} [Mon Oct 10 19:00:20 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:20.295361 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3f65c978-dddb-4318-ae79-1d4dbc093bfc tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-753158051"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:20.299892 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3f65c978-dddb-4318-ae79-1d4dbc093bfc tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:20.315862 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f65c978-dddb-4318-ae79-1d4dbc093bfc tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:20.316623 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f65c978-dddb-4318-ae79-1d4dbc093bfc tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:20.317257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f65c978-dddb-4318-ae79-1d4dbc093bfc tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:20.318753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f65c978-dddb-4318-ae79-1d4dbc093bfc tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:20.319368 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f65c978-dddb-4318-ae79-1d4dbc093bfc tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:20.320077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f65c978-dddb-4318-ae79-1d4dbc093bfc tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:20.708186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fe43e644-6a65-4f89-8450-365008ccf4d4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:20.720832 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fe43e644-6a65-4f89-8450-365008ccf4d4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.744318 Oct 10 19:00:20.721834 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1117/2488] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:19 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:20.734584 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3289ee9e-e839-4acc-94d4-5d73a8330099 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:20.749269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3289ee9e-e839-4acc-94d4-5d73a8330099 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:20.753448 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3289ee9e-e839-4acc-94d4-5d73a8330099 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:00:20.775797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3289ee9e-e839-4acc-94d4-5d73a8330099 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:20.777537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3289ee9e-e839-4acc-94d4-5d73a8330099 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:20.778297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3289ee9e-e839-4acc-94d4-5d73a8330099 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:20.780094 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3289ee9e-e839-4acc-94d4-5d73a8330099 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:20.781726 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3289ee9e-e839-4acc-94d4-5d73a8330099 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:20.782822 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3289ee9e-e839-4acc-94d4-5d73a8330099 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:20.852025 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.multi_cell_list [None req-3289ee9e-e839-4acc-94d4-5d73a8330099 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127289) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:00:20.921850 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3289ee9e-e839-4acc-94d4-5d73a8330099 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.198576 Oct 10 19:00:20.931680 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1118/2489] 10.222.0.43 () {58 vars in 1125 bytes} [Mon Oct 10 19:00:20 2022] GET /compute/v2.1/servers => generated 1011 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:20.941321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-2362d268-b9d1-4715-a790-561841c28305 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:20.944797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-2362d268-b9d1-4715-a790-561841c28305 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:20.953356 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3f65c978-dddb-4318-ae79-1d4dbc093bfc tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "POST /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72/action" status: 202 len: 0 microversion: 2.1 time: 0.671390 Oct 10 19:00:20.955041 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1372/2490] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:00:20 2022] POST /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 19:00:20.966975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2362d268-b9d1-4715-a790-561841c28305 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:20.967796 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2362d268-b9d1-4715-a790-561841c28305 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:20.968419 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2362d268-b9d1-4715-a790-561841c28305 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:20.970213 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2362d268-b9d1-4715-a790-561841c28305 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:20.970967 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0b611a62-49cb-476f-8df6-27e42a79e46d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318e7a7040>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:20.972765 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2362d268-b9d1-4715-a790-561841c28305 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:20.974743 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-2362d268-b9d1-4715-a790-561841c28305 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:21.059460 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0b611a62-49cb-476f-8df6-27e42a79e46d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.102409 Oct 10 19:00:21.062025 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1373/2491] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:20 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:21.072124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-25bb8cdb-fc28-4c60-a68a-a58f579a4abe tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:21.086478 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-25bb8cdb-fc28-4c60-a68a-a58f579a4abe tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:21.093495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-25bb8cdb-fc28-4c60-a68a-a58f579a4abe tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:00:21.122795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-25bb8cdb-fc28-4c60-a68a-a58f579a4abe tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:21.130853 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-25bb8cdb-fc28-4c60-a68a-a58f579a4abe tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:21.131536 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-25bb8cdb-fc28-4c60-a68a-a58f579a4abe tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:21.132716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-25bb8cdb-fc28-4c60-a68a-a58f579a4abe tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:21.133297 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-25bb8cdb-fc28-4c60-a68a-a58f579a4abe tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:21.134017 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-25bb8cdb-fc28-4c60-a68a-a58f579a4abe tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:21.359794 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-25bb8cdb-fc28-4c60-a68a-a58f579a4abe tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:00:21.451738 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-25bb8cdb-fc28-4c60-a68a-a58f579a4abe tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.387709 Oct 10 19:00:21.452800 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1374/2492] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 19:00:21 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:21.461115 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-97601748-9e9c-496b-8cb2-40b3539056b3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318e2b6dc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:21.526738 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-97601748-9e9c-496b-8cb2-40b3539056b3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715" status: 200 len: 1413 microversion: 2.1 time: 0.072569 Oct 10 19:00:21.528172 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1375/2493] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:21 2022] GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715 => generated 1413 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:21.542938 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-53ad87c4-806b-4a98-ae08-54095a301bcf tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:21.562603 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-53ad87c4-806b-4a98-ae08-54095a301bcf tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:21.563358 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.compute.servers [None req-53ad87c4-806b-4a98-ae08-54095a301bcf tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Removing options 'limit' from query {{(pid=127288) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 10 19:00:21.564224 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-53ad87c4-806b-4a98-ae08-54095a301bcf tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:00:21.574268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53ad87c4-806b-4a98-ae08-54095a301bcf tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:21.574908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53ad87c4-806b-4a98-ae08-54095a301bcf tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:21.575480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53ad87c4-806b-4a98-ae08-54095a301bcf tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:21.576347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53ad87c4-806b-4a98-ae08-54095a301bcf tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:21.576937 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53ad87c4-806b-4a98-ae08-54095a301bcf tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:21.577882 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53ad87c4-806b-4a98-ae08-54095a301bcf tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:21.626592 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-53ad87c4-806b-4a98-ae08-54095a301bcf tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.096802 Oct 10 19:00:21.628048 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1376/2494] 10.222.0.43 () {58 vars in 1140 bytes} [Mon Oct 10 19:00:21 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:21.641346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-9811fe9e-65cc-418a-947b-13f50a7459e2 req-a3641c59-43e3-4ba8-88ce-421247d16665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b24fdb-281e-478a-8aca-665e35082ba4", "name": "network-vif-plugged", "status": "completed", "tag": "95c07e43-0ca4-462d-926e-60121c79a4aa"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:21.655076 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-9811fe9e-65cc-418a-947b-13f50a7459e2 req-a3641c59-43e3-4ba8-88ce-421247d16665 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:21.655795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-9811fe9e-65cc-418a-947b-13f50a7459e2 req-a3641c59-43e3-4ba8-88ce-421247d16665 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:21.656351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-9811fe9e-65cc-418a-947b-13f50a7459e2 req-a3641c59-43e3-4ba8-88ce-421247d16665 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:21.670749 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-9811fe9e-65cc-418a-947b-13f50a7459e2 req-a3641c59-43e3-4ba8-88ce-421247d16665 service nova] Creating event network-vif-plugged:95c07e43-0ca4-462d-926e-60121c79a4aa for instance c3b24fdb-281e-478a-8aca-665e35082ba4 on n-h1-860863-1 Oct 10 19:00:21.679043 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-9811fe9e-65cc-418a-947b-13f50a7459e2 req-a3641c59-43e3-4ba8-88ce-421247d16665 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047182 Oct 10 19:00:21.679043 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1377/2495] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:21.684383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-68b94a43-ded0-45c5-af4c-580e822812cc tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:21.692947 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-68b94a43-ded0-45c5-af4c-580e822812cc tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:21.692947 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-68b94a43-ded0-45c5-af4c-580e822812cc tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1561889264', 'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:00:21.699129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-68b94a43-ded0-45c5-af4c-580e822812cc tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:21.699768 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-68b94a43-ded0-45c5-af4c-580e822812cc tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:21.700363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-68b94a43-ded0-45c5-af4c-580e822812cc tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:21.701496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-68b94a43-ded0-45c5-af4c-580e822812cc tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:21.702204 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-68b94a43-ded0-45c5-af4c-580e822812cc tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:21.702862 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-68b94a43-ded0-45c5-af4c-580e822812cc tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:21.872862 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-68b94a43-ded0-45c5-af4c-580e822812cc tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:00:21.996351 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-68b94a43-ded0-45c5-af4c-580e822812cc tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1561889264" status: 200 len: 346 microversion: 2.1 time: 0.316959 Oct 10 19:00:21.997469 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1378/2496] 10.222.0.43 () {58 vars in 1242 bytes} [Mon Oct 10 19:00:21 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1561889264 => generated 346 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:22.004351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0f671d91-26db-49d9-ae0f-bc20871d6411 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:22.004351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0f671d91-26db-49d9-ae0f-bc20871d6411 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:22.016383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f671d91-26db-49d9-ae0f-bc20871d6411 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:22.021459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f671d91-26db-49d9-ae0f-bc20871d6411 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:22.022443 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f671d91-26db-49d9-ae0f-bc20871d6411 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:22.026587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f671d91-26db-49d9-ae0f-bc20871d6411 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:22.027452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f671d91-26db-49d9-ae0f-bc20871d6411 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:22.028838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f671d91-26db-49d9-ae0f-bc20871d6411 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:22.155423 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-2362d268-b9d1-4715-a790-561841c28305 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:22.167126 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-2362d268-b9d1-4715-a790-561841c28305 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 1.234079 Oct 10 19:00:22.182008 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1119/2497] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:20 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:22.194196 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6da59d61-16f9-4730-af6f-ba32b6ad7849 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:22.213797 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6da59d61-16f9-4730-af6f-ba32b6ad7849 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:22.214320 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6da59d61-16f9-4730-af6f-ba32b6ad7849 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:22.214776 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6da59d61-16f9-4730-af6f-ba32b6ad7849 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:22.387809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0f671d91-26db-49d9-ae0f-bc20871d6411 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:22.398335 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0f671d91-26db-49d9-ae0f-bc20871d6411 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.399924 Oct 10 19:00:22.401905 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1379/2498] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:21 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:22.409352 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-10c654b6-1249-47c4-a9e8-22f171c43f4c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f3192357160>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:22.466884 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6da59d61-16f9-4730-af6f-ba32b6ad7849 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Going to try to stop instance {{(pid=127289) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 19:00:22.506989 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-10c654b6-1249-47c4-a9e8-22f171c43f4c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.103713 Oct 10 19:00:22.524071 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1380/2499] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:22 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:22.543978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-91d6819c-c5f0-48ab-a4f6-934eee60aaa3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f3192378a60>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:22.600945 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-91d6819c-c5f0-48ab-a4f6-934eee60aaa3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715" status: 200 len: 1413 microversion: 2.1 time: 0.061095 Oct 10 19:00:22.601918 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1381/2500] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:22 2022] GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715 => generated 1413 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:23.038633 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6da59d61-16f9-4730-af6f-ba32b6ad7849 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "POST /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58/action" status: 202 len: 0 microversion: 2.1 time: 0.854896 Oct 10 19:00:23.040872 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1120/2501] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:00:22 2022] POST /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58/action => generated 0 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 19:00:23.049282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9b3b1527-6b9a-46c3-8f46-f8a88f745127 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:23.049907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9b3b1527-6b9a-46c3-8f46-f8a88f745127 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:23.064061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9b3b1527-6b9a-46c3-8f46-f8a88f745127 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:23.064580 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9b3b1527-6b9a-46c3-8f46-f8a88f745127 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:23.065030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9b3b1527-6b9a-46c3-8f46-f8a88f745127 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:23.066402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9b3b1527-6b9a-46c3-8f46-f8a88f745127 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:23.067048 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9b3b1527-6b9a-46c3-8f46-f8a88f745127 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:23.069582 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9b3b1527-6b9a-46c3-8f46-f8a88f745127 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:23.204216 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-eb58da2b-e440-4782-8c67-f0f8487d72d4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:23.208868 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-eb58da2b-e440-4782-8c67-f0f8487d72d4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:23.229347 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb58da2b-e440-4782-8c67-f0f8487d72d4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:23.230191 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb58da2b-e440-4782-8c67-f0f8487d72d4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:23.230824 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb58da2b-e440-4782-8c67-f0f8487d72d4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:23.232213 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb58da2b-e440-4782-8c67-f0f8487d72d4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:23.232896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb58da2b-e440-4782-8c67-f0f8487d72d4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:23.237169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb58da2b-e440-4782-8c67-f0f8487d72d4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:23.435327 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9b3b1527-6b9a-46c3-8f46-f8a88f745127 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:23.453736 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9b3b1527-6b9a-46c3-8f46-f8a88f745127 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1522 microversion: 2.1 time: 0.405666 Oct 10 19:00:23.465105 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1382/2502] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:23 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:23.470196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f0ce9c7b-1490-4773-9c21-2bd991c40ba7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:23.475028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f0ce9c7b-1490-4773-9c21-2bd991c40ba7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:23.498918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0ce9c7b-1490-4773-9c21-2bd991c40ba7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:23.499419 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0ce9c7b-1490-4773-9c21-2bd991c40ba7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:23.499880 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0ce9c7b-1490-4773-9c21-2bd991c40ba7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:23.504785 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0ce9c7b-1490-4773-9c21-2bd991c40ba7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:23.505308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0ce9c7b-1490-4773-9c21-2bd991c40ba7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:23.505850 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0ce9c7b-1490-4773-9c21-2bd991c40ba7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:23.602085 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-eb58da2b-e440-4782-8c67-f0f8487d72d4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:23.625024 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-eb58da2b-e440-4782-8c67-f0f8487d72d4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.424969 Oct 10 19:00:23.636965 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1121/2503] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:23 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:23.648364 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b1e4945f-8e75-421a-bd04-5f2fd1094143 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921961f0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:23.816338 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b1e4945f-8e75-421a-bd04-5f2fd1094143 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1455 microversion: 2.1 time: 0.177992 Oct 10 19:00:23.817038 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1122/2504] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:23 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1455 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:23.828271 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-585c1a62-ebc6-4945-bdf1-f7d87bcf1b27 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f31921c0ca0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:23.907449 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-585c1a62-ebc6-4945-bdf1-f7d87bcf1b27 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715" status: 200 len: 1413 microversion: 2.1 time: 0.089149 Oct 10 19:00:23.908523 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1123/2505] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:23 2022] GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:23.924378 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-4e406c91-ae3a-4427-8c49-007c4423f0fb req-05ab3342-aa3e-428c-af17-7b5c267aea8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b24fdb-281e-478a-8aca-665e35082ba4", "name": "network-vif-plugged", "status": "completed", "tag": "4fec9244-ae46-4042-9186-dcea2242c021"}, {"server_uuid": "c3b24fdb-281e-478a-8aca-665e35082ba4", "name": "network-vif-plugged", "status": "completed", "tag": "9fb205c6-4673-44b4-86aa-fdaf03c74fb8"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:23.942640 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4e406c91-ae3a-4427-8c49-007c4423f0fb req-05ab3342-aa3e-428c-af17-7b5c267aea8f service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:23.943400 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4e406c91-ae3a-4427-8c49-007c4423f0fb req-05ab3342-aa3e-428c-af17-7b5c267aea8f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:23.943987 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-4e406c91-ae3a-4427-8c49-007c4423f0fb req-05ab3342-aa3e-428c-af17-7b5c267aea8f service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:23.968170 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-4e406c91-ae3a-4427-8c49-007c4423f0fb req-05ab3342-aa3e-428c-af17-7b5c267aea8f service nova] Creating event network-vif-plugged:4fec9244-ae46-4042-9186-dcea2242c021 for instance c3b24fdb-281e-478a-8aca-665e35082ba4 on n-h1-860863-1 Oct 10 19:00:23.968715 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-4e406c91-ae3a-4427-8c49-007c4423f0fb req-05ab3342-aa3e-428c-af17-7b5c267aea8f service nova] Creating event network-vif-plugged:9fb205c6-4673-44b4-86aa-fdaf03c74fb8 for instance c3b24fdb-281e-478a-8aca-665e35082ba4 on n-h1-860863-1 Oct 10 19:00:23.994373 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-4e406c91-ae3a-4427-8c49-007c4423f0fb req-05ab3342-aa3e-428c-af17-7b5c267aea8f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080303 Oct 10 19:00:23.995476 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1124/2506] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:24.010740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f0ce9c7b-1490-4773-9c21-2bd991c40ba7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:24.021860 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f0ce9c7b-1490-4773-9c21-2bd991c40ba7 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.555350 Oct 10 19:00:24.027962 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1383/2507] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:23 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:24.512011 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0649b200-8c2e-4602-8a7b-a8b3caf3f646 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:24.516357 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0649b200-8c2e-4602-8a7b-a8b3caf3f646 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:24.534251 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0649b200-8c2e-4602-8a7b-a8b3caf3f646 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:24.534991 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0649b200-8c2e-4602-8a7b-a8b3caf3f646 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:24.535602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0649b200-8c2e-4602-8a7b-a8b3caf3f646 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:24.536834 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0649b200-8c2e-4602-8a7b-a8b3caf3f646 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:24.537819 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0649b200-8c2e-4602-8a7b-a8b3caf3f646 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:24.538391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0649b200-8c2e-4602-8a7b-a8b3caf3f646 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:24.650381 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a7fa946f-fe04-49ee-9a04-a5ff690cbb5a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:24.651007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a7fa946f-fe04-49ee-9a04-a5ff690cbb5a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:24.669653 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7fa946f-fe04-49ee-9a04-a5ff690cbb5a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:24.670298 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7fa946f-fe04-49ee-9a04-a5ff690cbb5a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:24.671197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7fa946f-fe04-49ee-9a04-a5ff690cbb5a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:24.672528 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7fa946f-fe04-49ee-9a04-a5ff690cbb5a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:24.673195 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7fa946f-fe04-49ee-9a04-a5ff690cbb5a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:24.675883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a7fa946f-fe04-49ee-9a04-a5ff690cbb5a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:24.820816 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0649b200-8c2e-4602-8a7b-a8b3caf3f646 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:24.831137 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0649b200-8c2e-4602-8a7b-a8b3caf3f646 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1522 microversion: 2.1 time: 0.342936 Oct 10 19:00:24.860821 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1125/2508] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:24 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:24.874314 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6c789c3f-d005-4358-9fe6-5d5b7b90fce1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921961f0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:24.959557 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6c789c3f-d005-4358-9fe6-5d5b7b90fce1 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1464 microversion: 2.1 time: 0.097155 Oct 10 19:00:24.961130 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1126/2509] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:24 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1464 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:24.967526 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0353e9b3-4367-4434-8429-8cebb5a0136b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f3192181160>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:25.042746 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0353e9b3-4367-4434-8429-8cebb5a0136b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715" status: 200 len: 1413 microversion: 2.1 time: 0.080281 Oct 10 19:00:25.054217 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1127/2510] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:24 2022] GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715 => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:25.057242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-520d12ef-f1c9-47f0-9cda-1d5623ff6563 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921969d0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:25.103888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a7fa946f-fe04-49ee-9a04-a5ff690cbb5a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:25.118923 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a7fa946f-fe04-49ee-9a04-a5ff690cbb5a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.469902 Oct 10 19:00:25.136562 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1384/2511] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:24 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:25.144680 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-11cf3971-b670-47e0-871b-d8fc852de266 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:25.144680 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-11cf3971-b670-47e0-871b-d8fc852de266 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:25.153427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-11cf3971-b670-47e0-871b-d8fc852de266 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:25.153427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-11cf3971-b670-47e0-871b-d8fc852de266 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:25.153427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-11cf3971-b670-47e0-871b-d8fc852de266 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:25.153427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-11cf3971-b670-47e0-871b-d8fc852de266 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:25.154128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-11cf3971-b670-47e0-871b-d8fc852de266 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:25.155670 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-11cf3971-b670-47e0-871b-d8fc852de266 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:25.171931 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-520d12ef-f1c9-47f0-9cda-1d5623ff6563 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 200 len: 1464 microversion: 2.1 time: 0.124580 Oct 10 19:00:25.172826 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1128/2512] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:25 2022] GET /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 1464 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:25.202878 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1e24dc4b-80c3-4e00-9cc9-81a760ac9226 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:25.203604 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1e24dc4b-80c3-4e00-9cc9-81a760ac9226 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:25.211321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1e24dc4b-80c3-4e00-9cc9-81a760ac9226 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:25.211886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1e24dc4b-80c3-4e00-9cc9-81a760ac9226 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:25.212451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1e24dc4b-80c3-4e00-9cc9-81a760ac9226 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:25.213252 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1e24dc4b-80c3-4e00-9cc9-81a760ac9226 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:25.213781 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1e24dc4b-80c3-4e00-9cc9-81a760ac9226 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:25.214432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1e24dc4b-80c3-4e00-9cc9-81a760ac9226 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:25.417720 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-11cf3971-b670-47e0-871b-d8fc852de266 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:25.428358 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-11cf3971-b670-47e0-871b-d8fc852de266 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1355 microversion: 2.1 time: 0.301955 Oct 10 19:00:25.429233 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1385/2513] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:25 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1355 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:25.511958 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1e24dc4b-80c3-4e00-9cc9-81a760ac9226 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:25.525068 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1e24dc4b-80c3-4e00-9cc9-81a760ac9226 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1480 microversion: 2.1 time: 0.326210 Oct 10 19:00:25.536863 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1129/2514] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:25 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1480 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:25.869008 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c9776e7d-8f5b-4d16-b0bf-65724120c958 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:25.869635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c9776e7d-8f5b-4d16-b0bf-65724120c958 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:25.877049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9776e7d-8f5b-4d16-b0bf-65724120c958 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:25.882825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9776e7d-8f5b-4d16-b0bf-65724120c958 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:25.882825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9776e7d-8f5b-4d16-b0bf-65724120c958 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:25.882825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9776e7d-8f5b-4d16-b0bf-65724120c958 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:25.882825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9776e7d-8f5b-4d16-b0bf-65724120c958 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:25.882825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c9776e7d-8f5b-4d16-b0bf-65724120c958 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:26.043353 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-e0f8bc34-e3aa-447c-bd0a-39684eebf1fe req-965e127f-db9c-46e0-9be4-e313673bfe6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e295c8-6ffa-4153-a9ae-1a2ce81a1b72", "name": "network-vif-plugged", "status": "completed", "tag": "e11576b3-4ac1-481a-b46a-0785fc909905"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:26.057182 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e0f8bc34-e3aa-447c-bd0a-39684eebf1fe req-965e127f-db9c-46e0-9be4-e313673bfe6e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:26.058194 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e0f8bc34-e3aa-447c-bd0a-39684eebf1fe req-965e127f-db9c-46e0-9be4-e313673bfe6e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:26.058796 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-e0f8bc34-e3aa-447c-bd0a-39684eebf1fe req-965e127f-db9c-46e0-9be4-e313673bfe6e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:26.074063 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-e0f8bc34-e3aa-447c-bd0a-39684eebf1fe req-965e127f-db9c-46e0-9be4-e313673bfe6e service nova] Creating event network-vif-plugged:e11576b3-4ac1-481a-b46a-0785fc909905 for instance 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 on n-h1-860863-1 Oct 10 19:00:26.079212 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-e0f8bc34-e3aa-447c-bd0a-39684eebf1fe req-965e127f-db9c-46e0-9be4-e313673bfe6e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040330 Oct 10 19:00:26.080569 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1130/2515] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 19:00:26.087275 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-26f5a210-abef-4502-a9c4-46a80fa1e6d8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f319226fca0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:26.145393 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-26f5a210-abef-4502-a9c4-46a80fa1e6d8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715" status: 200 len: 1413 microversion: 2.1 time: 0.063099 Oct 10 19:00:26.154239 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1131/2516] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:26 2022] GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715 => generated 1413 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:26.157616 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-87208c27-2b68-4df4-a5df-558e580a0606 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:26.159834 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-87208c27-2b68-4df4-a5df-558e580a0606 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:26.167711 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87208c27-2b68-4df4-a5df-558e580a0606 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:26.168316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87208c27-2b68-4df4-a5df-558e580a0606 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:26.169154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87208c27-2b68-4df4-a5df-558e580a0606 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:26.169889 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87208c27-2b68-4df4-a5df-558e580a0606 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:26.170353 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87208c27-2b68-4df4-a5df-558e580a0606 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:26.170783 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87208c27-2b68-4df4-a5df-558e580a0606 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:26.188358 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c9776e7d-8f5b-4d16-b0bf-65724120c958 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:26.197509 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c9776e7d-8f5b-4d16-b0bf-65724120c958 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1522 microversion: 2.1 time: 0.332855 Oct 10 19:00:26.198095 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1386/2517] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:25 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:26.364340 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-87208c27-2b68-4df4-a5df-558e580a0606 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:26.370015 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-87208c27-2b68-4df4-a5df-558e580a0606 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.216774 Oct 10 19:00:26.370889 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1132/2518] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:26 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:26.451276 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-91e283ee-c251-4b88-9d92-2792ccf0023b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:26.452002 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-91e283ee-c251-4b88-9d92-2792ccf0023b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:26.454563 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:26.459993 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-91e283ee-c251-4b88-9d92-2792ccf0023b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:26.459993 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-91e283ee-c251-4b88-9d92-2792ccf0023b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:26.460444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-91e283ee-c251-4b88-9d92-2792ccf0023b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:26.461208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-91e283ee-c251-4b88-9d92-2792ccf0023b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:26.461653 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-91e283ee-c251-4b88-9d92-2792ccf0023b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:26.462067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-91e283ee-c251-4b88-9d92-2792ccf0023b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:26.558460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9c8ed6b4-9804-4eca-823b-1adc97892850 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:26.558460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9c8ed6b4-9804-4eca-823b-1adc97892850 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:26.567751 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c8ed6b4-9804-4eca-823b-1adc97892850 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:26.568437 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c8ed6b4-9804-4eca-823b-1adc97892850 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:26.568968 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c8ed6b4-9804-4eca-823b-1adc97892850 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:26.569954 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c8ed6b4-9804-4eca-823b-1adc97892850 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:26.570487 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c8ed6b4-9804-4eca-823b-1adc97892850 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:26.571029 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c8ed6b4-9804-4eca-823b-1adc97892850 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:26.703378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-91e283ee-c251-4b88-9d92-2792ccf0023b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:26.713868 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-91e283ee-c251-4b88-9d92-2792ccf0023b tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1805 microversion: 2.1 time: 0.266506 Oct 10 19:00:26.729040 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1387/2519] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:26 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1805 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:26.738484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-609d08cc-4268-4286-b983-9d501e0ec051 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:26.740120 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-609d08cc-4268-4286-b983-9d501e0ec051 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:26.746679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-609d08cc-4268-4286-b983-9d501e0ec051 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:26.747462 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-609d08cc-4268-4286-b983-9d501e0ec051 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:26.748080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-609d08cc-4268-4286-b983-9d501e0ec051 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:26.749000 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-609d08cc-4268-4286-b983-9d501e0ec051 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:26.749907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-609d08cc-4268-4286-b983-9d501e0ec051 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:26.750520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-609d08cc-4268-4286-b983-9d501e0ec051 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:26.774696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:26.775790 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9c8ed6b4-9804-4eca-823b-1adc97892850 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:26.789543 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-609d08cc-4268-4286-b983-9d501e0ec051 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4/ips" status: 200 len: 218 microversion: 2.1 time: 0.046146 Oct 10 19:00:26.789543 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1388/2520] 10.222.0.43 () {58 vars in 1248 bytes} [Mon Oct 10 19:00:26 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4/ips => generated 218 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 19:00:26.789790 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9c8ed6b4-9804-4eca-823b-1adc97892850 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1467 microversion: 2.1 time: 0.237670 Oct 10 19:00:26.796393 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-99ec9747-4604-4ddb-b6fe-82d63cc55938 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:26.797120 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1133/2521] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:26 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1467 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:26.797428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-99ec9747-4604-4ddb-b6fe-82d63cc55938 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:26.805225 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-99ec9747-4604-4ddb-b6fe-82d63cc55938 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:26.806018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-99ec9747-4604-4ddb-b6fe-82d63cc55938 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:26.806658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-99ec9747-4604-4ddb-b6fe-82d63cc55938 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:26.807588 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-99ec9747-4604-4ddb-b6fe-82d63cc55938 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:26.808252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-99ec9747-4604-4ddb-b6fe-82d63cc55938 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:26.809045 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-99ec9747-4604-4ddb-b6fe-82d63cc55938 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:26.811922 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-79ff6c68-b5aa-4c55-b3b4-e898ca0e7271 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1591966765"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:26.819666 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-79ff6c68-b5aa-4c55-b3b4-e898ca0e7271 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:26.827839 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-79ff6c68-b5aa-4c55-b3b4-e898ca0e7271 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:26.828577 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-79ff6c68-b5aa-4c55-b3b4-e898ca0e7271 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:26.830423 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-79ff6c68-b5aa-4c55-b3b4-e898ca0e7271 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:26.831409 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-79ff6c68-b5aa-4c55-b3b4-e898ca0e7271 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:26.832025 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-79ff6c68-b5aa-4c55-b3b4-e898ca0e7271 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:26.832622 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-79ff6c68-b5aa-4c55-b3b4-e898ca0e7271 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:26.857729 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-99ec9747-4604-4ddb-b6fe-82d63cc55938 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:00:27.288921 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-99ec9747-4604-4ddb-b6fe-82d63cc55938 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 204 len: 0 microversion: 2.1 time: 0.496648 Oct 10 19:00:27.294663 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1389/2522] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:00:26 2022] DELETE /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:00:27.304431 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-99e9590c-a90e-45f3-93a9-6a293141d5d3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318d693670>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:27.379324 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-99e9590c-a90e-45f3-93a9-6a293141d5d3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715" status: 200 len: 1413 microversion: 2.1 time: 0.082824 Oct 10 19:00:27.380646 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1390/2523] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:27 2022] GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715 => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:27.388764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0374f8db-7d8e-4a68-874e-cd0172beb972 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:27.389908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0374f8db-7d8e-4a68-874e-cd0172beb972 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:27.398600 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0374f8db-7d8e-4a68-874e-cd0172beb972 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:27.399234 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0374f8db-7d8e-4a68-874e-cd0172beb972 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:27.399738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0374f8db-7d8e-4a68-874e-cd0172beb972 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:27.400519 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0374f8db-7d8e-4a68-874e-cd0172beb972 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:27.401105 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0374f8db-7d8e-4a68-874e-cd0172beb972 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:27.401599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0374f8db-7d8e-4a68-874e-cd0172beb972 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:27.442099 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-79ff6c68-b5aa-4c55-b3b4-e898ca0e7271 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "POST /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f/action" status: 202 len: 0 microversion: 2.1 time: 0.635657 Oct 10 19:00:27.449186 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1134/2524] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:00:26 2022] POST /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 10 19:00:27.460009 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-503e8b5a-fe59-4e03-8584-5ecdef80f59f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:27.460746 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-503e8b5a-fe59-4e03-8584-5ecdef80f59f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:27.471910 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-503e8b5a-fe59-4e03-8584-5ecdef80f59f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:27.476591 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-503e8b5a-fe59-4e03-8584-5ecdef80f59f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:27.477975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-503e8b5a-fe59-4e03-8584-5ecdef80f59f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:27.478985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-503e8b5a-fe59-4e03-8584-5ecdef80f59f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:27.479626 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-503e8b5a-fe59-4e03-8584-5ecdef80f59f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:27.483852 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-503e8b5a-fe59-4e03-8584-5ecdef80f59f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:27.677810 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=6 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:27.683038 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0374f8db-7d8e-4a68-874e-cd0172beb972 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:27.691690 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0374f8db-7d8e-4a68-874e-cd0172beb972 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1522 microversion: 2.1 time: 0.309758 Oct 10 19:00:27.693424 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1391/2525] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:27 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:27.711292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2e13fad2-d5a0-4fa8-bddb-d1e0aca0f8fc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:27.712463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2e13fad2-d5a0-4fa8-bddb-d1e0aca0f8fc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:27.716845 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-503e8b5a-fe59-4e03-8584-5ecdef80f59f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:27.722955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2e13fad2-d5a0-4fa8-bddb-d1e0aca0f8fc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:27.724133 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2e13fad2-d5a0-4fa8-bddb-d1e0aca0f8fc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:27.726225 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2e13fad2-d5a0-4fa8-bddb-d1e0aca0f8fc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:27.727116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2e13fad2-d5a0-4fa8-bddb-d1e0aca0f8fc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:27.729124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2e13fad2-d5a0-4fa8-bddb-d1e0aca0f8fc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:27.734170 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2e13fad2-d5a0-4fa8-bddb-d1e0aca0f8fc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:27.734473 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-503e8b5a-fe59-4e03-8584-5ecdef80f59f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1811 microversion: 2.1 time: 0.281468 Oct 10 19:00:27.734473 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1135/2526] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:27 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1811 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:27.743087 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-efd84caa-14ac-463f-ba5a-3cf40753039b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921c6ee0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:27.813868 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-efd84caa-14ac-463f-ba5a-3cf40753039b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1455 microversion: 2.1 time: 0.081513 Oct 10 19:00:27.829589 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1136/2527] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:27 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:28.046643 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2e13fad2-d5a0-4fa8-bddb-d1e0aca0f8fc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:28.057619 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2e13fad2-d5a0-4fa8-bddb-d1e0aca0f8fc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1515 microversion: 2.1 time: 0.362838 Oct 10 19:00:28.068911 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1392/2528] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:27 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1515 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:28.398904 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-616abb8c-13ae-4097-96b4-4dcb6086f0c0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f319226fd30>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:28.458523 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-616abb8c-13ae-4097-96b4-4dcb6086f0c0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715" status: 200 len: 1413 microversion: 2.1 time: 0.063939 Oct 10 19:00:28.461587 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1137/2529] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:28 2022] GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715 => generated 1413 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:28.721821 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-dba35d79-5331-4dab-9d76-619f128a20a5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:28.722645 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-dba35d79-5331-4dab-9d76-619f128a20a5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:28.730053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:28.733554 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dba35d79-5331-4dab-9d76-619f128a20a5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:28.737982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dba35d79-5331-4dab-9d76-619f128a20a5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:28.738758 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dba35d79-5331-4dab-9d76-619f128a20a5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:28.741161 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dba35d79-5331-4dab-9d76-619f128a20a5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:28.747080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dba35d79-5331-4dab-9d76-619f128a20a5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:28.747080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-dba35d79-5331-4dab-9d76-619f128a20a5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:28.757136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4bb19ad1-352c-48e6-a0d1-1dc01596a234 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:28.758707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4bb19ad1-352c-48e6-a0d1-1dc01596a234 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:28.769256 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4bb19ad1-352c-48e6-a0d1-1dc01596a234 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:28.771627 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4bb19ad1-352c-48e6-a0d1-1dc01596a234 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:28.775596 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4bb19ad1-352c-48e6-a0d1-1dc01596a234 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:28.775596 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4bb19ad1-352c-48e6-a0d1-1dc01596a234 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:28.778759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4bb19ad1-352c-48e6-a0d1-1dc01596a234 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:28.781701 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4bb19ad1-352c-48e6-a0d1-1dc01596a234 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:29.160907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-dba35d79-5331-4dab-9d76-619f128a20a5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:29.174080 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-dba35d79-5331-4dab-9d76-619f128a20a5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1522 microversion: 2.1 time: 0.456011 Oct 10 19:00:29.180016 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1393/2530] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:28 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:29.187509 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8d501650-932e-48ab-a399-9e7f52154a57 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319225edc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:29.247277 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4bb19ad1-352c-48e6-a0d1-1dc01596a234 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:29.261510 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4bb19ad1-352c-48e6-a0d1-1dc01596a234 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1811 microversion: 2.1 time: 0.508528 Oct 10 19:00:29.263064 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1138/2531] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:28 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1811 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:29.269423 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b3178828-7c52-47ff-8ff6-c16b393ac1a1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:29.271789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b3178828-7c52-47ff-8ff6-c16b393ac1a1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:29.277773 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3178828-7c52-47ff-8ff6-c16b393ac1a1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:29.278474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3178828-7c52-47ff-8ff6-c16b393ac1a1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:29.279096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3178828-7c52-47ff-8ff6-c16b393ac1a1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:29.280427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3178828-7c52-47ff-8ff6-c16b393ac1a1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:29.281085 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3178828-7c52-47ff-8ff6-c16b393ac1a1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:29.281673 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3178828-7c52-47ff-8ff6-c16b393ac1a1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:29.299760 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8d501650-932e-48ab-a399-9e7f52154a57 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1455 microversion: 2.1 time: 0.118283 Oct 10 19:00:29.301781 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1394/2532] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:29 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:29.315877 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-934b0021-0491-4f10-962f-f903f7aab7e0 req-31ff2737-253a-483d-9df4-cef6bd39514b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4098c038-9bbe-4f57-8b58-a6b33603f231", "name": "network-vif-unplugged", "status": "completed", "tag": "f24f31eb-483d-4f5b-a6a5-8c0d1e1cce67"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:29.335021 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-934b0021-0491-4f10-962f-f903f7aab7e0 req-31ff2737-253a-483d-9df4-cef6bd39514b service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:29.337166 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-934b0021-0491-4f10-962f-f903f7aab7e0 req-31ff2737-253a-483d-9df4-cef6bd39514b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:29.337792 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-934b0021-0491-4f10-962f-f903f7aab7e0 req-31ff2737-253a-483d-9df4-cef6bd39514b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:29.359823 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-934b0021-0491-4f10-962f-f903f7aab7e0 req-31ff2737-253a-483d-9df4-cef6bd39514b service nova] Creating event network-vif-unplugged:f24f31eb-483d-4f5b-a6a5-8c0d1e1cce67 for instance 4098c038-9bbe-4f57-8b58-a6b33603f231 on n-h1-860863-1 Oct 10 19:00:29.372299 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-934b0021-0491-4f10-962f-f903f7aab7e0 req-31ff2737-253a-483d-9df4-cef6bd39514b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067428 Oct 10 19:00:29.377657 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1395/2533] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:29.484503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b68c32eb-6100-449c-a0d6-315f3ee89a8f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318d8511f0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:29.504421 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b3178828-7c52-47ff-8ff6-c16b393ac1a1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:29.516599 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b3178828-7c52-47ff-8ff6-c16b393ac1a1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1521 microversion: 2.1 time: 0.251077 Oct 10 19:00:29.518694 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1139/2534] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:29 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:29.581443 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b68c32eb-6100-449c-a0d6-315f3ee89a8f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715" status: 200 len: 1413 microversion: 2.1 time: 0.105371 Oct 10 19:00:29.582485 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1396/2535] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:29 2022] GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:30.199189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f89116c9-ed2b-43a3-86a7-3f9536e3c339 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:30.199838 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f89116c9-ed2b-43a3-86a7-3f9536e3c339 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:30.212119 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89116c9-ed2b-43a3-86a7-3f9536e3c339 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:30.212677 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89116c9-ed2b-43a3-86a7-3f9536e3c339 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:30.213132 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89116c9-ed2b-43a3-86a7-3f9536e3c339 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:30.213871 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89116c9-ed2b-43a3-86a7-3f9536e3c339 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:30.219780 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89116c9-ed2b-43a3-86a7-3f9536e3c339 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:30.220305 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f89116c9-ed2b-43a3-86a7-3f9536e3c339 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:30.224909 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:30.293594 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f2a83776-c695-4454-956a-f3c6f21a891e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:30.294559 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f2a83776-c695-4454-956a-f3c6f21a891e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:30.317016 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2a83776-c695-4454-956a-f3c6f21a891e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:30.319023 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2a83776-c695-4454-956a-f3c6f21a891e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:30.321124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2a83776-c695-4454-956a-f3c6f21a891e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:30.323315 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2a83776-c695-4454-956a-f3c6f21a891e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:30.323603 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2a83776-c695-4454-956a-f3c6f21a891e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:30.330179 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f2a83776-c695-4454-956a-f3c6f21a891e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:30.764784 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f89116c9-ed2b-43a3-86a7-3f9536e3c339 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:30.773588 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f89116c9-ed2b-43a3-86a7-3f9536e3c339 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1522 microversion: 2.1 time: 0.578428 Oct 10 19:00:30.780866 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1140/2536] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:30 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1522 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:30.801632 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-82022a1c-a0b6-4d9e-8c46-0afd1fc06bfb tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f3192362ee0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:30.815376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=8 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:30.884135 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-82022a1c-a0b6-4d9e-8c46-0afd1fc06bfb tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1455 microversion: 2.1 time: 0.101888 Oct 10 19:00:30.884753 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1141/2537] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:30 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:30.897483 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-6d41f1c8-6965-46a7-8324-37cdc0010fc8 req-0c934bc1-0354-4ad0-a9cc-7bc191f8306e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b24fdb-281e-478a-8aca-665e35082ba4", "name": "network-vif-deleted", "tag": "9fb205c6-4673-44b4-86aa-fdaf03c74fb8"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:30.929072 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6d41f1c8-6965-46a7-8324-37cdc0010fc8 req-0c934bc1-0354-4ad0-a9cc-7bc191f8306e service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:30.929867 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6d41f1c8-6965-46a7-8324-37cdc0010fc8 req-0c934bc1-0354-4ad0-a9cc-7bc191f8306e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:30.930464 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6d41f1c8-6965-46a7-8324-37cdc0010fc8 req-0c934bc1-0354-4ad0-a9cc-7bc191f8306e service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:30.962842 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-6d41f1c8-6965-46a7-8324-37cdc0010fc8 req-0c934bc1-0354-4ad0-a9cc-7bc191f8306e service nova] Creating event network-vif-deleted:9fb205c6-4673-44b4-86aa-fdaf03c74fb8 for instance c3b24fdb-281e-478a-8aca-665e35082ba4 on n-h1-860863-1 Oct 10 19:00:30.997236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f2a83776-c695-4454-956a-f3c6f21a891e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:31.013636 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-6d41f1c8-6965-46a7-8324-37cdc0010fc8 req-0c934bc1-0354-4ad0-a9cc-7bc191f8306e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119685 Oct 10 19:00:31.020346 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1142/2538] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:31.028320 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f2a83776-c695-4454-956a-f3c6f21a891e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1790 microversion: 2.1 time: 0.741226 Oct 10 19:00:31.044853 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1397/2539] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:30 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1790 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:31.045582 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-829f9984-4592-46e6-84dd-d7e96fc9e5ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:31.068466 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-829f9984-4592-46e6-84dd-d7e96fc9e5ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:31.069158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c59315c4-3ebe-4e33-afa6-f58a0a46f9bc tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318ddbc820>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:31.106001 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-829f9984-4592-46e6-84dd-d7e96fc9e5ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:31.107224 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-829f9984-4592-46e6-84dd-d7e96fc9e5ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:31.107686 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-829f9984-4592-46e6-84dd-d7e96fc9e5ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:31.111853 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-829f9984-4592-46e6-84dd-d7e96fc9e5ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:31.113163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-829f9984-4592-46e6-84dd-d7e96fc9e5ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:31.117170 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-829f9984-4592-46e6-84dd-d7e96fc9e5ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:31.187098 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c59315c4-3ebe-4e33-afa6-f58a0a46f9bc tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715" status: 200 len: 1413 microversion: 2.1 time: 0.153307 Oct 10 19:00:31.191489 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1398/2540] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:31 2022] GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715 => generated 1413 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:31.355220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-829f9984-4592-46e6-84dd-d7e96fc9e5ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:31.371720 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-829f9984-4592-46e6-84dd-d7e96fc9e5ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1521 microversion: 2.1 time: 0.346635 Oct 10 19:00:31.373463 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1143/2541] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:31 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:31.803141 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=12 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:31.807454 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5a5fbfa6-34ca-4bc0-b190-526c4104b8ce tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:31.809864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5a5fbfa6-34ca-4bc0-b190-526c4104b8ce tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:31.824029 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a5fbfa6-34ca-4bc0-b190-526c4104b8ce tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:31.824798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a5fbfa6-34ca-4bc0-b190-526c4104b8ce tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:31.825487 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a5fbfa6-34ca-4bc0-b190-526c4104b8ce tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:31.826503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a5fbfa6-34ca-4bc0-b190-526c4104b8ce tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:31.827168 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a5fbfa6-34ca-4bc0-b190-526c4104b8ce tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:31.827970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5a5fbfa6-34ca-4bc0-b190-526c4104b8ce tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:31.901035 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dd06ef74-2668-4f59-b2ca-215a34f81949 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319225d430>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:31.994331 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dd06ef74-2668-4f59-b2ca-215a34f81949 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1455 microversion: 2.1 time: 0.098973 Oct 10 19:00:31.995401 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1144/2542] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:31 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:32.069509 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0c3b0d08-cbc6-4c00-afe1-83253948f4c9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:32.070625 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0c3b0d08-cbc6-4c00-afe1-83253948f4c9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:32.073722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:32.084203 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c3b0d08-cbc6-4c00-afe1-83253948f4c9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:32.088324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c3b0d08-cbc6-4c00-afe1-83253948f4c9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:32.091638 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c3b0d08-cbc6-4c00-afe1-83253948f4c9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:32.092479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c3b0d08-cbc6-4c00-afe1-83253948f4c9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:32.093049 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c3b0d08-cbc6-4c00-afe1-83253948f4c9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:32.099041 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0c3b0d08-cbc6-4c00-afe1-83253948f4c9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:32.247806 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0c3b0d08-cbc6-4c00-afe1-83253948f4c9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:32.258630 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0c3b0d08-cbc6-4c00-afe1-83253948f4c9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1613 microversion: 2.1 time: 0.195229 Oct 10 19:00:32.266789 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1145/2543] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:32 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1613 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:32.272112 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cf4f0e26-c9c8-4cff-ba59-d66c0fc40003 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f31921818b0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:32.352879 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cf4f0e26-c9c8-4cff-ba59-d66c0fc40003 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715" status: 200 len: 1413 microversion: 2.1 time: 0.084544 Oct 10 19:00:32.353635 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1146/2544] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:32 2022] GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715 => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:32.396096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fbcb7a79-958c-4960-9a99-d0be505acc65 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:32.396906 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fbcb7a79-958c-4960-9a99-d0be505acc65 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:32.413021 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fbcb7a79-958c-4960-9a99-d0be505acc65 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:32.413518 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fbcb7a79-958c-4960-9a99-d0be505acc65 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:32.417653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fbcb7a79-958c-4960-9a99-d0be505acc65 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:32.417653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fbcb7a79-958c-4960-9a99-d0be505acc65 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:32.417653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fbcb7a79-958c-4960-9a99-d0be505acc65 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:32.417653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fbcb7a79-958c-4960-9a99-d0be505acc65 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:32.499544 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5a5fbfa6-34ca-4bc0-b190-526c4104b8ce tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:32.507596 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5a5fbfa6-34ca-4bc0-b190-526c4104b8ce tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1522 microversion: 2.1 time: 0.706246 Oct 10 19:00:32.508178 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1399/2545] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:31 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1522 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:32.680262 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fbcb7a79-958c-4960-9a99-d0be505acc65 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:32.688723 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fbcb7a79-958c-4960-9a99-d0be505acc65 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1521 microversion: 2.1 time: 0.296533 Oct 10 19:00:32.689484 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1147/2546] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:32 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:33.010943 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2cc72aad-858e-4aca-96f9-8d04169fd99d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31922f94c0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:33.033517 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-01e7f4bb-9d1c-45b2-9390-19c85f22b4d0 req-09371938-5557-42dc-aef8-75be5cb0bedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b24fdb-281e-478a-8aca-665e35082ba4", "name": "network-vif-deleted", "tag": "95c07e43-0ca4-462d-926e-60121c79a4aa"}, {"server_uuid": "c3b24fdb-281e-478a-8aca-665e35082ba4", "name": "network-vif-deleted", "tag": "4fec9244-ae46-4042-9186-dcea2242c021"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:33.059072 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-01e7f4bb-9d1c-45b2-9390-19c85f22b4d0 req-09371938-5557-42dc-aef8-75be5cb0bedb service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:33.060400 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-01e7f4bb-9d1c-45b2-9390-19c85f22b4d0 req-09371938-5557-42dc-aef8-75be5cb0bedb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:33.060867 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-01e7f4bb-9d1c-45b2-9390-19c85f22b4d0 req-09371938-5557-42dc-aef8-75be5cb0bedb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:33.077607 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-01e7f4bb-9d1c-45b2-9390-19c85f22b4d0 req-09371938-5557-42dc-aef8-75be5cb0bedb service nova] Creating event network-vif-deleted:95c07e43-0ca4-462d-926e-60121c79a4aa for instance c3b24fdb-281e-478a-8aca-665e35082ba4 on n-h1-860863-1 Oct 10 19:00:33.078232 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-01e7f4bb-9d1c-45b2-9390-19c85f22b4d0 req-09371938-5557-42dc-aef8-75be5cb0bedb service nova] Creating event network-vif-deleted:4fec9244-ae46-4042-9186-dcea2242c021 for instance c3b24fdb-281e-478a-8aca-665e35082ba4 on n-h1-860863-1 Oct 10 19:00:33.084650 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-01e7f4bb-9d1c-45b2-9390-19c85f22b4d0 req-09371938-5557-42dc-aef8-75be5cb0bedb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055458 Oct 10 19:00:33.085573 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1148/2547] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:33.147330 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2cc72aad-858e-4aca-96f9-8d04169fd99d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1455 microversion: 2.1 time: 0.140125 Oct 10 19:00:33.149954 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1400/2548] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:33 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:33.296470 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-85d8117d-837d-403b-ac92-313d2a3e75a4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:33.297726 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-85d8117d-837d-403b-ac92-313d2a3e75a4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:33.315591 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85d8117d-837d-403b-ac92-313d2a3e75a4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:33.316484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85d8117d-837d-403b-ac92-313d2a3e75a4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:33.317883 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85d8117d-837d-403b-ac92-313d2a3e75a4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:33.323066 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85d8117d-837d-403b-ac92-313d2a3e75a4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:33.325215 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85d8117d-837d-403b-ac92-313d2a3e75a4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:33.326215 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85d8117d-837d-403b-ac92-313d2a3e75a4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:33.370908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9ac42f63-8b0a-44bc-91b0-a08b3b268711 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318df91550>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:33.380910 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85d8117d-837d-403b-ac92-313d2a3e75a4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:33.382453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85d8117d-837d-403b-ac92-313d2a3e75a4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:33.383912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-85d8117d-837d-403b-ac92-313d2a3e75a4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:33.384484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-85d8117d-837d-403b-ac92-313d2a3e75a4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lazy-loading 'fault' on Instance uuid c3b24fdb-281e-478a-8aca-665e35082ba4 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:00:33.451457 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-85d8117d-837d-403b-ac92-313d2a3e75a4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:33.471130 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-85d8117d-837d-403b-ac92-313d2a3e75a4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 200 len: 1303 microversion: 2.1 time: 0.179027 Oct 10 19:00:33.472015 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1149/2549] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:33 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 1303 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:33.490510 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9ac42f63-8b0a-44bc-91b0-a08b3b268711 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715" status: 200 len: 1413 microversion: 2.1 time: 0.125347 Oct 10 19:00:33.492261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-bf2537b8-f5cd-446f-aaa4-d86ebbd0b833 req-489a4b40-0c32-4bf0-ace3-683579b21ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625d4b03-2441-4576-a0e2-6c266b24b1e9", "name": "network-vif-unplugged", "status": "completed", "tag": "f2875240-f490-44c6-8bd6-6fe609be5a6c"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:33.493431 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1401/2550] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:33 2022] GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715 => generated 1413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:33.520748 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-bf2537b8-f5cd-446f-aaa4-d86ebbd0b833 req-489a4b40-0c32-4bf0-ace3-683579b21ae1 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:33.521242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-bf2537b8-f5cd-446f-aaa4-d86ebbd0b833 req-489a4b40-0c32-4bf0-ace3-683579b21ae1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:33.526763 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-bf2537b8-f5cd-446f-aaa4-d86ebbd0b833 req-489a4b40-0c32-4bf0-ace3-683579b21ae1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:33.532423 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-32f85801-eb72-429d-881a-b97754d0c189 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:33.533428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-32f85801-eb72-429d-881a-b97754d0c189 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:33.546251 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32f85801-eb72-429d-881a-b97754d0c189 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:33.547839 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32f85801-eb72-429d-881a-b97754d0c189 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:33.549080 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32f85801-eb72-429d-881a-b97754d0c189 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:33.551470 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32f85801-eb72-429d-881a-b97754d0c189 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:33.554940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32f85801-eb72-429d-881a-b97754d0c189 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:33.555607 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-32f85801-eb72-429d-881a-b97754d0c189 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:33.575894 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-bf2537b8-f5cd-446f-aaa4-d86ebbd0b833 req-489a4b40-0c32-4bf0-ace3-683579b21ae1 service nova] Creating event network-vif-unplugged:f2875240-f490-44c6-8bd6-6fe609be5a6c for instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 on n-h2-860863-1 Oct 10 19:00:33.589469 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-bf2537b8-f5cd-446f-aaa4-d86ebbd0b833 req-489a4b40-0c32-4bf0-ace3-683579b21ae1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115021 Oct 10 19:00:33.590125 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1150/2551] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:33.718183 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ca7bf3ba-9c28-4a87-8f32-43e8542c2e24 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:33.718878 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ca7bf3ba-9c28-4a87-8f32-43e8542c2e24 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:33.725973 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ca7bf3ba-9c28-4a87-8f32-43e8542c2e24 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:33.726468 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ca7bf3ba-9c28-4a87-8f32-43e8542c2e24 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:33.737351 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ca7bf3ba-9c28-4a87-8f32-43e8542c2e24 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:33.740240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ca7bf3ba-9c28-4a87-8f32-43e8542c2e24 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:33.740240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ca7bf3ba-9c28-4a87-8f32-43e8542c2e24 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:33.740240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ca7bf3ba-9c28-4a87-8f32-43e8542c2e24 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:33.855689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-32f85801-eb72-429d-881a-b97754d0c189 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:33.865067 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-32f85801-eb72-429d-881a-b97754d0c189 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1522 microversion: 2.1 time: 0.337505 Oct 10 19:00:33.872279 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1402/2552] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:33 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:34.167296 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-79eab973-90dd-4503-a449-04439119cda2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318deb7af0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:34.238985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ca7bf3ba-9c28-4a87-8f32-43e8542c2e24 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:34.248606 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ca7bf3ba-9c28-4a87-8f32-43e8542c2e24 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1521 microversion: 2.1 time: 0.534312 Oct 10 19:00:34.263859 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1151/2553] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:33 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:34.496478 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0fca48e4-028a-4ff3-aade-9c097c1e81b9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:34.503893 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0fca48e4-028a-4ff3-aade-9c097c1e81b9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:34.517351 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fca48e4-028a-4ff3-aade-9c097c1e81b9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:34.518178 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fca48e4-028a-4ff3-aade-9c097c1e81b9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:34.518826 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fca48e4-028a-4ff3-aade-9c097c1e81b9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:34.520427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fca48e4-028a-4ff3-aade-9c097c1e81b9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:34.522826 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fca48e4-028a-4ff3-aade-9c097c1e81b9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:34.523830 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0fca48e4-028a-4ff3-aade-9c097c1e81b9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:34.558526 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-0fca48e4-028a-4ff3-aade-9c097c1e81b9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] HTTP exception thrown: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:00:34.570457 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-79eab973-90dd-4503-a449-04439119cda2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1455 microversion: 2.1 time: 0.409035 Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0fca48e4-028a-4ff3-aade-9c097c1e81b9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Request method failure captured: Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 HTTP/1.1 Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGuO9V3CgMSt_l3JlD1RVQ4jd_M2uydLQLknLZT3pCKpJggVJyLLFaiF-k23VPd26y-i0lrktud9P1XZQ2CoLjc-1F0yzFH-zOPSgmZVi_zSdIbVOJi3CZIulBWpypaNz5QR0KZGLG-mREGURmSAP_GluiMr7lKFdocUKnauWYWJ82E Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 1206fcb7f08f4c09a019a4a560ccac71 Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersTestMultiNic-447712075 Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1206fcb7f08f4c09a019a4a560ccac71", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1206fcb7f08f4c09a019a4a560ccac71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1206fcb7f08f4c09a019a4a560ccac71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1206fcb7f08f4c09a019a4a560ccac71"}]}] Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersTestMultiNic-447712075 Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 1206fcb7f08f4c09a019a4a560ccac71 Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersTestMultiNic-447712075 Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersTestMultiNic-447712075-project Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: f5d2fecfd1eb43dc9e050393017dede3 Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersTestMultiNic-447712075-project Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'c3b24fdb-281e-478a-8aca-665e35082ba4'} Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:00:34.571899 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:00:34.575987 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:00:34.575987 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:00:34.575987 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:00:34.575987 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:00:34.575987 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:00:34.575987 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:00:34.575987 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:00:34.578541 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0fca48e4-028a-4ff3-aade-9c097c1e81b9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Returning 404 to user: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:00:34.584933 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0fca48e4-028a-4ff3-aade-9c097c1e81b9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 404 len: 111 microversion: 2.1 time: 0.089398 Oct 10 19:00:34.589933 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1152/2554] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:34 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:00:34.590285 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1403/2555] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:34 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1455 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:00:34.608670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a8d617c1-2134-4fd9-bc3f-6f34348604c0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f31922ab9d0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:34.897895 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-987aefd9-d348-44a9-a116-85aed590525b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:34.898526 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-987aefd9-d348-44a9-a116-85aed590525b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:34.908970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-987aefd9-d348-44a9-a116-85aed590525b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:34.911813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-987aefd9-d348-44a9-a116-85aed590525b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:34.912514 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-987aefd9-d348-44a9-a116-85aed590525b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:34.915082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-987aefd9-d348-44a9-a116-85aed590525b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:34.917158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-987aefd9-d348-44a9-a116-85aed590525b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:34.922124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-987aefd9-d348-44a9-a116-85aed590525b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:35.300698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-987aefd9-d348-44a9-a116-85aed590525b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:35.322580 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-987aefd9-d348-44a9-a116-85aed590525b tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1522 microversion: 2.1 time: 0.429781 Oct 10 19:00:35.336562 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1404/2556] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:34 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:35.336562 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-24748b76-ca59-46f3-826c-8e13d3c20e86 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:35.336562 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-24748b76-ca59-46f3-826c-8e13d3c20e86 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:35.356479 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24748b76-ca59-46f3-826c-8e13d3c20e86 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:35.360009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24748b76-ca59-46f3-826c-8e13d3c20e86 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:35.360009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24748b76-ca59-46f3-826c-8e13d3c20e86 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:35.360009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24748b76-ca59-46f3-826c-8e13d3c20e86 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:35.360009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24748b76-ca59-46f3-826c-8e13d3c20e86 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:35.360009 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-24748b76-ca59-46f3-826c-8e13d3c20e86 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:36.049130 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-24748b76-ca59-46f3-826c-8e13d3c20e86 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:36.068010 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-24748b76-ca59-46f3-826c-8e13d3c20e86 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1521 microversion: 2.1 time: 0.742763 Oct 10 19:00:36.071254 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1405/2557] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:35 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1521 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:36.100246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-15488453-d41e-4375-98af-6d4d5a27ecdf tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319233adc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:44.518076 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=15 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:44.537122 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=45 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:45.381745 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:46.054674 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:00:48.092088 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a8d617c1-2134-4fd9-bc3f-6f34348604c0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715" status: 200 len: 1422 microversion: 2.1 time: 13.499465 Oct 10 19:00:48.101384 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-15488453-d41e-4375-98af-6d4d5a27ecdf tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1455 microversion: 2.1 time: 12.025713 Oct 10 19:00:48.102880 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1406/2558] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:36 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1455 bytes in 12029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:48.111310 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1153/2559] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:34 2022] GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715 => generated 1422 bytes in 13523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:48.135399 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a99fc623-ba27-4d6f-bfb3-a00c2b7ab7c6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:48.136122 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a99fc623-ba27-4d6f-bfb3-a00c2b7ab7c6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:48.156010 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a99fc623-ba27-4d6f-bfb3-a00c2b7ab7c6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:48.160246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a99fc623-ba27-4d6f-bfb3-a00c2b7ab7c6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:48.160246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a99fc623-ba27-4d6f-bfb3-a00c2b7ab7c6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:48.160246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a99fc623-ba27-4d6f-bfb3-a00c2b7ab7c6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:48.160246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a99fc623-ba27-4d6f-bfb3-a00c2b7ab7c6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:48.160246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a99fc623-ba27-4d6f-bfb3-a00c2b7ab7c6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:48.368783 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-8560b038-9483-4b86-8cd8-725ebe98be69 req-d032bc65-0ec4-4dce-83c9-968cc4a231a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f", "name": "network-vif-plugged", "status": "completed", "tag": "5bffc937-d058-4e1d-89e3-1fcc517f98e7"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:48.382741 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8560b038-9483-4b86-8cd8-725ebe98be69 req-d032bc65-0ec4-4dce-83c9-968cc4a231a8 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:48.384170 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8560b038-9483-4b86-8cd8-725ebe98be69 req-d032bc65-0ec4-4dce-83c9-968cc4a231a8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:48.384881 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-8560b038-9483-4b86-8cd8-725ebe98be69 req-d032bc65-0ec4-4dce-83c9-968cc4a231a8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:48.417028 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-8560b038-9483-4b86-8cd8-725ebe98be69 req-d032bc65-0ec4-4dce-83c9-968cc4a231a8 service nova] Creating event network-vif-plugged:5bffc937-d058-4e1d-89e3-1fcc517f98e7 for instance bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f on n-h1-860863-1 Oct 10 19:00:48.428785 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-8560b038-9483-4b86-8cd8-725ebe98be69 req-d032bc65-0ec4-4dce-83c9-968cc4a231a8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323409 Oct 10 19:00:48.430647 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1407/2560] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:48.436601 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4dd31a4e-d858-483c-a75d-ba5675e2def6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:48.437843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4dd31a4e-d858-483c-a75d-ba5675e2def6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:48.455226 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4dd31a4e-d858-483c-a75d-ba5675e2def6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:48.458379 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4dd31a4e-d858-483c-a75d-ba5675e2def6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:48.462734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4dd31a4e-d858-483c-a75d-ba5675e2def6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:48.472169 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4dd31a4e-d858-483c-a75d-ba5675e2def6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:48.472169 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4dd31a4e-d858-483c-a75d-ba5675e2def6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:48.472169 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4dd31a4e-d858-483c-a75d-ba5675e2def6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:48.642822 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a99fc623-ba27-4d6f-bfb3-a00c2b7ab7c6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:48.657479 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a99fc623-ba27-4d6f-bfb3-a00c2b7ab7c6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1499 microversion: 2.1 time: 0.545083 Oct 10 19:00:48.660742 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1154/2561] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:48 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1499 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:48.675524 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bca90d7d-6435-47eb-ade0-295c9e614836 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f31922d1f70>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:48.840241 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bca90d7d-6435-47eb-ade0-295c9e614836 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715" status: 200 len: 1422 microversion: 2.1 time: 0.177515 Oct 10 19:00:48.843672 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1155/2562] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:48 2022] GET /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715 => generated 1422 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:48.853395 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-058096f6-cdd5-46c7-8ad9-d27257a84455 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:48.888168 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-058096f6-cdd5-46c7-8ad9-d27257a84455 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:48.893402 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-058096f6-cdd5-46c7-8ad9-d27257a84455 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:00:48.903826 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-058096f6-cdd5-46c7-8ad9-d27257a84455 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:48.905011 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-058096f6-cdd5-46c7-8ad9-d27257a84455 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:48.905567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-058096f6-cdd5-46c7-8ad9-d27257a84455 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:48.908456 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-058096f6-cdd5-46c7-8ad9-d27257a84455 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:48.908456 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-058096f6-cdd5-46c7-8ad9-d27257a84455 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:48.908456 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-058096f6-cdd5-46c7-8ad9-d27257a84455 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:48.951757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4dd31a4e-d858-483c-a75d-ba5675e2def6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:48.962380 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.multi_cell_list [None req-058096f6-cdd5-46c7-8ad9-d27257a84455 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127289) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:00:48.965463 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4dd31a4e-d858-483c-a75d-ba5675e2def6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1521 microversion: 2.1 time: 0.533369 Oct 10 19:00:48.966686 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1408/2563] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:48 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:48.971534 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2950b213-2969-4020-9631-c3e551e1bf44 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f319225e940>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:49.087084 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-058096f6-cdd5-46c7-8ad9-d27257a84455 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.227660 Oct 10 19:00:49.089606 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1156/2564] 10.222.0.43 () {58 vars in 1154 bytes} [Mon Oct 10 19:00:48 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:49.106586 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d5413ec3-2cc0-4434-bceb-fd8ce138af51 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:49.135170 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5413ec3-2cc0-4434-bceb-fd8ce138af51 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:49.140651 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5413ec3-2cc0-4434-bceb-fd8ce138af51 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:49.141378 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d5413ec3-2cc0-4434-bceb-fd8ce138af51 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:49.287200 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d5413ec3-2cc0-4434-bceb-fd8ce138af51 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Going to try to start instance {{(pid=127289) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 10 19:00:49.629795 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d5413ec3-2cc0-4434-bceb-fd8ce138af51 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "POST /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58/action" status: 202 len: 0 microversion: 2.1 time: 0.531384 Oct 10 19:00:49.638816 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1157/2565] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:00:49 2022] POST /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 19:00:49.647991 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-63e3018a-cf63-4222-9af0-9b43ae831a7b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319225d040>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:50.901033 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2950b213-2969-4020-9631-c3e551e1bf44 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "DELETE /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715" status: 204 len: 0 microversion: 2.1 time: 1.932897 Oct 10 19:00:50.902370 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1409/2566] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:48 2022] DELETE /compute/v2.1/images/240ec6aa-c6a9-4d85-9f4e-038fcf234715 => generated 0 bytes in 1935 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:00:50.909928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-55150c7d-3074-4154-9095-3bb2387f2d84 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:50.912296 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-55150c7d-3074-4154-9095-3bb2387f2d84 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:50.946368 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55150c7d-3074-4154-9095-3bb2387f2d84 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:50.947348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55150c7d-3074-4154-9095-3bb2387f2d84 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:50.947994 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55150c7d-3074-4154-9095-3bb2387f2d84 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:50.949152 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55150c7d-3074-4154-9095-3bb2387f2d84 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:50.951533 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55150c7d-3074-4154-9095-3bb2387f2d84 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:50.953711 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55150c7d-3074-4154-9095-3bb2387f2d84 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:50.975951 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-63e3018a-cf63-4222-9af0-9b43ae831a7b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1455 microversion: 2.1 time: 1.342091 Oct 10 19:00:50.978801 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1158/2567] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:49 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1455 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:50.988296 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cf529f9e-3275-4ed5-a7cc-9178459ff9cf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:50.993259 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cf529f9e-3275-4ed5-a7cc-9178459ff9cf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:51.029500 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf529f9e-3275-4ed5-a7cc-9178459ff9cf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:51.030005 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf529f9e-3275-4ed5-a7cc-9178459ff9cf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:51.033342 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf529f9e-3275-4ed5-a7cc-9178459ff9cf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:51.036889 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf529f9e-3275-4ed5-a7cc-9178459ff9cf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:51.037389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf529f9e-3275-4ed5-a7cc-9178459ff9cf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:51.037831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cf529f9e-3275-4ed5-a7cc-9178459ff9cf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:51.521602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55150c7d-3074-4154-9095-3bb2387f2d84 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:51.535165 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-55150c7d-3074-4154-9095-3bb2387f2d84 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1508 microversion: 2.1 time: 0.628629 Oct 10 19:00:51.553270 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1410/2568] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:50 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:51.570347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-d7a52daf-e805-4aab-b8ed-1b5175191ca2 req-5b4ac76b-ece5-48e8-a9d1-de108026c8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625d4b03-2441-4576-a0e2-6c266b24b1e9", "name": "network-vif-plugged", "status": "completed", "tag": "f2875240-f490-44c6-8bd6-6fe609be5a6c"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:51.599091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d7a52daf-e805-4aab-b8ed-1b5175191ca2 req-5b4ac76b-ece5-48e8-a9d1-de108026c8f8 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:51.601291 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d7a52daf-e805-4aab-b8ed-1b5175191ca2 req-5b4ac76b-ece5-48e8-a9d1-de108026c8f8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:51.604728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d7a52daf-e805-4aab-b8ed-1b5175191ca2 req-5b4ac76b-ece5-48e8-a9d1-de108026c8f8 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:51.637308 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-d7a52daf-e805-4aab-b8ed-1b5175191ca2 req-5b4ac76b-ece5-48e8-a9d1-de108026c8f8 service nova] Creating event network-vif-plugged:f2875240-f490-44c6-8bd6-6fe609be5a6c for instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 on n-h2-860863-1 Oct 10 19:00:51.651687 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-d7a52daf-e805-4aab-b8ed-1b5175191ca2 req-5b4ac76b-ece5-48e8-a9d1-de108026c8f8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096406 Oct 10 19:00:51.656908 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1411/2569] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:51.666621 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4e0a88b6-9413-4805-9177-350d10b281af tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:51.672700 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4e0a88b6-9413-4805-9177-350d10b281af tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:51.684141 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e0a88b6-9413-4805-9177-350d10b281af tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:51.685558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e0a88b6-9413-4805-9177-350d10b281af tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:51.686156 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e0a88b6-9413-4805-9177-350d10b281af tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:51.688503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e0a88b6-9413-4805-9177-350d10b281af tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:51.689206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e0a88b6-9413-4805-9177-350d10b281af tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:51.690328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4e0a88b6-9413-4805-9177-350d10b281af tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:51.755816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4e0a88b6-9413-4805-9177-350d10b281af tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:00:51.829507 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cf529f9e-3275-4ed5-a7cc-9178459ff9cf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:51.841065 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cf529f9e-3275-4ed5-a7cc-9178459ff9cf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1521 microversion: 2.1 time: 0.857862 Oct 10 19:00:51.842395 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1159/2570] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:50 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1521 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:51.860271 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1660143548", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "610a6a6e-94f1-4be1-87a3-97f71fbd6978"}, {"uuid": "ea546c00-5ccd-4ce4-9255-89e39134f70d"}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:51.975052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] validate_networks() for [('610a6a6e-94f1-4be1-87a3-97f71fbd6978', None, None, None, None, None), ('ea546c00-5ccd-4ce4-9255-89e39134f70d', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 19:00:52.295986 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4e0a88b6-9413-4805-9177-350d10b281af tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "DELETE /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72" status: 204 len: 0 microversion: 2.1 time: 0.637543 Oct 10 19:00:52.300500 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1412/2571] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:00:51 2022] DELETE /compute/v2.1/servers/33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:00:52.310568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-068636a4-8877-4312-9f1d-93c5e8ca9c1d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318ddbc820>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:52.438410 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-068636a4-8877-4312-9f1d-93c5e8ca9c1d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1455 microversion: 2.1 time: 0.136249 Oct 10 19:00:52.455457 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1413/2572] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:52 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:52.566391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a5d510f1-eb75-4314-bd0e-a961af93ea92 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:52.568154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a5d510f1-eb75-4314-bd0e-a961af93ea92 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:52.577918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a5d510f1-eb75-4314-bd0e-a961af93ea92 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:52.578587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a5d510f1-eb75-4314-bd0e-a961af93ea92 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:52.579198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a5d510f1-eb75-4314-bd0e-a961af93ea92 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:52.580323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a5d510f1-eb75-4314-bd0e-a961af93ea92 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:52.580997 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a5d510f1-eb75-4314-bd0e-a961af93ea92 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:52.581583 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a5d510f1-eb75-4314-bd0e-a961af93ea92 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:53.131761 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a5d510f1-eb75-4314-bd0e-a961af93ea92 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:53.140895 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a5d510f1-eb75-4314-bd0e-a961af93ea92 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1508 microversion: 2.1 time: 0.579070 Oct 10 19:00:53.144976 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1414/2573] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:52 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1508 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:53.158114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2056463822", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "66c8ea36-6ebd-4d4c-b51b-1928dacdf136"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:53.257375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] validate_networks() for [('66c8ea36-6ebd-4d4c-b51b-1928dacdf136', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 19:00:54.972793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 19:00:54.974256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 19:00:54.975573 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 19:00:54.976355 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 19:00:54.977343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 19:00:55.003287 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:55.007202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:55.009324 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:55.014394 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:55.019008 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:55.019008 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:55.082067 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Getting quotas for project bd2cfdbce62b4c72b773d5312d02ab40. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 19:00:55.094738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Getting quotas for user 76ba48b4475d429f884546750a467e14 and project bd2cfdbce62b4c72b773d5312d02ab40. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 19:00:55.130360 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 19:00:55.133842 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 19:00:55.280786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 19:00:55.281906 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 19:00:55.282541 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 19:00:55.283135 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 19:00:55.283772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 19:00:55.308776 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:55.312473 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:55.313420 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:55.317517 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:55.317517 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:55.327203 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0fb5e6ed-8a58-4625-9beb-2d726d5945f7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.178007 Oct 10 19:00:55.328983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:55.356680 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1415/2574] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 19:00:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 19:00:55.389024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f42b5f59-3284-40ea-904d-e9259efff0e7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:55.390847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f42b5f59-3284-40ea-904d-e9259efff0e7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:55.417822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f42b5f59-3284-40ea-904d-e9259efff0e7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:55.419243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f42b5f59-3284-40ea-904d-e9259efff0e7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:55.419724 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Getting quotas for project 1206fcb7f08f4c09a019a4a560ccac71. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 19:00:55.420721 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f42b5f59-3284-40ea-904d-e9259efff0e7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:55.423999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f42b5f59-3284-40ea-904d-e9259efff0e7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:55.439311 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f42b5f59-3284-40ea-904d-e9259efff0e7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:55.443214 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f42b5f59-3284-40ea-904d-e9259efff0e7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:55.446295 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Getting quotas for user f5d2fecfd1eb43dc9e050393017dede3 and project 1206fcb7f08f4c09a019a4a560ccac71. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 19:00:55.484276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 19:00:55.486747 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 19:00:55.711716 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e0dddd09-7ffa-4e36-a2da-24bc594350b4 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.867690 Oct 10 19:00:55.717045 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1160/2575] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 19:00:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 19:00:55.728786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8b877d79-9600-4e3e-b512-dc0b219c3370 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31922d1700>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:55.840367 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8b877d79-9600-4e3e-b512-dc0b219c3370 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1455 microversion: 2.1 time: 0.122012 Oct 10 19:00:55.841729 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1161/2576] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:55 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:55.852050 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-1446210c-f4a9-4fd9-b8c0-5a0d61fa8aa7 req-4add0e80-7f53-4f17-84b5-e6b833ea6be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e295c8-6ffa-4153-a9ae-1a2ce81a1b72", "name": "network-vif-unplugged", "status": "completed", "tag": "e11576b3-4ac1-481a-b46a-0785fc909905"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:55.876988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1446210c-f4a9-4fd9-b8c0-5a0d61fa8aa7 req-4add0e80-7f53-4f17-84b5-e6b833ea6be1 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:55.876988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1446210c-f4a9-4fd9-b8c0-5a0d61fa8aa7 req-4add0e80-7f53-4f17-84b5-e6b833ea6be1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:55.876988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1446210c-f4a9-4fd9-b8c0-5a0d61fa8aa7 req-4add0e80-7f53-4f17-84b5-e6b833ea6be1 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:55.896383 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-1446210c-f4a9-4fd9-b8c0-5a0d61fa8aa7 req-4add0e80-7f53-4f17-84b5-e6b833ea6be1 service nova] Creating event network-vif-unplugged:e11576b3-4ac1-481a-b46a-0785fc909905 for instance 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 on n-h1-860863-1 Oct 10 19:00:55.918553 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-1446210c-f4a9-4fd9-b8c0-5a0d61fa8aa7 req-4add0e80-7f53-4f17-84b5-e6b833ea6be1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074823 Oct 10 19:00:55.919776 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1162/2577] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:55.929989 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-246a4ce6-e8af-4f36-b6b8-7fcef457999c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:55.931517 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-246a4ce6-e8af-4f36-b6b8-7fcef457999c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:55.946000 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-246a4ce6-e8af-4f36-b6b8-7fcef457999c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:55.946754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-246a4ce6-e8af-4f36-b6b8-7fcef457999c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:55.947348 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-246a4ce6-e8af-4f36-b6b8-7fcef457999c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:55.948201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-246a4ce6-e8af-4f36-b6b8-7fcef457999c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:55.948833 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-246a4ce6-e8af-4f36-b6b8-7fcef457999c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:55.949402 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-246a4ce6-e8af-4f36-b6b8-7fcef457999c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:56.091149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f42b5f59-3284-40ea-904d-e9259efff0e7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:56.108291 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f42b5f59-3284-40ea-904d-e9259efff0e7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1506 microversion: 2.1 time: 0.745113 Oct 10 19:00:56.108744 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1416/2578] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:55 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1506 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:56.120438 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-21aaafb8-022f-4720-8ab6-f78d043f0fb9 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:56.122590 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-21aaafb8-022f-4720-8ab6-f78d043f0fb9 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:56.391011 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-21aaafb8-022f-4720-8ab6-f78d043f0fb9 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:56.404303 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-21aaafb8-022f-4720-8ab6-f78d043f0fb9 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1208 microversion: 2.1 time: 0.293084 Oct 10 19:00:56.404968 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1417/2579] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:56 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1208 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:56.424051 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-988ba5ee-f9f4-4d31-bf03-31cbf1df2268 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:56.429599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-988ba5ee-f9f4-4d31-bf03-31cbf1df2268 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:56.681345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-988ba5ee-f9f4-4d31-bf03-31cbf1df2268 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:56.695014 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-988ba5ee-f9f4-4d31-bf03-31cbf1df2268 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1213 microversion: 2.1 time: 0.280492 Oct 10 19:00:56.702634 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1418/2580] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:56 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1213 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:56.713208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a60b43c8-7f11-46d0-b43e-86240568727f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:56.722676 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a60b43c8-7f11-46d0-b43e-86240568727f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:56.740969 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a60b43c8-7f11-46d0-b43e-86240568727f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:56.741774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a60b43c8-7f11-46d0-b43e-86240568727f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:56.742665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a60b43c8-7f11-46d0-b43e-86240568727f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:56.750538 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a60b43c8-7f11-46d0-b43e-86240568727f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:56.752275 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a60b43c8-7f11-46d0-b43e-86240568727f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:56.755785 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a60b43c8-7f11-46d0-b43e-86240568727f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:57.265487 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a60b43c8-7f11-46d0-b43e-86240568727f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:57.280295 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a60b43c8-7f11-46d0-b43e-86240568727f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 200 len: 1506 microversion: 2.1 time: 0.574650 Oct 10 19:00:57.284726 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1419/2581] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:56 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:57.639228 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-246a4ce6-e8af-4f36-b6b8-7fcef457999c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:57.652173 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-246a4ce6-e8af-4f36-b6b8-7fcef457999c tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1512 microversion: 2.1 time: 1.730935 Oct 10 19:00:57.654696 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1163/2582] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:55 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1512 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:57.660604 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c96735c3-55d6-4c4e-a751-369ac8a7132c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319225d310>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:57.777173 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-f37b8cd7-83ef-4b5e-9f35-d10a8ec2365d req-d837cc34-c965-49bc-88f7-3346dc66822b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e295c8-6ffa-4153-a9ae-1a2ce81a1b72", "name": "network-vif-deleted", "tag": "e11576b3-4ac1-481a-b46a-0785fc909905"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:57.791582 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c96735c3-55d6-4c4e-a751-369ac8a7132c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1455 microversion: 2.1 time: 0.135307 Oct 10 19:00:57.793505 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1164/2583] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:57 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:57.806039 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5e84f4f3-8407-476e-8d06-a5711b526259 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:57.806895 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5e84f4f3-8407-476e-8d06-a5711b526259 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:57.820288 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e84f4f3-8407-476e-8d06-a5711b526259 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:57.822360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e84f4f3-8407-476e-8d06-a5711b526259 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:57.823241 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e84f4f3-8407-476e-8d06-a5711b526259 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:57.826939 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f37b8cd7-83ef-4b5e-9f35-d10a8ec2365d req-d837cc34-c965-49bc-88f7-3346dc66822b service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:57.827446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f37b8cd7-83ef-4b5e-9f35-d10a8ec2365d req-d837cc34-c965-49bc-88f7-3346dc66822b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:57.827871 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f37b8cd7-83ef-4b5e-9f35-d10a8ec2365d req-d837cc34-c965-49bc-88f7-3346dc66822b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:57.828659 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e84f4f3-8407-476e-8d06-a5711b526259 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:57.829365 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e84f4f3-8407-476e-8d06-a5711b526259 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:57.830016 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5e84f4f3-8407-476e-8d06-a5711b526259 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:57.868697 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-f37b8cd7-83ef-4b5e-9f35-d10a8ec2365d req-d837cc34-c965-49bc-88f7-3346dc66822b service nova] Creating event network-vif-deleted:e11576b3-4ac1-481a-b46a-0785fc909905 for instance 33e295c8-6ffa-4153-a9ae-1a2ce81a1b72 on n-h1-860863-1 Oct 10 19:00:57.884666 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-f37b8cd7-83ef-4b5e-9f35-d10a8ec2365d req-d837cc34-c965-49bc-88f7-3346dc66822b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.597794 Oct 10 19:00:57.888475 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1420/2584] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:00:57.906756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-61c33d12-181f-4be9-8ff5-59223be88294 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:57.907942 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-61c33d12-181f-4be9-8ff5-59223be88294 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:57.921687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61c33d12-181f-4be9-8ff5-59223be88294 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:57.922615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61c33d12-181f-4be9-8ff5-59223be88294 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:57.923358 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61c33d12-181f-4be9-8ff5-59223be88294 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:57.925312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61c33d12-181f-4be9-8ff5-59223be88294 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:57.928631 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61c33d12-181f-4be9-8ff5-59223be88294 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:57.929236 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61c33d12-181f-4be9-8ff5-59223be88294 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:57.937296 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5e84f4f3-8407-476e-8d06-a5711b526259 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:00:58.166391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-61c33d12-181f-4be9-8ff5-59223be88294 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:58.181145 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-61c33d12-181f-4be9-8ff5-59223be88294 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1204 microversion: 2.1 time: 0.281861 Oct 10 19:00:58.187200 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1421/2585] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:57 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1204 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:58.208524 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9dc83b40-d771-4281-aed0-209d1d97961f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:58.232395 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9dc83b40-d771-4281-aed0-209d1d97961f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:58.236888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.compute.servers [None req-9dc83b40-d771-4281-aed0-209d1d97961f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Removing options 'limit' from query {{(pid=127288) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 10 19:00:58.240379 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9dc83b40-d771-4281-aed0-209d1d97961f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:00:58.244773 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc83b40-d771-4281-aed0-209d1d97961f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:58.249959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc83b40-d771-4281-aed0-209d1d97961f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:58.250430 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc83b40-d771-4281-aed0-209d1d97961f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:58.254928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc83b40-d771-4281-aed0-209d1d97961f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:58.255475 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc83b40-d771-4281-aed0-209d1d97961f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:58.278842 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9dc83b40-d771-4281-aed0-209d1d97961f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:58.283659 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9dc83b40-d771-4281-aed0-209d1d97961f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.095066 Oct 10 19:00:58.287713 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1422/2586] 10.222.0.43 () {58 vars in 1140 bytes} [Mon Oct 10 19:00:58 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 19:00:58.301795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5c47dba2-28a5-4a33-91f7-e0fb7ea0d898 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:58.305313 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5c47dba2-28a5-4a33-91f7-e0fb7ea0d898 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:58.325452 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5c47dba2-28a5-4a33-91f7-e0fb7ea0d898 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:58.328195 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5c47dba2-28a5-4a33-91f7-e0fb7ea0d898 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:58.328715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5c47dba2-28a5-4a33-91f7-e0fb7ea0d898 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:58.332108 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5c47dba2-28a5-4a33-91f7-e0fb7ea0d898 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:58.338600 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5c47dba2-28a5-4a33-91f7-e0fb7ea0d898 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:58.339849 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5c47dba2-28a5-4a33-91f7-e0fb7ea0d898 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:58.403584 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5e84f4f3-8407-476e-8d06-a5711b526259 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 204 len: 0 microversion: 2.1 time: 0.607556 Oct 10 19:00:58.404751 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1165/2587] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:00:57 2022] DELETE /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:00:58.437653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6b043e39-67ec-4f47-81af-33b3ff53b0a3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:58.439802 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6b043e39-67ec-4f47-81af-33b3ff53b0a3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:58.455653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b043e39-67ec-4f47-81af-33b3ff53b0a3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:58.458722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b043e39-67ec-4f47-81af-33b3ff53b0a3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:58.459697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b043e39-67ec-4f47-81af-33b3ff53b0a3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:58.460902 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b043e39-67ec-4f47-81af-33b3ff53b0a3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:58.465440 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b043e39-67ec-4f47-81af-33b3ff53b0a3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:58.466316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b043e39-67ec-4f47-81af-33b3ff53b0a3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:58.560182 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5c47dba2-28a5-4a33-91f7-e0fb7ea0d898 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:58.599882 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5c47dba2-28a5-4a33-91f7-e0fb7ea0d898 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1209 microversion: 2.1 time: 0.309969 Oct 10 19:00:58.603111 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1423/2588] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:58 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1209 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:58.694348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1081264471", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "472b8abb-e92b-4e24-8d15-9ea81e05fe68"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:00:58.777582 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] validate_networks() for [('472b8abb-e92b-4e24-8d15-9ea81e05fe68', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 19:00:58.895847 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6b043e39-67ec-4f47-81af-33b3ff53b0a3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:58.912810 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6b043e39-67ec-4f47-81af-33b3ff53b0a3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1512 microversion: 2.1 time: 0.505941 Oct 10 19:00:58.915086 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1166/2589] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:58 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1512 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:58.920836 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6add290e-f5d8-4a24-925b-e545a5159ea8 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319225d820>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:58.985921 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6add290e-f5d8-4a24-925b-e545a5159ea8 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1455 microversion: 2.1 time: 0.069527 Oct 10 19:00:58.994814 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1167/2590] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:00:58 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:58.999841 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1942fceb-aaf9-409e-8af6-c540b3f56fc6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:59.000776 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1942fceb-aaf9-409e-8af6-c540b3f56fc6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: c22fa54d-372c-4887-8875-a3c56b3850b1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:59.009135 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1942fceb-aaf9-409e-8af6-c540b3f56fc6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:59.009936 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1942fceb-aaf9-409e-8af6-c540b3f56fc6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:59.010625 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1942fceb-aaf9-409e-8af6-c540b3f56fc6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:59.011540 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1942fceb-aaf9-409e-8af6-c540b3f56fc6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:59.012193 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1942fceb-aaf9-409e-8af6-c540b3f56fc6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:59.013761 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1942fceb-aaf9-409e-8af6-c540b3f56fc6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:59.611682 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1942fceb-aaf9-409e-8af6-c540b3f56fc6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:59.626392 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1942fceb-aaf9-409e-8af6-c540b3f56fc6 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1" status: 200 len: 1511 microversion: 2.1 time: 0.630131 Oct 10 19:00:59.627669 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1168/2591] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:58 2022] GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1 => generated 1511 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:59.642758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-45451ffc-7dea-4b0e-81c7-7675852b6778 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:00:59.648318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-45451ffc-7dea-4b0e-81c7-7675852b6778 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:00:59.662163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45451ffc-7dea-4b0e-81c7-7675852b6778 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:59.665936 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45451ffc-7dea-4b0e-81c7-7675852b6778 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:59.666546 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45451ffc-7dea-4b0e-81c7-7675852b6778 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:59.668425 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45451ffc-7dea-4b0e-81c7-7675852b6778 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:59.672031 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45451ffc-7dea-4b0e-81c7-7675852b6778 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:59.673483 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45451ffc-7dea-4b0e-81c7-7675852b6778 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:59.832159 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 19:00:59.833774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 19:00:59.834561 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 19:00:59.835122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 19:00:59.835867 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 19:00:59.859889 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:59.863288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:59.863288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:59.863288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:00:59.864639 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:00:59.865278 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:00:59.910208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Getting quotas for project e2cfbbf586f5441e80930980df18d471. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 19:00:59.921011 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Getting quotas for user b83cb923e3064ac7aeb1bd6883415e9f and project e2cfbbf586f5441e80930980df18d471. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 19:00:59.964407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-45451ffc-7dea-4b0e-81c7-7675852b6778 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:00:59.976931 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 19:00:59.980327 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-45451ffc-7dea-4b0e-81c7-7675852b6778 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1260 microversion: 2.1 time: 0.350084 Oct 10 19:00:59.981118 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1169/2592] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:59 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1260 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:00:59.986351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 19:00:59.990315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-31cb0564-6572-407e-a251-3166b3d621d2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:00.001689 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-31cb0564-6572-407e-a251-3166b3d621d2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:00.028272 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31cb0564-6572-407e-a251-3166b3d621d2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:00.030398 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31cb0564-6572-407e-a251-3166b3d621d2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:00.031429 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31cb0564-6572-407e-a251-3166b3d621d2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:00.033474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31cb0564-6572-407e-a251-3166b3d621d2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:00.034866 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31cb0564-6572-407e-a251-3166b3d621d2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:00.037035 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31cb0564-6572-407e-a251-3166b3d621d2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:00.167563 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-65524d47-324e-4499-9799-19262c9aa0a3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.476223 Oct 10 19:01:00.177665 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1424/2593] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 19:00:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 19:01:00.192965 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-adebda09-cf8f-4baf-9234-da7a45891833 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:00.194621 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-adebda09-cf8f-4baf-9234-da7a45891833 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:00.215543 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-adebda09-cf8f-4baf-9234-da7a45891833 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:00.228107 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-adebda09-cf8f-4baf-9234-da7a45891833 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:00.228602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-adebda09-cf8f-4baf-9234-da7a45891833 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:00.236174 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-adebda09-cf8f-4baf-9234-da7a45891833 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:00.236780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-adebda09-cf8f-4baf-9234-da7a45891833 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:00.237240 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-adebda09-cf8f-4baf-9234-da7a45891833 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:00.364856 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-31cb0564-6572-407e-a251-3166b3d621d2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:00.377739 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-31cb0564-6572-407e-a251-3166b3d621d2 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1265 microversion: 2.1 time: 0.394099 Oct 10 19:01:00.380275 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1170/2594] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:00:59 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1265 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:00.388737 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-80a94219-7636-4e52-9c5b-494c2fed414c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319225d430>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:00.496435 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-80a94219-7636-4e52-9c5b-494c2fed414c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1455 microversion: 2.1 time: 0.114872 Oct 10 19:01:00.497501 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1171/2595] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:00 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:00.505162 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8e70d087-a19a-41f1-a0a8-7dfd835e3f3d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:00.511034 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8e70d087-a19a-41f1-a0a8-7dfd835e3f3d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:00.682577 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8e70d087-a19a-41f1-a0a8-7dfd835e3f3d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:00.692678 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8e70d087-a19a-41f1-a0a8-7dfd835e3f3d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1218 microversion: 2.1 time: 0.193412 Oct 10 19:01:00.696990 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1172/2596] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:00 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1218 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:01.006872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-99678d11-a970-4066-ad04-a06a3009fc0d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:01.008791 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-99678d11-a970-4066-ad04-a06a3009fc0d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:01.021021 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-99678d11-a970-4066-ad04-a06a3009fc0d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:01.024185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-99678d11-a970-4066-ad04-a06a3009fc0d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:01.024932 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-99678d11-a970-4066-ad04-a06a3009fc0d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:01.026536 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-99678d11-a970-4066-ad04-a06a3009fc0d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:01.028825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-99678d11-a970-4066-ad04-a06a3009fc0d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:01.029813 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-99678d11-a970-4066-ad04-a06a3009fc0d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:01.221460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-99678d11-a970-4066-ad04-a06a3009fc0d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:01.234946 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-99678d11-a970-4066-ad04-a06a3009fc0d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1266 microversion: 2.1 time: 0.232416 Oct 10 19:01:01.236299 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1173/2597] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:01 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:01.254015 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-adebda09-cf8f-4baf-9234-da7a45891833 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:01.263664 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-adebda09-cf8f-4baf-9234-da7a45891833 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1511 microversion: 2.1 time: 1.083108 Oct 10 19:01:01.265268 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1425/2598] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:00 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1511 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:01.293211 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-eb0316d0-c888-494d-882b-ae79b952f282 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:01.302168 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-eb0316d0-c888-494d-882b-ae79b952f282 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:01.305479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-eb0316d0-c888-494d-882b-ae79b952f282 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:01:01.462179 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-12fb723b-88a6-4e25-882d-3e2b6a7b3e5e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:01.465058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-12fb723b-88a6-4e25-882d-3e2b6a7b3e5e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:01.478932 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12fb723b-88a6-4e25-882d-3e2b6a7b3e5e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:01.479303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12fb723b-88a6-4e25-882d-3e2b6a7b3e5e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:01.479746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12fb723b-88a6-4e25-882d-3e2b6a7b3e5e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:01.480463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12fb723b-88a6-4e25-882d-3e2b6a7b3e5e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:01.480955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12fb723b-88a6-4e25-882d-3e2b6a7b3e5e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:01.483476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-12fb723b-88a6-4e25-882d-3e2b6a7b3e5e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:01.657132 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-12fb723b-88a6-4e25-882d-3e2b6a7b3e5e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:01.671525 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-12fb723b-88a6-4e25-882d-3e2b6a7b3e5e tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1283 microversion: 2.1 time: 0.246400 Oct 10 19:01:01.672963 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1426/2599] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:01 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1283 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:01.681793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-abce427f-24d1-4c36-8c16-617da2c198f9 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319225e280>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:01.742583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb0316d0-c888-494d-882b-ae79b952f282 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:01.742583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb0316d0-c888-494d-882b-ae79b952f282 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:01.742583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb0316d0-c888-494d-882b-ae79b952f282 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:01.742583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb0316d0-c888-494d-882b-ae79b952f282 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:01.742583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb0316d0-c888-494d-882b-ae79b952f282 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:01.742583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-eb0316d0-c888-494d-882b-ae79b952f282 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:01.759128 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-abce427f-24d1-4c36-8c16-617da2c198f9 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1455 microversion: 2.1 time: 0.084450 Oct 10 19:01:01.759972 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1427/2600] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:01 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:01.774940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c6785fe3-b7c4-40c1-80a4-c20c88a65722 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:01.778432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c6785fe3-b7c4-40c1-80a4-c20c88a65722 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:01.801318 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6785fe3-b7c4-40c1-80a4-c20c88a65722 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:01.804445 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6785fe3-b7c4-40c1-80a4-c20c88a65722 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:01.806306 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6785fe3-b7c4-40c1-80a4-c20c88a65722 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:01.808343 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6785fe3-b7c4-40c1-80a4-c20c88a65722 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:01.809117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6785fe3-b7c4-40c1-80a4-c20c88a65722 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:01.810514 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6785fe3-b7c4-40c1-80a4-c20c88a65722 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:01.933058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.multi_cell_list [None req-eb0316d0-c888-494d-882b-ae79b952f282 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127289) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:01:02.069602 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-eb0316d0-c888-494d-882b-ae79b952f282 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.782566 Oct 10 19:01:02.071348 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1174/2601] 10.222.0.43 () {58 vars in 1154 bytes} [Mon Oct 10 19:01:01 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:02.084719 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c6785fe3-b7c4-40c1-80a4-c20c88a65722 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:02.093704 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c6785fe3-b7c4-40c1-80a4-c20c88a65722 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1222 microversion: 2.1 time: 0.332410 Oct 10 19:01:02.096877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e629fe7e-fd43-4ff0-9220-aef231842dac tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:02.097707 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1428/2602] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:01 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1222 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:02.098754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e629fe7e-fd43-4ff0-9220-aef231842dac tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:02.114241 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e629fe7e-fd43-4ff0-9220-aef231842dac tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:02.117225 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e629fe7e-fd43-4ff0-9220-aef231842dac tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:02.118623 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e629fe7e-fd43-4ff0-9220-aef231842dac tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:02.119697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e629fe7e-fd43-4ff0-9220-aef231842dac tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:02.122063 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e629fe7e-fd43-4ff0-9220-aef231842dac tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:02.122673 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e629fe7e-fd43-4ff0-9220-aef231842dac tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:02.159171 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:02.261021 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-246db720-3901-4d6d-b0eb-e1c4155a4690 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:02.262501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-246db720-3901-4d6d-b0eb-e1c4155a4690 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:02.270899 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-246db720-3901-4d6d-b0eb-e1c4155a4690 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:02.271872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-246db720-3901-4d6d-b0eb-e1c4155a4690 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:02.272360 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-246db720-3901-4d6d-b0eb-e1c4155a4690 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:02.273171 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-246db720-3901-4d6d-b0eb-e1c4155a4690 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:02.276085 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-246db720-3901-4d6d-b0eb-e1c4155a4690 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:02.276085 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-246db720-3901-4d6d-b0eb-e1c4155a4690 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:02.419054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-246db720-3901-4d6d-b0eb-e1c4155a4690 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:02.424775 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-246db720-3901-4d6d-b0eb-e1c4155a4690 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1266 microversion: 2.1 time: 0.167511 Oct 10 19:01:02.444971 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1429/2603] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:02 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:02.697851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-628fd937-6152-4b79-91c5-d65a9b972704 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:02.698746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-628fd937-6152-4b79-91c5-d65a9b972704 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:02.719348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-628fd937-6152-4b79-91c5-d65a9b972704 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:02.728181 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-628fd937-6152-4b79-91c5-d65a9b972704 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:02.729037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-628fd937-6152-4b79-91c5-d65a9b972704 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:02.730656 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-628fd937-6152-4b79-91c5-d65a9b972704 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:02.731357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-628fd937-6152-4b79-91c5-d65a9b972704 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:02.732004 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-628fd937-6152-4b79-91c5-d65a9b972704 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:02.949443 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e629fe7e-fd43-4ff0-9220-aef231842dac tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:02.959562 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e629fe7e-fd43-4ff0-9220-aef231842dac tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1512 microversion: 2.1 time: 0.878294 Oct 10 19:01:02.960561 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1175/2604] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:02 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1512 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:02.965596 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-78126eaa-dd94-47c5-9937-0a53c52c9d16 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921c68b0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:02.978016 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-628fd937-6152-4b79-91c5-d65a9b972704 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:03.007408 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-628fd937-6152-4b79-91c5-d65a9b972704 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1271 microversion: 2.1 time: 0.315881 Oct 10 19:01:03.010183 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1430/2605] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:02 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1271 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:03.030931 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-7cb50102-ded8-4475-a0b2-ece1fa6297f5 req-50e43074-89a2-4673-b6ce-72e5ed7a6796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625d4b03-2441-4576-a0e2-6c266b24b1e9", "name": "network-vif-deleted", "tag": "f2875240-f490-44c6-8bd6-6fe609be5a6c"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:03.057283 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-7cb50102-ded8-4475-a0b2-ece1fa6297f5 req-50e43074-89a2-4673-b6ce-72e5ed7a6796 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:03.062742 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-7cb50102-ded8-4475-a0b2-ece1fa6297f5 req-50e43074-89a2-4673-b6ce-72e5ed7a6796 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:03.062742 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-7cb50102-ded8-4475-a0b2-ece1fa6297f5 req-50e43074-89a2-4673-b6ce-72e5ed7a6796 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:03.062742 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:03.063027 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-78126eaa-dd94-47c5-9937-0a53c52c9d16 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1464 microversion: 2.1 time: 0.100555 Oct 10 19:01:03.063741 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1176/2606] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:02 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1464 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:03.076214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0d52c8db-db4e-42fc-8c50-3ad1e9b3e5f3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:03.078851 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0d52c8db-db4e-42fc-8c50-3ad1e9b3e5f3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: c22fa54d-372c-4887-8875-a3c56b3850b1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:03.088455 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-7cb50102-ded8-4475-a0b2-ece1fa6297f5 req-50e43074-89a2-4673-b6ce-72e5ed7a6796 service nova] Creating event network-vif-deleted:f2875240-f490-44c6-8bd6-6fe609be5a6c for instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 on n-h2-860863-1 Oct 10 19:01:03.094154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d52c8db-db4e-42fc-8c50-3ad1e9b3e5f3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:03.094772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d52c8db-db4e-42fc-8c50-3ad1e9b3e5f3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:03.095215 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d52c8db-db4e-42fc-8c50-3ad1e9b3e5f3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:03.095927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d52c8db-db4e-42fc-8c50-3ad1e9b3e5f3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:03.098263 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-7cb50102-ded8-4475-a0b2-ece1fa6297f5 req-50e43074-89a2-4673-b6ce-72e5ed7a6796 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086605 Oct 10 19:01:03.099526 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1431/2607] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:03.105889 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f2ecdc21-5dab-492a-9079-0c497d54fa39 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d826ca0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:03.107330 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d52c8db-db4e-42fc-8c50-3ad1e9b3e5f3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:03.107786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0d52c8db-db4e-42fc-8c50-3ad1e9b3e5f3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:03.172941 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f2ecdc21-5dab-492a-9079-0c497d54fa39 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 200 len: 1464 microversion: 2.1 time: 0.071226 Oct 10 19:01:03.173927 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1432/2608] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:03 2022] GET /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 1464 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:03.189970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cfe03c46-c2e4-4258-89de-7191ab49d2ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:03.190802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cfe03c46-c2e4-4258-89de-7191ab49d2ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:03.210504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cfe03c46-c2e4-4258-89de-7191ab49d2ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:03.211015 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cfe03c46-c2e4-4258-89de-7191ab49d2ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:03.214366 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cfe03c46-c2e4-4258-89de-7191ab49d2ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:03.215371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cfe03c46-c2e4-4258-89de-7191ab49d2ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:03.216006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cfe03c46-c2e4-4258-89de-7191ab49d2ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:03.218018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cfe03c46-c2e4-4258-89de-7191ab49d2ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:03.395482 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cfe03c46-c2e4-4258-89de-7191ab49d2ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:03.404096 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cfe03c46-c2e4-4258-89de-7191ab49d2ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1270 microversion: 2.1 time: 0.228880 Oct 10 19:01:03.404765 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1433/2609] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:03 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1270 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:03.415305 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-72cff623-6b6d-47c7-99c7-a674580c26ef tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:03.415920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-72cff623-6b6d-47c7-99c7-a674580c26ef tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:03.439226 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-72cff623-6b6d-47c7-99c7-a674580c26ef tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:03.439724 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-72cff623-6b6d-47c7-99c7-a674580c26ef tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:03.440157 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-72cff623-6b6d-47c7-99c7-a674580c26ef tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:03.440902 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-72cff623-6b6d-47c7-99c7-a674580c26ef tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:03.446404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-72cff623-6b6d-47c7-99c7-a674580c26ef tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:03.446988 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-72cff623-6b6d-47c7-99c7-a674580c26ef tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:03.733773 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0d52c8db-db4e-42fc-8c50-3ad1e9b3e5f3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:03.745614 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0d52c8db-db4e-42fc-8c50-3ad1e9b3e5f3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1" status: 200 len: 1511 microversion: 2.1 time: 0.680105 Oct 10 19:01:03.747220 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1177/2610] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:03 2022] GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1 => generated 1511 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:03.754078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-215d7c5e-b6c0-45fb-a5e5-96276c86f93b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:03.759969 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-215d7c5e-b6c0-45fb-a5e5-96276c86f93b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:03.788830 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-215d7c5e-b6c0-45fb-a5e5-96276c86f93b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:03.789590 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-215d7c5e-b6c0-45fb-a5e5-96276c86f93b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:03.790231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-215d7c5e-b6c0-45fb-a5e5-96276c86f93b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:03.791321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-215d7c5e-b6c0-45fb-a5e5-96276c86f93b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:03.796714 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-215d7c5e-b6c0-45fb-a5e5-96276c86f93b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:03.797699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-215d7c5e-b6c0-45fb-a5e5-96276c86f93b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:04.006805 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-72cff623-6b6d-47c7-99c7-a674580c26ef tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:04.016560 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-72cff623-6b6d-47c7-99c7-a674580c26ef tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f" status: 200 len: 1468 microversion: 2.1 time: 0.610745 Oct 10 19:01:04.018042 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1434/2611] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:03 2022] GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f => generated 1468 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:04.023988 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-350e2d64-0835-40c2-917f-f2a6c668b9f2 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:04.025307 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-350e2d64-0835-40c2-917f-f2a6c668b9f2 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:04.044159 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-350e2d64-0835-40c2-917f-f2a6c668b9f2 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:04.049026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-350e2d64-0835-40c2-917f-f2a6c668b9f2 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:04.049026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-350e2d64-0835-40c2-917f-f2a6c668b9f2 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:04.049026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-350e2d64-0835-40c2-917f-f2a6c668b9f2 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:04.049026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-350e2d64-0835-40c2-917f-f2a6c668b9f2 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:04.049026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-350e2d64-0835-40c2-917f-f2a6c668b9f2 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:04.249502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-215d7c5e-b6c0-45fb-a5e5-96276c86f93b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:04.261293 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-215d7c5e-b6c0-45fb-a5e5-96276c86f93b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1308 microversion: 2.1 time: 0.512823 Oct 10 19:01:04.262577 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1178/2612] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:03 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1308 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:04.267563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-40d63174-b071-4344-8b9c-f1d05ed8c813 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:04.268250 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-40d63174-b071-4344-8b9c-f1d05ed8c813 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:04.275318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40d63174-b071-4344-8b9c-f1d05ed8c813 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:04.276160 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40d63174-b071-4344-8b9c-f1d05ed8c813 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:04.276988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40d63174-b071-4344-8b9c-f1d05ed8c813 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:04.281567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40d63174-b071-4344-8b9c-f1d05ed8c813 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:04.281567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40d63174-b071-4344-8b9c-f1d05ed8c813 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:04.281567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40d63174-b071-4344-8b9c-f1d05ed8c813 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:04.363453 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-40d63174-b071-4344-8b9c-f1d05ed8c813 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:04.375253 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-40d63174-b071-4344-8b9c-f1d05ed8c813 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1271 microversion: 2.1 time: 0.111456 Oct 10 19:01:04.376486 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1179/2613] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:04 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:04.384353 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cdb152f4-c6da-44c8-90b4-f7891f615022 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31922805e0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:04.418738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-350e2d64-0835-40c2-917f-f2a6c668b9f2 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:04.430817 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-350e2d64-0835-40c2-917f-f2a6c668b9f2 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1511 microversion: 2.1 time: 0.408674 Oct 10 19:01:04.431563 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1435/2614] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:04 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:04.439605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e64385fe-7f15-46ad-b38e-8231418fbcb3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:04.440248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e64385fe-7f15-46ad-b38e-8231418fbcb3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:04.459874 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e64385fe-7f15-46ad-b38e-8231418fbcb3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:04.463237 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e64385fe-7f15-46ad-b38e-8231418fbcb3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:04.463370 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e64385fe-7f15-46ad-b38e-8231418fbcb3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:04.465278 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e64385fe-7f15-46ad-b38e-8231418fbcb3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:04.465278 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e64385fe-7f15-46ad-b38e-8231418fbcb3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:04.465995 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e64385fe-7f15-46ad-b38e-8231418fbcb3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:04.579585 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cdb152f4-c6da-44c8-90b4-f7891f615022 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images?changes-since=2022-10-10T18%3A58%3A40Z" status: 200 len: 1904 microversion: 2.1 time: 0.200407 Oct 10 19:01:04.580044 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1180/2615] 10.222.0.43 () {58 vars in 1199 bytes} [Mon Oct 10 19:01:04 2022] GET /compute/v2.1/images?changes-since=2022-10-10T18%3A58%3A40Z => generated 1904 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:04.590329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:04.598171 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:04.599811 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:01:04.607609 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:04.608239 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:04.608772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:04.609573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:04.610179 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:04.611303 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:04.654897 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.multi_cell_list [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127289) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:01:04.682407 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e64385fe-7f15-46ad-b38e-8231418fbcb3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:04.697811 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e64385fe-7f15-46ad-b38e-8231418fbcb3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1276 microversion: 2.1 time: 0.264969 Oct 10 19:01:04.700311 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1436/2616] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:04 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1276 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:04.705231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9a9b7c3d-e878-4fd1-980e-3fbf93aa1d53 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d851430>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:04.828572 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9a9b7c3d-e878-4fd1-980e-3fbf93aa1d53 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1907640394" status: 200 len: 485 microversion: 2.1 time: 0.124885 Oct 10 19:01:04.829272 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1437/2617] 10.222.0.43 () {58 vars in 1231 bytes} [Mon Oct 10 19:01:04 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1907640394 => generated 485 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:04.830047 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:04.845176 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-35546449-d52b-49f1-bea2-0cc61516a121 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921ccb80>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:04.853984 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:04.857793 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:04.860508 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:05.028987 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-35546449-d52b-49f1-bea2-0cc61516a121 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images?server=bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f" status: 200 len: 958 microversion: 2.1 time: 0.188905 Oct 10 19:01:05.041357 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1438/2618] 10.222.0.43 () {58 vars in 1209 bytes} [Mon Oct 10 19:01:04 2022] GET /compute/v2.1/images?server=bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f => generated 958 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:05.056156 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-39acad24-e327-4d6e-8c32-c24078ae1d63 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31922b2550>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:05.120315 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-39acad24-e327-4d6e-8c32-c24078ae1d63 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 485 microversion: 2.1 time: 0.077312 Oct 10 19:01:05.120921 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1439/2619] 10.222.0.43 () {58 vars in 1317 bytes} [Mon Oct 10 19:01:05 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 485 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:05.142323 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8b2eb317-1add-476a-bd16-4ad4d9ca297c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921cc1f0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:05.209908 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8b2eb317-1add-476a-bd16-4ad4d9ca297c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 485 microversion: 2.1 time: 0.075580 Oct 10 19:01:05.211564 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1440/2620] 10.222.0.43 () {58 vars in 1303 bytes} [Mon Oct 10 19:01:05 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 485 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:05.227357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b87f1a14-f6d9-48a9-b424-828745222e8f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318dda4c10>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:05.376056 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-50083eac-d0ff-455b-b240-407881358a75 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.794909 Oct 10 19:01:05.377505 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1181/2621] 10.222.0.43 () {58 vars in 1146 bytes} [Mon Oct 10 19:01:04 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:05.382396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7c594857-ce5b-458e-9277-2b7251e411f3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:05.383195 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7c594857-ce5b-458e-9277-2b7251e411f3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:05.395845 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7c594857-ce5b-458e-9277-2b7251e411f3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:05.397092 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7c594857-ce5b-458e-9277-2b7251e411f3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:05.401287 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7c594857-ce5b-458e-9277-2b7251e411f3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:05.402459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7c594857-ce5b-458e-9277-2b7251e411f3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:05.403074 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7c594857-ce5b-458e-9277-2b7251e411f3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:05.403680 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7c594857-ce5b-458e-9277-2b7251e411f3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:05.508169 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b87f1a14-f6d9-48a9-b424-828745222e8f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3283 microversion: 2.1 time: 0.286335 Oct 10 19:01:05.508809 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1441/2622] 10.222.0.43 () {58 vars in 1149 bytes} [Mon Oct 10 19:01:05 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3283 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:05.528686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ca4b2cd4-dc0c-44a6-b45d-1b54ac9a3e97 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:05.541265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ca4b2cd4-dc0c-44a6-b45d-1b54ac9a3e97 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:05.547796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca4b2cd4-dc0c-44a6-b45d-1b54ac9a3e97 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:05.548321 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca4b2cd4-dc0c-44a6-b45d-1b54ac9a3e97 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:05.555468 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca4b2cd4-dc0c-44a6-b45d-1b54ac9a3e97 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:05.555468 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca4b2cd4-dc0c-44a6-b45d-1b54ac9a3e97 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:05.555468 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca4b2cd4-dc0c-44a6-b45d-1b54ac9a3e97 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:05.555468 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca4b2cd4-dc0c-44a6-b45d-1b54ac9a3e97 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:05.803433 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7c594857-ce5b-458e-9277-2b7251e411f3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:05.825521 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7c594857-ce5b-458e-9277-2b7251e411f3 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1308 microversion: 2.1 time: 0.442173 Oct 10 19:01:05.825521 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1182/2623] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:05 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:05.835755 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-992bb7dc-09c0-4dda-bb32-1d5ba87af12f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:05.840982 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-992bb7dc-09c0-4dda-bb32-1d5ba87af12f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:05.841663 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-992bb7dc-09c0-4dda-bb32-1d5ba87af12f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:01:05.938722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ca4b2cd4-dc0c-44a6-b45d-1b54ac9a3e97 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:05.949224 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ca4b2cd4-dc0c-44a6-b45d-1b54ac9a3e97 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1313 microversion: 2.1 time: 0.426206 Oct 10 19:01:05.957878 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1442/2624] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:05 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:05.977485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bbd9f7b4-7abc-4329-b7c6-758add760c25 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319225e820>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:05.997793 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-992bb7dc-09c0-4dda-bb32-1d5ba87af12f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:05.998488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-992bb7dc-09c0-4dda-bb32-1d5ba87af12f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:05.999089 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-992bb7dc-09c0-4dda-bb32-1d5ba87af12f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:06.000115 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-992bb7dc-09c0-4dda-bb32-1d5ba87af12f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:06.003960 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-992bb7dc-09c0-4dda-bb32-1d5ba87af12f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:06.003960 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-992bb7dc-09c0-4dda-bb32-1d5ba87af12f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:06.046354 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.multi_cell_list [None req-992bb7dc-09c0-4dda-bb32-1d5ba87af12f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127289) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:01:06.096209 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-992bb7dc-09c0-4dda-bb32-1d5ba87af12f tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.273387 Oct 10 19:01:06.106530 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1183/2625] 10.222.0.43 () {58 vars in 1150 bytes} [Mon Oct 10 19:01:05 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:06.111900 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-d250f921-ff49-412e-984b-d28a7a760155 req-01b1397d-5736-47f9-9c74-830930e769e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "154d20fa-a1d2-4bfd-99ab-024ddf8ae67b", "tag": "d76218a1-c511-4bbd-bdc9-d8d4fda923c7"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:06.112455 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bbd9f7b4-7abc-4329-b7c6-758add760c25 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.160096 Oct 10 19:01:06.114571 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1443/2626] 10.222.0.43 () {58 vars in 1149 bytes} [Mon Oct 10 19:01:05 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:06.135420 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d250f921-ff49-412e-984b-d28a7a760155 req-01b1397d-5736-47f9-9c74-830930e769e6 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:06.136019 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d250f921-ff49-412e-984b-d28a7a760155 req-01b1397d-5736-47f9-9c74-830930e769e6 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:06.136459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d250f921-ff49-412e-984b-d28a7a760155 req-01b1397d-5736-47f9-9c74-830930e769e6 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:06.152080 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-d250f921-ff49-412e-984b-d28a7a760155 req-01b1397d-5736-47f9-9c74-830930e769e6 service nova] Creating event network-changed:d76218a1-c511-4bbd-bdc9-d8d4fda923c7 for instance 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b on n-h1-860863-1 Oct 10 19:01:06.159204 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-d250f921-ff49-412e-984b-d28a7a760155 req-01b1397d-5736-47f9-9c74-830930e769e6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049584 Oct 10 19:01:06.159204 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1184/2627] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:06.166877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-765720fe-c86e-4274-8fd5-5e9d138c4b4b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:06.167626 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-765720fe-c86e-4274-8fd5-5e9d138c4b4b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:06.182704 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765720fe-c86e-4274-8fd5-5e9d138c4b4b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:06.182704 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765720fe-c86e-4274-8fd5-5e9d138c4b4b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:06.182704 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765720fe-c86e-4274-8fd5-5e9d138c4b4b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:06.182704 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765720fe-c86e-4274-8fd5-5e9d138c4b4b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:06.182704 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765720fe-c86e-4274-8fd5-5e9d138c4b4b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:06.182704 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-765720fe-c86e-4274-8fd5-5e9d138c4b4b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:06.220677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-94947576", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "8fe474f1-4c55-4478-ae57-c7d795da4502"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:06.320776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] validate_networks() for [('8fe474f1-4c55-4478-ae57-c7d795da4502', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 19:01:06.539891 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-765720fe-c86e-4274-8fd5-5e9d138c4b4b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:06.555108 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-765720fe-c86e-4274-8fd5-5e9d138c4b4b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1318 microversion: 2.1 time: 0.394088 Oct 10 19:01:06.555709 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1185/2628] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:06 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:06.569203 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-1dbf750f-e8b8-4dc4-b2f1-bf4f09dd3f78 req-ef4648b0-ee8c-4654-b463-6774c41eeb49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f", "name": "network-vif-unplugged", "status": "completed", "tag": "5bffc937-d058-4e1d-89e3-1fcc517f98e7"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:06.591317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1dbf750f-e8b8-4dc4-b2f1-bf4f09dd3f78 req-ef4648b0-ee8c-4654-b463-6774c41eeb49 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:06.592207 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1dbf750f-e8b8-4dc4-b2f1-bf4f09dd3f78 req-ef4648b0-ee8c-4654-b463-6774c41eeb49 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:06.594901 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-1dbf750f-e8b8-4dc4-b2f1-bf4f09dd3f78 req-ef4648b0-ee8c-4654-b463-6774c41eeb49 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:06.637722 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-1dbf750f-e8b8-4dc4-b2f1-bf4f09dd3f78 req-ef4648b0-ee8c-4654-b463-6774c41eeb49 service nova] Creating event network-vif-unplugged:5bffc937-d058-4e1d-89e3-1fcc517f98e7 for instance bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f on n-h1-860863-1 Oct 10 19:01:06.652089 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-1dbf750f-e8b8-4dc4-b2f1-bf4f09dd3f78 req-ef4648b0-ee8c-4654-b463-6774c41eeb49 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095123 Oct 10 19:01:06.655513 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1186/2629] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:06.670352 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fb3ddb95-7875-4ff8-9c98-9241e4a432fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:06.689113 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fb3ddb95-7875-4ff8-9c98-9241e4a432fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:06.690609 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fb3ddb95-7875-4ff8-9c98-9241e4a432fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:01:06.706347 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb3ddb95-7875-4ff8-9c98-9241e4a432fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:06.706888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb3ddb95-7875-4ff8-9c98-9241e4a432fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:06.707621 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb3ddb95-7875-4ff8-9c98-9241e4a432fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:06.711825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb3ddb95-7875-4ff8-9c98-9241e4a432fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:06.711825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb3ddb95-7875-4ff8-9c98-9241e4a432fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:06.711825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb3ddb95-7875-4ff8-9c98-9241e4a432fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:06.825857 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.multi_cell_list [None req-fb3ddb95-7875-4ff8-9c98-9241e4a432fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127289) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:01:06.901280 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fb3ddb95-7875-4ff8-9c98-9241e4a432fd tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.243806 Oct 10 19:01:06.904821 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1187/2630] 10.222.0.43 () {58 vars in 1212 bytes} [Mon Oct 10 19:01:06 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:06.923888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-eb5ab656-61e8-439a-8a89-172d77aea0bd tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921c68b0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:07.062989 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-eb5ab656-61e8-439a-8a89-172d77aea0bd tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.159637 Oct 10 19:01:07.076459 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1188/2631] 10.222.0.43 () {58 vars in 1137 bytes} [Mon Oct 10 19:01:06 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:07.076459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ab23760d-a14f-4280-9e41-1c335c261209 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:07.076459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ab23760d-a14f-4280-9e41-1c335c261209 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:07.083303 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab23760d-a14f-4280-9e41-1c335c261209 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:07.083795 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab23760d-a14f-4280-9e41-1c335c261209 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:07.084230 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab23760d-a14f-4280-9e41-1c335c261209 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:07.085053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab23760d-a14f-4280-9e41-1c335c261209 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:07.085508 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab23760d-a14f-4280-9e41-1c335c261209 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:07.086536 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ab23760d-a14f-4280-9e41-1c335c261209 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:07.160031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 19:01:07.161106 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 19:01:07.161789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 19:01:07.162266 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 19:01:07.162987 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 19:01:07.184100 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:07.184100 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:07.185799 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:07.186726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:07.189093 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:07.189609 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:07.235981 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Getting quotas for project 9d12307b731846928ce877a98bce8c10. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 19:01:07.255750 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Getting quotas for user 3ee224c527494aec81a29103a3c3332e and project 9d12307b731846928ce877a98bce8c10. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 19:01:07.261676 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:07.276334 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 19:01:07.280189 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 19:01:07.347800 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ab23760d-a14f-4280-9e41-1c335c261209 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:07.357151 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ab23760d-a14f-4280-9e41-1c335c261209 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1308 microversion: 2.1 time: 0.287160 Oct 10 19:01:07.380526 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1189/2632] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:07 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1308 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:07.390545 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fb535ff6-41d2-4612-aa22-27d7bb5b9041 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:07.405938 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fb535ff6-41d2-4612-aa22-27d7bb5b9041 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:07.406802 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fb535ff6-41d2-4612-aa22-27d7bb5b9041 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127289) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:01:07.415149 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb535ff6-41d2-4612-aa22-27d7bb5b9041 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:07.416488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb535ff6-41d2-4612-aa22-27d7bb5b9041 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:07.417182 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb535ff6-41d2-4612-aa22-27d7bb5b9041 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:07.418966 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb535ff6-41d2-4612-aa22-27d7bb5b9041 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:07.419818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb535ff6-41d2-4612-aa22-27d7bb5b9041 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:07.420461 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb535ff6-41d2-4612-aa22-27d7bb5b9041 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:07.483435 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c7491f0e-c624-457a-af30-78ad572c2f07 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.367438 Oct 10 19:01:07.485173 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1444/2633] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 19:01:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 19:01:07.503025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f0d670ec-ea2c-4171-8934-591bc5f017ff tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:07.504860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f0d670ec-ea2c-4171-8934-591bc5f017ff tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:07.517022 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0d670ec-ea2c-4171-8934-591bc5f017ff tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:07.517768 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0d670ec-ea2c-4171-8934-591bc5f017ff tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:07.518956 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0d670ec-ea2c-4171-8934-591bc5f017ff tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:07.523000 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0d670ec-ea2c-4171-8934-591bc5f017ff tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:07.524396 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0d670ec-ea2c-4171-8934-591bc5f017ff tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:07.525113 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f0d670ec-ea2c-4171-8934-591bc5f017ff tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:07.594772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.multi_cell_list [None req-fb535ff6-41d2-4612-aa22-27d7bb5b9041 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127289) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:01:07.705655 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fb535ff6-41d2-4612-aa22-27d7bb5b9041 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.323642 Oct 10 19:01:07.707080 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1190/2634] 10.222.0.43 () {58 vars in 1196 bytes} [Mon Oct 10 19:01:07 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:07.714745 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-eb80a600-6a67-4c8a-8b63-0af0243dc99f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31921c6af0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:07.852639 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-eb80a600-6a67-4c8a-8b63-0af0243dc99f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/detail?changes-since=2022-10-10T18%3A58%3A32Z" status: 200 len: 6336 microversion: 2.1 time: 0.143439 Oct 10 19:01:07.853125 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1191/2635] 10.222.0.43 () {58 vars in 1220 bytes} [Mon Oct 10 19:01:07 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-10T18%3A58%3A32Z => generated 6336 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:07.875603 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a8b4485d-5221-43a2-9442-9d0aa59f643b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:07.876450 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a8b4485d-5221-43a2-9442-9d0aa59f643b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:07.999936 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a8b4485d-5221-43a2-9442-9d0aa59f643b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:08.014337 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a8b4485d-5221-43a2-9442-9d0aa59f643b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1209 microversion: 2.1 time: 0.144547 Oct 10 19:01:08.015409 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1192/2636] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:07 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1209 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:08.022447 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-46d5216c-fe0b-467a-ba54-1340624dfeab tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:08.023541 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-46d5216c-fe0b-467a-ba54-1340624dfeab tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:08.033397 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46d5216c-fe0b-467a-ba54-1340624dfeab tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:08.033968 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46d5216c-fe0b-467a-ba54-1340624dfeab tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:08.034415 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46d5216c-fe0b-467a-ba54-1340624dfeab tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:08.036570 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46d5216c-fe0b-467a-ba54-1340624dfeab tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:08.037231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46d5216c-fe0b-467a-ba54-1340624dfeab tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:08.042891 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-46d5216c-fe0b-467a-ba54-1340624dfeab tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:08.049057 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f0d670ec-ea2c-4171-8934-591bc5f017ff tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:08.061831 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f0d670ec-ea2c-4171-8934-591bc5f017ff tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1334 microversion: 2.1 time: 0.574206 Oct 10 19:01:08.071611 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1445/2637] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:07 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1334 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:08.079282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-55c0eebe-e0f2-4f8a-96af-42f128653877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:08.099156 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-55c0eebe-e0f2-4f8a-96af-42f128653877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:08.099857 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-55c0eebe-e0f2-4f8a-96af-42f128653877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'name': '1561889264', 'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:01:08.111623 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55c0eebe-e0f2-4f8a-96af-42f128653877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:08.112032 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55c0eebe-e0f2-4f8a-96af-42f128653877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:08.112630 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55c0eebe-e0f2-4f8a-96af-42f128653877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:08.113369 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55c0eebe-e0f2-4f8a-96af-42f128653877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:08.114589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55c0eebe-e0f2-4f8a-96af-42f128653877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:08.115021 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-55c0eebe-e0f2-4f8a-96af-42f128653877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:08.220832 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-55c0eebe-e0f2-4f8a-96af-42f128653877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:01:08.287176 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-55c0eebe-e0f2-4f8a-96af-42f128653877 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers?name=1561889264" status: 200 len: 346 microversion: 2.1 time: 0.220934 Oct 10 19:01:08.295003 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1446/2638] 10.222.0.43 () {58 vars in 1156 bytes} [Mon Oct 10 19:01:08 2022] GET /compute/v2.1/servers?name=1561889264 => generated 346 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:08.297545 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-46d5216c-fe0b-467a-ba54-1340624dfeab tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:08.305843 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e946f551-6115-465a-8e3e-4d4cd99b4466 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31922f9430>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:08.321623 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-46d5216c-fe0b-467a-ba54-1340624dfeab tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1318 microversion: 2.1 time: 0.289226 Oct 10 19:01:08.321623 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1193/2639] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:08 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:08.331164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-cd724ba3-38e5-45b0-9184-183adc96dedf req-6f5f238d-65bb-4092-b42c-88cd238ac04d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5cc13ed-22f0-4a0a-a65f-208bd80d70b2", "tag": "35cd11dc-afb2-4ad8-839a-5e9279495af4"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:08.373570 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-cd724ba3-38e5-45b0-9184-183adc96dedf req-6f5f238d-65bb-4092-b42c-88cd238ac04d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:08.374603 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-cd724ba3-38e5-45b0-9184-183adc96dedf req-6f5f238d-65bb-4092-b42c-88cd238ac04d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:08.375200 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-cd724ba3-38e5-45b0-9184-183adc96dedf req-6f5f238d-65bb-4092-b42c-88cd238ac04d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:08.405971 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e946f551-6115-465a-8e3e-4d4cd99b4466 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1907640394" status: 200 len: 665 microversion: 2.1 time: 0.114232 Oct 10 19:01:08.406818 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1447/2640] 10.222.0.43 () {58 vars in 1252 bytes} [Mon Oct 10 19:01:08 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1907640394 => generated 665 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:08.408400 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-cd724ba3-38e5-45b0-9184-183adc96dedf req-6f5f238d-65bb-4092-b42c-88cd238ac04d service nova] Creating event network-changed:35cd11dc-afb2-4ad8-839a-5e9279495af4 for instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 on n-h2-860863-1 Oct 10 19:01:08.414302 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-cd724ba3-38e5-45b0-9184-183adc96dedf req-6f5f238d-65bb-4092-b42c-88cd238ac04d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102873 Oct 10 19:01:08.414893 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1194/2641] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:08.418196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ba0d43ae-bcc8-45f2-9236-11f8b90aaff3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:08.420501 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8b7ccdf6-0368-4a1b-960d-2026dff7981c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:08.421446 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8b7ccdf6-0368-4a1b-960d-2026dff7981c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:08.427387 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ba0d43ae-bcc8-45f2-9236-11f8b90aaff3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:08.430033 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b7ccdf6-0368-4a1b-960d-2026dff7981c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:08.430929 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ba0d43ae-bcc8-45f2-9236-11f8b90aaff3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:01:08.431724 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b7ccdf6-0368-4a1b-960d-2026dff7981c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:08.432340 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b7ccdf6-0368-4a1b-960d-2026dff7981c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:08.433336 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b7ccdf6-0368-4a1b-960d-2026dff7981c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:08.434028 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b7ccdf6-0368-4a1b-960d-2026dff7981c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:08.434633 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8b7ccdf6-0368-4a1b-960d-2026dff7981c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:08.448263 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba0d43ae-bcc8-45f2-9236-11f8b90aaff3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:08.448845 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba0d43ae-bcc8-45f2-9236-11f8b90aaff3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:08.449342 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba0d43ae-bcc8-45f2-9236-11f8b90aaff3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:08.450132 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba0d43ae-bcc8-45f2-9236-11f8b90aaff3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:08.450835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba0d43ae-bcc8-45f2-9236-11f8b90aaff3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:08.451731 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba0d43ae-bcc8-45f2-9236-11f8b90aaff3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:08.597499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-ba0d43ae-bcc8-45f2-9236-11f8b90aaff3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:01:08.694862 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ba0d43ae-bcc8-45f2-9236-11f8b90aaff3 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.286297 Oct 10 19:01:08.695484 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1448/2642] 10.222.0.43 () {58 vars in 1154 bytes} [Mon Oct 10 19:01:08 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:08.702780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-750f06af-06eb-467a-bb9d-667f9d8867f2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d63c550>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:08.776831 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-750f06af-06eb-467a-bb9d-667f9d8867f2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1467 microversion: 2.1 time: 0.079914 Oct 10 19:01:08.778128 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1449/2643] 10.222.0.43 () {58 vars in 1338 bytes} [Mon Oct 10 19:01:08 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1467 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:08.794382 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-08fe29ba-c0a8-4370-8675-f4a3eb4f81ae tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:08.800219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-08fe29ba-c0a8-4370-8675-f4a3eb4f81ae tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:08.800923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-08fe29ba-c0a8-4370-8675-f4a3eb4f81ae tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-156188926', 'deleted': False, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12'} {{(pid=127288) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 10 19:01:08.806623 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08fe29ba-c0a8-4370-8675-f4a3eb4f81ae tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:08.807321 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08fe29ba-c0a8-4370-8675-f4a3eb4f81ae tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:08.807766 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08fe29ba-c0a8-4370-8675-f4a3eb4f81ae tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:08.810085 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08fe29ba-c0a8-4370-8675-f4a3eb4f81ae tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:08.810587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08fe29ba-c0a8-4370-8675-f4a3eb4f81ae tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:08.811026 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-08fe29ba-c0a8-4370-8675-f4a3eb4f81ae tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:08.906266 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.multi_cell_list [None req-08fe29ba-c0a8-4370-8675-f4a3eb4f81ae tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 10 19:01:08.934395 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8b7ccdf6-0368-4a1b-960d-2026dff7981c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:08.977495 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8b7ccdf6-0368-4a1b-960d-2026dff7981c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1308 microversion: 2.1 time: 0.561381 Oct 10 19:01:08.978611 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1195/2644] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:08 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1308 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:08.985770 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-41acea55-9ba9-4967-8898-e832167a8bca tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f31922b6790>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:09.001670 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-08fe29ba-c0a8-4370-8675-f4a3eb4f81ae tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-156188926" status: 200 len: 346 microversion: 2.1 time: 0.207963 Oct 10 19:01:09.002505 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1450/2645] 10.222.0.43 () {58 vars in 1228 bytes} [Mon Oct 10 19:01:08 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-156188926 => generated 346 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:09.015346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-525cc2ed-4581-46a4-9f69-80f07c2ca78d tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:09.015873 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-525cc2ed-4581-46a4-9f69-80f07c2ca78d tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:09.030265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-525cc2ed-4581-46a4-9f69-80f07c2ca78d tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:09.031416 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-525cc2ed-4581-46a4-9f69-80f07c2ca78d tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:09.032319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-525cc2ed-4581-46a4-9f69-80f07c2ca78d tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:09.036110 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-525cc2ed-4581-46a4-9f69-80f07c2ca78d tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:09.037583 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-525cc2ed-4581-46a4-9f69-80f07c2ca78d tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:09.038380 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-525cc2ed-4581-46a4-9f69-80f07c2ca78d tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:09.055004 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-41acea55-9ba9-4967-8898-e832167a8bca tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1467 microversion: 2.1 time: 0.075148 Oct 10 19:01:09.056273 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1196/2646] 10.222.0.43 () {58 vars in 1324 bytes} [Mon Oct 10 19:01:08 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1467 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:09.062407 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fa900423-d3cd-4e7f-a6d5-893108281030 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:09.070267 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fa900423-d3cd-4e7f-a6d5-893108281030 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:09.072517 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fa900423-d3cd-4e7f-a6d5-893108281030 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:09.073228 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fa900423-d3cd-4e7f-a6d5-893108281030 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:09.074256 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fa900423-d3cd-4e7f-a6d5-893108281030 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:09.074636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fa900423-d3cd-4e7f-a6d5-893108281030 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:09.075315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fa900423-d3cd-4e7f-a6d5-893108281030 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:09.075941 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fa900423-d3cd-4e7f-a6d5-893108281030 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:09.092955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-525cc2ed-4581-46a4-9f69-80f07c2ca78d tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:01:09.495782 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-525cc2ed-4581-46a4-9f69-80f07c2ca78d tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 204 len: 0 microversion: 2.1 time: 0.483211 Oct 10 19:01:09.496465 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1451/2647] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:01:09 2022] DELETE /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 19:01:09.506711 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-06359bb4-4624-4a44-b5de-c186bcbb0377 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d5cf700>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:09.590500 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fa900423-d3cd-4e7f-a6d5-893108281030 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:09.612825 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fa900423-d3cd-4e7f-a6d5-893108281030 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1213 microversion: 2.1 time: 0.555135 Oct 10 19:01:09.633953 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1197/2648] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:09 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1213 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:09.646405 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-959c843a-1be8-4f80-b060-84d9606b7886 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:09.647088 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-959c843a-1be8-4f80-b060-84d9606b7886 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:09.655596 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-959c843a-1be8-4f80-b060-84d9606b7886 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:09.656076 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-959c843a-1be8-4f80-b060-84d9606b7886 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:09.657244 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-959c843a-1be8-4f80-b060-84d9606b7886 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:09.658129 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-959c843a-1be8-4f80-b060-84d9606b7886 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:09.658846 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-959c843a-1be8-4f80-b060-84d9606b7886 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:09.662442 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-959c843a-1be8-4f80-b060-84d9606b7886 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:09.683391 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-06359bb4-4624-4a44-b5de-c186bcbb0377 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7111 microversion: 2.1 time: 0.184422 Oct 10 19:01:09.683798 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1452/2649] 10.222.0.43 () {58 vars in 1170 bytes} [Mon Oct 10 19:01:09 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7111 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:09.689085 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a5577a35-09f6-4a93-b191-568ab5efe42a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:09.689557 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a5577a35-09f6-4a93-b191-568ab5efe42a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:09.698963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a5577a35-09f6-4a93-b191-568ab5efe42a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:09.701136 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a5577a35-09f6-4a93-b191-568ab5efe42a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:09.701136 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a5577a35-09f6-4a93-b191-568ab5efe42a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:09.701136 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a5577a35-09f6-4a93-b191-568ab5efe42a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:09.701136 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a5577a35-09f6-4a93-b191-568ab5efe42a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:09.701565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a5577a35-09f6-4a93-b191-568ab5efe42a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:09.706030 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:09.880877 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-959c843a-1be8-4f80-b060-84d9606b7886 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:09.888702 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-959c843a-1be8-4f80-b060-84d9606b7886 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1334 microversion: 2.1 time: 0.253484 Oct 10 19:01:09.889199 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1198/2650] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:09 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1334 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:09.905794 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0180b47f-4f24-44ad-a8b5-42f0fe246707 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:09.907419 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0180b47f-4f24-44ad-a8b5-42f0fe246707 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:09.909383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a5577a35-09f6-4a93-b191-568ab5efe42a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:09.914481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0180b47f-4f24-44ad-a8b5-42f0fe246707 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:09.915081 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0180b47f-4f24-44ad-a8b5-42f0fe246707 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:09.915586 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0180b47f-4f24-44ad-a8b5-42f0fe246707 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:09.916526 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0180b47f-4f24-44ad-a8b5-42f0fe246707 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:09.917086 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0180b47f-4f24-44ad-a8b5-42f0fe246707 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:09.917720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0180b47f-4f24-44ad-a8b5-42f0fe246707 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:09.917890 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a5577a35-09f6-4a93-b191-568ab5efe42a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1318 microversion: 2.1 time: 0.233015 Oct 10 19:01:09.920773 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1453/2651] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:09 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:09.924161 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a57be2bb-bc1a-435f-84d6-f9d2c68b617f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d56e040>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:10.041005 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a57be2bb-bc1a-435f-84d6-f9d2c68b617f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4377 microversion: 2.1 time: 0.121425 Oct 10 19:01:10.053951 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1454/2652] 10.222.0.43 () {58 vars in 1170 bytes} [Mon Oct 10 19:01:09 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4377 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:10.058907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-44438557-0695-4a8b-be37-89b8cf117e41 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:10.059520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-44438557-0695-4a8b-be37-89b8cf117e41 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:10.066476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44438557-0695-4a8b-be37-89b8cf117e41 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:10.067305 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44438557-0695-4a8b-be37-89b8cf117e41 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:10.067991 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44438557-0695-4a8b-be37-89b8cf117e41 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:10.069129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44438557-0695-4a8b-be37-89b8cf117e41 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:10.069599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44438557-0695-4a8b-be37-89b8cf117e41 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:10.070025 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-44438557-0695-4a8b-be37-89b8cf117e41 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:10.238331 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-44438557-0695-4a8b-be37-89b8cf117e41 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:10.248797 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-44438557-0695-4a8b-be37-89b8cf117e41 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1308 microversion: 2.1 time: 0.193625 Oct 10 19:01:10.249672 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1455/2653] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:10 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:10.254240 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b62ff514-98ae-44c8-96eb-3528a53b6dbd tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d4fe160>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:10.278679 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0180b47f-4f24-44ad-a8b5-42f0fe246707 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:10.292203 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0180b47f-4f24-44ad-a8b5-42f0fe246707 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1517 microversion: 2.1 time: 0.399799 Oct 10 19:01:10.292203 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1199/2654] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:09 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1517 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:10.307038 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b62ff514-98ae-44c8-96eb-3528a53b6dbd tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/b0a280ee-26ee-4c9a-8155-4326e368ccc9" status: 200 len: 784 microversion: 2.1 time: 0.056322 Oct 10 19:01:10.307606 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1456/2655] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:10 2022] GET /compute/v2.1/images/b0a280ee-26ee-4c9a-8155-4326e368ccc9 => generated 784 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:10.323220 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-630e2637-b218-45bd-a47f-92b5005ce2ea tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f3192292670>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:10.409203 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-630e2637-b218-45bd-a47f-92b5005ce2ea tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.082967 Oct 10 19:01:10.409203 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1200/2656] 10.222.0.43 () {58 vars in 1158 bytes} [Mon Oct 10 19:01:10 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:10.424948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5e51cd57-a9f2-4ef9-9c3a-fc390ada0c01 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d5cf670>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:10.592347 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-d7042d92-cc51-46d5-a245-8f98868c73c3 req-debdd898-ec42-448c-bc14-8506ed705320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769", "tag": "29dca69a-b2eb-4806-8479-4da7220dc095"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:10.609694 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d7042d92-cc51-46d5-a245-8f98868c73c3 req-debdd898-ec42-448c-bc14-8506ed705320 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:10.610181 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d7042d92-cc51-46d5-a245-8f98868c73c3 req-debdd898-ec42-448c-bc14-8506ed705320 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:10.610613 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d7042d92-cc51-46d5-a245-8f98868c73c3 req-debdd898-ec42-448c-bc14-8506ed705320 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:10.626549 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-d7042d92-cc51-46d5-a245-8f98868c73c3 req-debdd898-ec42-448c-bc14-8506ed705320 service nova] Creating event network-changed:29dca69a-b2eb-4806-8479-4da7220dc095 for instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 on n-h1-860863-1 Oct 10 19:01:10.636141 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-d7042d92-cc51-46d5-a245-8f98868c73c3 req-debdd898-ec42-448c-bc14-8506ed705320 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051156 Oct 10 19:01:10.637465 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1201/2657] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:10.658189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f881c556-fc55-4752-bd29-0b00ea910670 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:10.659358 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f881c556-fc55-4752-bd29-0b00ea910670 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:10.666607 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f881c556-fc55-4752-bd29-0b00ea910670 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:10.667091 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f881c556-fc55-4752-bd29-0b00ea910670 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:10.667794 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f881c556-fc55-4752-bd29-0b00ea910670 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:10.668621 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f881c556-fc55-4752-bd29-0b00ea910670 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:10.669524 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f881c556-fc55-4752-bd29-0b00ea910670 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:10.670226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f881c556-fc55-4752-bd29-0b00ea910670 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:10.794202 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f881c556-fc55-4752-bd29-0b00ea910670 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:10.804812 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f881c556-fc55-4752-bd29-0b00ea910670 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1261 microversion: 2.1 time: 0.165773 Oct 10 19:01:10.805713 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1202/2658] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:10 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:10.916756 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f4fc0cd6-dd7d-4e30-8338-b44a68afec76 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:10.918114 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f4fc0cd6-dd7d-4e30-8338-b44a68afec76 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:10.924347 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4fc0cd6-dd7d-4e30-8338-b44a68afec76 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:10.925139 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4fc0cd6-dd7d-4e30-8338-b44a68afec76 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:10.925666 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4fc0cd6-dd7d-4e30-8338-b44a68afec76 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:10.927508 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4fc0cd6-dd7d-4e30-8338-b44a68afec76 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:10.928191 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4fc0cd6-dd7d-4e30-8338-b44a68afec76 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:10.928858 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f4fc0cd6-dd7d-4e30-8338-b44a68afec76 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:11.191303 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f4fc0cd6-dd7d-4e30-8338-b44a68afec76 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:11.201207 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f4fc0cd6-dd7d-4e30-8338-b44a68afec76 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1334 microversion: 2.1 time: 0.288955 Oct 10 19:01:11.201914 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1203/2659] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:10 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1334 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:11.221072 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-05d599b6-aad4-4e14-a661-d183870752c5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:11.221852 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-05d599b6-aad4-4e14-a661-d183870752c5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:11.227641 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:11.229591 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05d599b6-aad4-4e14-a661-d183870752c5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:11.230273 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05d599b6-aad4-4e14-a661-d183870752c5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:11.230848 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05d599b6-aad4-4e14-a661-d183870752c5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:11.231793 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05d599b6-aad4-4e14-a661-d183870752c5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:11.232250 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05d599b6-aad4-4e14-a661-d183870752c5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:11.232719 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05d599b6-aad4-4e14-a661-d183870752c5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:11.390514 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-05d599b6-aad4-4e14-a661-d183870752c5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:11.398415 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-05d599b6-aad4-4e14-a661-d183870752c5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1318 microversion: 2.1 time: 0.195216 Oct 10 19:01:11.399000 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1204/2660] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:11 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:11.404474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4d66aa88-4e40-4fe5-8b79-21cb65fa139b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:11.405317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4d66aa88-4e40-4fe5-8b79-21cb65fa139b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:11.417013 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4d66aa88-4e40-4fe5-8b79-21cb65fa139b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:11.418967 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4d66aa88-4e40-4fe5-8b79-21cb65fa139b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:11.418967 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4d66aa88-4e40-4fe5-8b79-21cb65fa139b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:11.420164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4d66aa88-4e40-4fe5-8b79-21cb65fa139b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:11.420818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4d66aa88-4e40-4fe5-8b79-21cb65fa139b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:11.421422 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4d66aa88-4e40-4fe5-8b79-21cb65fa139b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:11.583481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4d66aa88-4e40-4fe5-8b79-21cb65fa139b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:11.592384 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4d66aa88-4e40-4fe5-8b79-21cb65fa139b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1308 microversion: 2.1 time: 0.192091 Oct 10 19:01:11.593217 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1205/2661] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:11 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1308 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:11.614933 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7fe1f54b-f4cb-4abf-a289-61bce712ac36 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:11.615741 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7fe1f54b-f4cb-4abf-a289-61bce712ac36 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:11.622516 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7fe1f54b-f4cb-4abf-a289-61bce712ac36 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:11.623222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7fe1f54b-f4cb-4abf-a289-61bce712ac36 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:11.623790 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7fe1f54b-f4cb-4abf-a289-61bce712ac36 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:11.624643 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7fe1f54b-f4cb-4abf-a289-61bce712ac36 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:11.625200 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7fe1f54b-f4cb-4abf-a289-61bce712ac36 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:11.625718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7fe1f54b-f4cb-4abf-a289-61bce712ac36 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:11.762400 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5e51cd57-a9f2-4ef9-9c3a-fc390ada0c01 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "DELETE /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a" status: 204 len: 0 microversion: 2.1 time: 1.341268 Oct 10 19:01:11.764399 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1457/2662] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:10 2022] DELETE /compute/v2.1/images/db5ab249-69c6-4efa-a71a-3dd8a8e89a0a => generated 0 bytes in 1344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:01:11.772978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-59143de2-73ba-4794-b692-5096d43a9dd4 req-ab87b508-ebdd-4ebd-9075-77126f244d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154d20fa-a1d2-4bfd-99ab-024ddf8ae67b", "name": "network-vif-plugged", "status": "completed", "tag": "d76218a1-c511-4bbd-bdc9-d8d4fda923c7"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:11.784740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-59143de2-73ba-4794-b692-5096d43a9dd4 req-ab87b508-ebdd-4ebd-9075-77126f244d61 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:11.786070 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-59143de2-73ba-4794-b692-5096d43a9dd4 req-ab87b508-ebdd-4ebd-9075-77126f244d61 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:11.786654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-59143de2-73ba-4794-b692-5096d43a9dd4 req-ab87b508-ebdd-4ebd-9075-77126f244d61 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:11.796644 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7fe1f54b-f4cb-4abf-a289-61bce712ac36 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:11.799317 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-59143de2-73ba-4794-b692-5096d43a9dd4 req-ab87b508-ebdd-4ebd-9075-77126f244d61 service nova] Creating event network-vif-plugged:d76218a1-c511-4bbd-bdc9-d8d4fda923c7 for instance 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b on n-h1-860863-1 Oct 10 19:01:11.804501 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-59143de2-73ba-4794-b692-5096d43a9dd4 req-ab87b508-ebdd-4ebd-9075-77126f244d61 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035686 Oct 10 19:01:11.805208 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1458/2663] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:11.806553 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7fe1f54b-f4cb-4abf-a289-61bce712ac36 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1517 microversion: 2.1 time: 0.211962 Oct 10 19:01:11.816704 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1206/2664] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:11 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1517 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:11.817252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ae996764-2c99-4b0c-beed-ab9a80f4316c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d5cfdc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:11.828749 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-63dc15f2-39c3-4f0d-8471-ef4a3dcb367e tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:11.829701 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-63dc15f2-39c3-4f0d-8471-ef4a3dcb367e tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:11.836862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dc15f2-39c3-4f0d-8471-ef4a3dcb367e tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:11.837577 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dc15f2-39c3-4f0d-8471-ef4a3dcb367e tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:11.843663 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dc15f2-39c3-4f0d-8471-ef4a3dcb367e tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:11.843663 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dc15f2-39c3-4f0d-8471-ef4a3dcb367e tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:11.843663 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dc15f2-39c3-4f0d-8471-ef4a3dcb367e tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:11.843663 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-63dc15f2-39c3-4f0d-8471-ef4a3dcb367e tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:11.930480 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-63dc15f2-39c3-4f0d-8471-ef4a3dcb367e tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:11.939617 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-63dc15f2-39c3-4f0d-8471-ef4a3dcb367e tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1261 microversion: 2.1 time: 0.115140 Oct 10 19:01:11.945268 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1207/2665] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:11 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1261 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:12.226419 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fb42f321-1745-4b02-b02f-db709f59b2a5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:12.227031 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fb42f321-1745-4b02-b02f-db709f59b2a5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:12.242409 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb42f321-1745-4b02-b02f-db709f59b2a5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:12.242409 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb42f321-1745-4b02-b02f-db709f59b2a5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:12.242409 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb42f321-1745-4b02-b02f-db709f59b2a5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:12.242409 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb42f321-1745-4b02-b02f-db709f59b2a5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:12.242409 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb42f321-1745-4b02-b02f-db709f59b2a5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:12.242409 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fb42f321-1745-4b02-b02f-db709f59b2a5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:12.447862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fb42f321-1745-4b02-b02f-db709f59b2a5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:12.457374 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fb42f321-1745-4b02-b02f-db709f59b2a5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1334 microversion: 2.1 time: 0.234689 Oct 10 19:01:12.458215 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1208/2666] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:12 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1334 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:12.463088 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-45555f9a-410d-4045-92a8-082d26f3528b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:12.463704 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-45555f9a-410d-4045-92a8-082d26f3528b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:12.469778 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45555f9a-410d-4045-92a8-082d26f3528b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:12.470260 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45555f9a-410d-4045-92a8-082d26f3528b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:12.470693 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45555f9a-410d-4045-92a8-082d26f3528b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:12.471577 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45555f9a-410d-4045-92a8-082d26f3528b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:12.472189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45555f9a-410d-4045-92a8-082d26f3528b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:12.472688 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-45555f9a-410d-4045-92a8-082d26f3528b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:12.761115 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-45555f9a-410d-4045-92a8-082d26f3528b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:12.767922 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-45555f9a-410d-4045-92a8-082d26f3528b tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1318 microversion: 2.1 time: 0.308331 Oct 10 19:01:12.775775 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1209/2667] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:12 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:12.791304 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-44381b9a-ef0b-4809-890e-d4cbd7b6c324 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:12.794612 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-44381b9a-ef0b-4809-890e-d4cbd7b6c324 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:12.801975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44381b9a-ef0b-4809-890e-d4cbd7b6c324 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:12.802465 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44381b9a-ef0b-4809-890e-d4cbd7b6c324 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:12.802896 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44381b9a-ef0b-4809-890e-d4cbd7b6c324 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:12.803597 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44381b9a-ef0b-4809-890e-d4cbd7b6c324 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:12.804384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44381b9a-ef0b-4809-890e-d4cbd7b6c324 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:12.808672 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44381b9a-ef0b-4809-890e-d4cbd7b6c324 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:13.172747 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-44381b9a-ef0b-4809-890e-d4cbd7b6c324 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:13.185342 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-44381b9a-ef0b-4809-890e-d4cbd7b6c324 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1308 microversion: 2.1 time: 0.407585 Oct 10 19:01:13.186134 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1210/2668] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:12 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:13.196676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-31408483-a18e-4e7f-a03f-728cf7364857 req-b65bd849-9387-4c7f-9173-0aecea17797a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769", "tag": "b1c8c0c4-18f0-46ad-862b-c045e504c56e"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:13.237922 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-31408483-a18e-4e7f-a03f-728cf7364857 req-b65bd849-9387-4c7f-9173-0aecea17797a service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:13.238728 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-31408483-a18e-4e7f-a03f-728cf7364857 req-b65bd849-9387-4c7f-9173-0aecea17797a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:13.242460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-31408483-a18e-4e7f-a03f-728cf7364857 req-b65bd849-9387-4c7f-9173-0aecea17797a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:13.279690 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-31408483-a18e-4e7f-a03f-728cf7364857 req-b65bd849-9387-4c7f-9173-0aecea17797a service nova] Creating event network-changed:b1c8c0c4-18f0-46ad-862b-c045e504c56e for instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 on n-h1-860863-1 Oct 10 19:01:13.285136 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-31408483-a18e-4e7f-a03f-728cf7364857 req-b65bd849-9387-4c7f-9173-0aecea17797a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097367 Oct 10 19:01:13.286521 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1211/2669] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:13.293441 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e4715fcd-853c-44bb-8a49-dacc1a421021 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:13.294501 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e4715fcd-853c-44bb-8a49-dacc1a421021 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:13.301990 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e4715fcd-853c-44bb-8a49-dacc1a421021 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:13.302806 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e4715fcd-853c-44bb-8a49-dacc1a421021 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:13.303420 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e4715fcd-853c-44bb-8a49-dacc1a421021 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:13.304352 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e4715fcd-853c-44bb-8a49-dacc1a421021 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:13.305128 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e4715fcd-853c-44bb-8a49-dacc1a421021 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:13.305763 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e4715fcd-853c-44bb-8a49-dacc1a421021 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:13.343274 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ae996764-2c99-4b0c-beed-ab9a80f4316c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "DELETE /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf" status: 204 len: 0 microversion: 2.1 time: 1.536658 Oct 10 19:01:13.346872 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1459/2670] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:11 2022] DELETE /compute/v2.1/images/fe7169cb-6288-4056-94fc-b79641452dcf => generated 0 bytes in 1538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:01:13.353358 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-ff19fa8a-4c22-4ece-8fb7-557045028ba1 req-fa603a47-545f-4199-a886-f745767b0188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7fa2bf-4c6b-4023-b935-69aa11ef98b5", "name": "network-vif-deleted", "tag": "15e57f63-4842-479a-9767-e8443587cdb2"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:13.376297 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-ff19fa8a-4c22-4ece-8fb7-557045028ba1 req-fa603a47-545f-4199-a886-f745767b0188 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:13.379010 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-ff19fa8a-4c22-4ece-8fb7-557045028ba1 req-fa603a47-545f-4199-a886-f745767b0188 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:13.379811 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-ff19fa8a-4c22-4ece-8fb7-557045028ba1 req-fa603a47-545f-4199-a886-f745767b0188 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:13.420960 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-ff19fa8a-4c22-4ece-8fb7-557045028ba1 req-fa603a47-545f-4199-a886-f745767b0188 service nova] Creating event network-vif-deleted:15e57f63-4842-479a-9767-e8443587cdb2 for instance 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 on n-h2-860863-1 Oct 10 19:01:13.427566 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-ff19fa8a-4c22-4ece-8fb7-557045028ba1 req-fa603a47-545f-4199-a886-f745767b0188 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078418 Oct 10 19:01:13.428181 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1460/2671] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:13.442383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-93e04d05-105a-435e-b8fe-9b8b5fe76bef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:13.444285 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-93e04d05-105a-435e-b8fe-9b8b5fe76bef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:13.462197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-93e04d05-105a-435e-b8fe-9b8b5fe76bef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:13.462197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-93e04d05-105a-435e-b8fe-9b8b5fe76bef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:13.462197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-93e04d05-105a-435e-b8fe-9b8b5fe76bef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:13.462197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-93e04d05-105a-435e-b8fe-9b8b5fe76bef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:13.462197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-93e04d05-105a-435e-b8fe-9b8b5fe76bef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:13.462197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-93e04d05-105a-435e-b8fe-9b8b5fe76bef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:13.541413 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e4715fcd-853c-44bb-8a49-dacc1a421021 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:13.554757 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e4715fcd-853c-44bb-8a49-dacc1a421021 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 200 len: 1305 microversion: 2.1 time: 0.263886 Oct 10 19:01:13.555400 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1212/2672] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:13 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 1305 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:13.564435 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6f2ca0a6-6842-420c-b997-1d7ff95e2668 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f319231d310>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:13.580503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-93e04d05-105a-435e-b8fe-9b8b5fe76bef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:13.585122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:13.594154 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-93e04d05-105a-435e-b8fe-9b8b5fe76bef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1267 microversion: 2.1 time: 0.156836 Oct 10 19:01:13.594746 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1461/2673] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:13 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:13.600598 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-79ba9f61-d98c-4f3f-8fad-4eaa008a9770 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:13.601525 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-79ba9f61-d98c-4f3f-8fad-4eaa008a9770 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:13.608324 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79ba9f61-d98c-4f3f-8fad-4eaa008a9770 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:13.609079 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79ba9f61-d98c-4f3f-8fad-4eaa008a9770 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:13.612738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79ba9f61-d98c-4f3f-8fad-4eaa008a9770 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:13.612738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79ba9f61-d98c-4f3f-8fad-4eaa008a9770 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:13.612738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79ba9f61-d98c-4f3f-8fad-4eaa008a9770 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:13.612738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79ba9f61-d98c-4f3f-8fad-4eaa008a9770 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:13.860261 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-79ba9f61-d98c-4f3f-8fad-4eaa008a9770 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:13.868648 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-79ba9f61-d98c-4f3f-8fad-4eaa008a9770 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1334 microversion: 2.1 time: 0.272568 Oct 10 19:01:13.869231 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1462/2674] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:13 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1334 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:13.889279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-50d70a38-c505-4d6e-8719-9c9a1b912098 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:13.889793 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-50d70a38-c505-4d6e-8719-9c9a1b912098 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:13.896838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50d70a38-c505-4d6e-8719-9c9a1b912098 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:13.897314 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50d70a38-c505-4d6e-8719-9c9a1b912098 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:13.897740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50d70a38-c505-4d6e-8719-9c9a1b912098 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:13.898442 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50d70a38-c505-4d6e-8719-9c9a1b912098 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:13.901817 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50d70a38-c505-4d6e-8719-9c9a1b912098 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:13.901817 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-50d70a38-c505-4d6e-8719-9c9a1b912098 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:14.164098 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-50d70a38-c505-4d6e-8719-9c9a1b912098 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:14.172143 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-50d70a38-c505-4d6e-8719-9c9a1b912098 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1318 microversion: 2.1 time: 0.286623 Oct 10 19:01:14.172884 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1463/2675] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:13 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:14.217294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5dcede63-4991-4071-a807-be67f821d0c7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:14.217906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5dcede63-4991-4071-a807-be67f821d0c7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:14.234211 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dcede63-4991-4071-a807-be67f821d0c7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:14.234963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dcede63-4991-4071-a807-be67f821d0c7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:14.237909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dcede63-4991-4071-a807-be67f821d0c7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:14.239194 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dcede63-4991-4071-a807-be67f821d0c7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:14.239662 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dcede63-4991-4071-a807-be67f821d0c7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:14.249772 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5dcede63-4991-4071-a807-be67f821d0c7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:14.401154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5dcede63-4991-4071-a807-be67f821d0c7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:14.409329 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5dcede63-4991-4071-a807-be67f821d0c7 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1487 microversion: 2.1 time: 0.195913 Oct 10 19:01:14.409913 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1464/2676] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:14 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1487 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:14.432725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-80c8fcfa-0a08-4b04-a338-180ae97e2278 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:14.438855 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80c8fcfa-0a08-4b04-a338-180ae97e2278 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:14.439307 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80c8fcfa-0a08-4b04-a338-180ae97e2278 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:14.439737 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-80c8fcfa-0a08-4b04-a338-180ae97e2278 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:14.463960 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-80c8fcfa-0a08-4b04-a338-180ae97e2278 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Going to try to stop instance {{(pid=127288) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 10 19:01:14.698729 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-80c8fcfa-0a08-4b04-a338-180ae97e2278 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "POST /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b/action" status: 202 len: 0 microversion: 2.1 time: 0.269773 Oct 10 19:01:14.699333 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1465/2677] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:01:14 2022] POST /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 10 19:01:14.708097 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cab05006-6675-44f0-bdef-6e3a04f95399 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:14.708821 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cab05006-6675-44f0-bdef-6e3a04f95399 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:14.715269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cab05006-6675-44f0-bdef-6e3a04f95399 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:14.715753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cab05006-6675-44f0-bdef-6e3a04f95399 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:14.719231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cab05006-6675-44f0-bdef-6e3a04f95399 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:14.719231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cab05006-6675-44f0-bdef-6e3a04f95399 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:14.719231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cab05006-6675-44f0-bdef-6e3a04f95399 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:14.719231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cab05006-6675-44f0-bdef-6e3a04f95399 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:14.758176 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-cab05006-6675-44f0-bdef-6e3a04f95399 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] HTTP exception thrown: Instance 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 could not be found. Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cab05006-6675-44f0-bdef-6e3a04f95399 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Request method failure captured: Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 HTTP/1.1 Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGueH1yj21OQo9spusNJ86KnqFGIUj5d__eOxFQuzC6ysNCVkuLFuO6i5WdrNvBH3JldTDtY_DnZzsiE4gC2AETI6PsxyEazOFGR7YrKnyLT2LZQKrJT6sLNQSIfdHlBcXbD9A0cyPY4wqWAtzRaL2dvNv9jbecxksv_Sbu3bEQAxvI Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b94e8833aa35458ea401de2ae6b0ba12 Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ListServerFiltersTestJSON-110530514 Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b94e8833aa35458ea401de2ae6b0ba12", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b94e8833aa35458ea401de2ae6b0ba12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b94e8833aa35458ea401de2ae6b0ba12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b94e8833aa35458ea401de2ae6b0ba12"}]}] Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ListServerFiltersTestJSON-110530514 Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b94e8833aa35458ea401de2ae6b0ba12 Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-110530514 Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ListServerFiltersTestJSON-110530514-project Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: adb4474eb77141ce942d1ad170fee56b Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ListServerFiltersTestJSON-110530514-project Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 could not be found. Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '6f7fa2bf-4c6b-4023-b935-69aa11ef98b5'} Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 could not be found. Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 could not be found. Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:14.761901 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:14.768110 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:14.768110 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:14.768110 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:14.768110 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:01:14.768110 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:01:14.768110 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 could not be found. Oct 10 19:01:14.768110 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:14.768110 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cab05006-6675-44f0-bdef-6e3a04f95399 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Returning 404 to user: Instance 6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:01:14.772203 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cab05006-6675-44f0-bdef-6e3a04f95399 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5" status: 404 len: 111 microversion: 2.1 time: 0.063492 Oct 10 19:01:14.772801 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1466/2678] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:14 2022] GET /compute/v2.1/servers/6f7fa2bf-4c6b-4023-b935-69aa11ef98b5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:01:14.780617 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d44a3d7a-2ea1-4823-9835-de39aeedf225 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:14.781446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d44a3d7a-2ea1-4823-9835-de39aeedf225 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:14.795139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d44a3d7a-2ea1-4823-9835-de39aeedf225 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:14.796347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d44a3d7a-2ea1-4823-9835-de39aeedf225 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:14.797215 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d44a3d7a-2ea1-4823-9835-de39aeedf225 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:14.797930 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d44a3d7a-2ea1-4823-9835-de39aeedf225 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:14.798377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d44a3d7a-2ea1-4823-9835-de39aeedf225 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:14.798803 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d44a3d7a-2ea1-4823-9835-de39aeedf225 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:14.941425 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d44a3d7a-2ea1-4823-9835-de39aeedf225 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:14.949399 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d44a3d7a-2ea1-4823-9835-de39aeedf225 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1309 microversion: 2.1 time: 0.175047 Oct 10 19:01:14.949962 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1467/2679] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:14 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1309 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:14.968831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c7a533d4-be21-4624-9c67-423223a049a8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:14.969454 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c7a533d4-be21-4624-9c67-423223a049a8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:14.976220 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7a533d4-be21-4624-9c67-423223a049a8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:14.976739 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7a533d4-be21-4624-9c67-423223a049a8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:14.977175 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7a533d4-be21-4624-9c67-423223a049a8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:14.977872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7a533d4-be21-4624-9c67-423223a049a8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:14.978333 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7a533d4-be21-4624-9c67-423223a049a8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:14.978760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7a533d4-be21-4624-9c67-423223a049a8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:14.992139 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6f2ca0a6-6842-420c-b997-1d7ff95e2668 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "DELETE /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890" status: 204 len: 0 microversion: 2.1 time: 1.434232 Oct 10 19:01:14.992841 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1213/2680] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:13 2022] DELETE /compute/v2.1/images/98901565-ad11-4d22-91b3-2e0f49197890 => generated 0 bytes in 1437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:01:14.999366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fdf50416-875a-489c-bf90-8ce832163ac5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:15.000152 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fdf50416-875a-489c-bf90-8ce832163ac5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: c22fa54d-372c-4887-8875-a3c56b3850b1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:15.007364 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fdf50416-875a-489c-bf90-8ce832163ac5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:15.008226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fdf50416-875a-489c-bf90-8ce832163ac5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:15.008908 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fdf50416-875a-489c-bf90-8ce832163ac5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:15.009846 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fdf50416-875a-489c-bf90-8ce832163ac5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:15.010526 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fdf50416-875a-489c-bf90-8ce832163ac5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:15.011155 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fdf50416-875a-489c-bf90-8ce832163ac5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:15.039661 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fdf50416-875a-489c-bf90-8ce832163ac5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: c22fa54d-372c-4887-8875-a3c56b3850b1] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:01:15.123650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c7a533d4-be21-4624-9c67-423223a049a8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:15.133576 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c7a533d4-be21-4624-9c67-423223a049a8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.168643 Oct 10 19:01:15.134984 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1468/2681] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:14 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:15.140120 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-53014017-fd3a-4cab-9d16-4f482f1e10e0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:15.140988 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-53014017-fd3a-4cab-9d16-4f482f1e10e0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:15.147695 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53014017-fd3a-4cab-9d16-4f482f1e10e0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:15.148176 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53014017-fd3a-4cab-9d16-4f482f1e10e0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:15.148658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53014017-fd3a-4cab-9d16-4f482f1e10e0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:15.149562 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53014017-fd3a-4cab-9d16-4f482f1e10e0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:15.150074 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53014017-fd3a-4cab-9d16-4f482f1e10e0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:15.150502 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-53014017-fd3a-4cab-9d16-4f482f1e10e0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:15.294567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-53014017-fd3a-4cab-9d16-4f482f1e10e0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:15.302641 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-53014017-fd3a-4cab-9d16-4f482f1e10e0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1334 microversion: 2.1 time: 0.166491 Oct 10 19:01:15.303222 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1469/2682] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:15 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1334 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:15.307863 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cdd83ec5-c145-4954-b35b-3e28a38dadb4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:15.308354 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cdd83ec5-c145-4954-b35b-3e28a38dadb4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:15.314810 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdd83ec5-c145-4954-b35b-3e28a38dadb4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:15.315347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdd83ec5-c145-4954-b35b-3e28a38dadb4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:15.315788 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdd83ec5-c145-4954-b35b-3e28a38dadb4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:15.317023 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdd83ec5-c145-4954-b35b-3e28a38dadb4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:15.317482 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdd83ec5-c145-4954-b35b-3e28a38dadb4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:15.317903 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdd83ec5-c145-4954-b35b-3e28a38dadb4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:15.326201 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fdf50416-875a-489c-bf90-8ce832163ac5 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1" status: 204 len: 0 microversion: 2.1 time: 0.331689 Oct 10 19:01:15.327305 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1214/2683] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:01:14 2022] DELETE /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:01:15.334377 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-016b524f-5b41-43b4-91d9-0bdab86b15c9 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:15.336444 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-016b524f-5b41-43b4-91d9-0bdab86b15c9 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:15.343465 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-016b524f-5b41-43b4-91d9-0bdab86b15c9 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:15.343957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-016b524f-5b41-43b4-91d9-0bdab86b15c9 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:15.344514 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-016b524f-5b41-43b4-91d9-0bdab86b15c9 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:15.345872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-016b524f-5b41-43b4-91d9-0bdab86b15c9 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:15.346330 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-016b524f-5b41-43b4-91d9-0bdab86b15c9 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:15.346477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cdd83ec5-c145-4954-b35b-3e28a38dadb4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:01:15.346752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-016b524f-5b41-43b4-91d9-0bdab86b15c9 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:15.767404 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cdd83ec5-c145-4954-b35b-3e28a38dadb4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 204 len: 0 microversion: 2.1 time: 0.461596 Oct 10 19:01:15.767404 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1470/2684] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:01:15 2022] DELETE /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:01:15.771870 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ade0e080-e8fb-46bd-8af5-507dbdfb2eca tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:15.772589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ade0e080-e8fb-46bd-8af5-507dbdfb2eca tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: c22fa54d-372c-4887-8875-a3c56b3850b1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:15.781634 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ade0e080-e8fb-46bd-8af5-507dbdfb2eca tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:15.782230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ade0e080-e8fb-46bd-8af5-507dbdfb2eca tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:15.782802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ade0e080-e8fb-46bd-8af5-507dbdfb2eca tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:15.783666 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ade0e080-e8fb-46bd-8af5-507dbdfb2eca tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:15.784269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ade0e080-e8fb-46bd-8af5-507dbdfb2eca tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:15.786637 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ade0e080-e8fb-46bd-8af5-507dbdfb2eca tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:15.946520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ade0e080-e8fb-46bd-8af5-507dbdfb2eca tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:15.954494 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ade0e080-e8fb-46bd-8af5-507dbdfb2eca tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1" status: 200 len: 1517 microversion: 2.1 time: 0.186632 Oct 10 19:01:15.955187 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1471/2685] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:15 2022] GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:15.968221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-742a7af4-ba43-41fa-9a58-004c9724fe47 req-6aaf40e6-6ea2-4693-b5e4-1a34b993f6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cc13ed-22f0-4a0a-a65f-208bd80d70b2", "name": "network-vif-plugged", "status": "completed", "tag": "35cd11dc-afb2-4ad8-839a-5e9279495af4"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:15.978802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-742a7af4-ba43-41fa-9a58-004c9724fe47 req-6aaf40e6-6ea2-4693-b5e4-1a34b993f6f9 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:15.984098 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-742a7af4-ba43-41fa-9a58-004c9724fe47 req-6aaf40e6-6ea2-4693-b5e4-1a34b993f6f9 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:15.984098 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-742a7af4-ba43-41fa-9a58-004c9724fe47 req-6aaf40e6-6ea2-4693-b5e4-1a34b993f6f9 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:15.991233 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-016b524f-5b41-43b4-91d9-0bdab86b15c9 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:15.991963 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-742a7af4-ba43-41fa-9a58-004c9724fe47 req-6aaf40e6-6ea2-4693-b5e4-1a34b993f6f9 service nova] Creating event network-vif-plugged:35cd11dc-afb2-4ad8-839a-5e9279495af4 for instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 on n-h2-860863-1 Oct 10 19:01:15.997080 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-742a7af4-ba43-41fa-9a58-004c9724fe47 req-6aaf40e6-6ea2-4693-b5e4-1a34b993f6f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040659 Oct 10 19:01:15.998485 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1472/2686] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:16.001037 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-016b524f-5b41-43b4-91d9-0bdab86b15c9 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1318 microversion: 2.1 time: 0.672276 Oct 10 19:01:16.019003 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f80c86c7-488a-402c-ae3d-00368c055350 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:16.019003 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f80c86c7-488a-402c-ae3d-00368c055350 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:16.019190 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1215/2687] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:15 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1318 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:16.019294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f80c86c7-488a-402c-ae3d-00368c055350 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:16.019294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f80c86c7-488a-402c-ae3d-00368c055350 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:16.019294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f80c86c7-488a-402c-ae3d-00368c055350 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:16.019294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f80c86c7-488a-402c-ae3d-00368c055350 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:16.019294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f80c86c7-488a-402c-ae3d-00368c055350 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:16.019294 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f80c86c7-488a-402c-ae3d-00368c055350 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:16.020027 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bf2d41d3-9070-4d4a-941d-ff94d957b275 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:16.020707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bf2d41d3-9070-4d4a-941d-ff94d957b275 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:16.027506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bf2d41d3-9070-4d4a-941d-ff94d957b275 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:16.027998 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bf2d41d3-9070-4d4a-941d-ff94d957b275 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:16.028433 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bf2d41d3-9070-4d4a-941d-ff94d957b275 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:16.029186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bf2d41d3-9070-4d4a-941d-ff94d957b275 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:16.029713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bf2d41d3-9070-4d4a-941d-ff94d957b275 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:16.034082 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bf2d41d3-9070-4d4a-941d-ff94d957b275 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:16.146507 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f80c86c7-488a-402c-ae3d-00368c055350 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:16.154379 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f80c86c7-488a-402c-ae3d-00368c055350 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1473 microversion: 2.1 time: 0.155218 Oct 10 19:01:16.154987 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1473/2688] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:15 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1473 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:16.159348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-43e2a31b-90f0-4294-b53b-ca9f0c7d6d76 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:16.159953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-43e2a31b-90f0-4294-b53b-ca9f0c7d6d76 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:16.169396 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43e2a31b-90f0-4294-b53b-ca9f0c7d6d76 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:16.169895 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43e2a31b-90f0-4294-b53b-ca9f0c7d6d76 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:16.170969 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43e2a31b-90f0-4294-b53b-ca9f0c7d6d76 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:16.171178 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43e2a31b-90f0-4294-b53b-ca9f0c7d6d76 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:16.171630 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43e2a31b-90f0-4294-b53b-ca9f0c7d6d76 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:16.172052 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43e2a31b-90f0-4294-b53b-ca9f0c7d6d76 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:16.313154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-43e2a31b-90f0-4294-b53b-ca9f0c7d6d76 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:16.323282 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-43e2a31b-90f0-4294-b53b-ca9f0c7d6d76 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.167284 Oct 10 19:01:16.334014 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1474/2689] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:16 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:16.344587 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4becc284-0837-4a79-89e1-b4f7ca109f54 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:16.345206 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4becc284-0837-4a79-89e1-b4f7ca109f54 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:16.351771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4becc284-0837-4a79-89e1-b4f7ca109f54 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:16.352270 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4becc284-0837-4a79-89e1-b4f7ca109f54 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:16.352759 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4becc284-0837-4a79-89e1-b4f7ca109f54 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:16.353636 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4becc284-0837-4a79-89e1-b4f7ca109f54 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:16.354213 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4becc284-0837-4a79-89e1-b4f7ca109f54 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:16.354637 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4becc284-0837-4a79-89e1-b4f7ca109f54 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:16.378284 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bf2d41d3-9070-4d4a-941d-ff94d957b275 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:16.384691 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:16.390371 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bf2d41d3-9070-4d4a-941d-ff94d957b275 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1309 microversion: 2.1 time: 0.375452 Oct 10 19:01:16.390371 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1216/2690] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:16 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1309 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:16.515028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4becc284-0837-4a79-89e1-b4f7ca109f54 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:16.526613 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4becc284-0837-4a79-89e1-b4f7ca109f54 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1334 microversion: 2.1 time: 0.190873 Oct 10 19:01:16.528488 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1475/2691] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:16 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1334 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:16.924898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-6fc840b9-3f4c-491e-a7ac-ff4ba4bae4e1 req-93c9db2a-5b81-447f-87a7-f8e8fe160681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f8b3740-33b8-47a5-ada8-d3dd2ce3356a", "tag": "6a64c27f-e1a8-446d-9325-a7901a380021"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:16.937267 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6fc840b9-3f4c-491e-a7ac-ff4ba4bae4e1 req-93c9db2a-5b81-447f-87a7-f8e8fe160681 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:16.937744 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6fc840b9-3f4c-491e-a7ac-ff4ba4bae4e1 req-93c9db2a-5b81-447f-87a7-f8e8fe160681 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:16.938517 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-6fc840b9-3f4c-491e-a7ac-ff4ba4bae4e1 req-93c9db2a-5b81-447f-87a7-f8e8fe160681 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:16.950366 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-6fc840b9-3f4c-491e-a7ac-ff4ba4bae4e1 req-93c9db2a-5b81-447f-87a7-f8e8fe160681 service nova] Creating event network-changed:6a64c27f-e1a8-446d-9325-a7901a380021 for instance 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a on n-h2-860863-1 Oct 10 19:01:16.955002 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-6fc840b9-3f4c-491e-a7ac-ff4ba4bae4e1 req-93c9db2a-5b81-447f-87a7-f8e8fe160681 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037985 Oct 10 19:01:16.956246 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1217/2692] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:16.979054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-232b76aa-1e78-4f2b-94af-948d5f237c74 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:16.979678 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-232b76aa-1e78-4f2b-94af-948d5f237c74 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: c22fa54d-372c-4887-8875-a3c56b3850b1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:16.996193 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-232b76aa-1e78-4f2b-94af-948d5f237c74 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:16.997709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-232b76aa-1e78-4f2b-94af-948d5f237c74 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:16.997709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-232b76aa-1e78-4f2b-94af-948d5f237c74 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:16.998028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-232b76aa-1e78-4f2b-94af-948d5f237c74 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:16.998520 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-232b76aa-1e78-4f2b-94af-948d5f237c74 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:16.998942 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-232b76aa-1e78-4f2b-94af-948d5f237c74 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:17.030092 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f260e211-8cc8-45ee-a6a8-a001fbd092bc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:17.032056 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f260e211-8cc8-45ee-a6a8-a001fbd092bc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:17.044946 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f260e211-8cc8-45ee-a6a8-a001fbd092bc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:17.045962 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f260e211-8cc8-45ee-a6a8-a001fbd092bc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:17.046890 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f260e211-8cc8-45ee-a6a8-a001fbd092bc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:17.047966 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f260e211-8cc8-45ee-a6a8-a001fbd092bc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:17.048519 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f260e211-8cc8-45ee-a6a8-a001fbd092bc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:17.049231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f260e211-8cc8-45ee-a6a8-a001fbd092bc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:17.268486 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=22 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:17.388785 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f260e211-8cc8-45ee-a6a8-a001fbd092bc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:17.405246 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f260e211-8cc8-45ee-a6a8-a001fbd092bc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1318 microversion: 2.1 time: 0.381005 Oct 10 19:01:17.407116 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1218/2693] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:17 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:17.410702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-232b76aa-1e78-4f2b-94af-948d5f237c74 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:17.421150 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-73c9d22e-f7f7-47f5-99ce-f0c6d5daad68 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:17.423033 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-73c9d22e-f7f7-47f5-99ce-f0c6d5daad68 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:17.429135 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-232b76aa-1e78-4f2b-94af-948d5f237c74 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1" status: 200 len: 1517 microversion: 2.1 time: 0.453713 Oct 10 19:01:17.432645 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-73c9d22e-f7f7-47f5-99ce-f0c6d5daad68 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:17.445134 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1476/2694] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:16 2022] GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1 => generated 1517 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:17.445134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-61e97320-962f-4d32-9ca6-ec938246f3c6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:17.445134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-61e97320-962f-4d32-9ca6-ec938246f3c6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:17.455420 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-73c9d22e-f7f7-47f5-99ce-f0c6d5daad68 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:17.456734 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-73c9d22e-f7f7-47f5-99ce-f0c6d5daad68 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:17.457750 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-73c9d22e-f7f7-47f5-99ce-f0c6d5daad68 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:17.460398 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-73c9d22e-f7f7-47f5-99ce-f0c6d5daad68 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:17.461163 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-73c9d22e-f7f7-47f5-99ce-f0c6d5daad68 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:17.462003 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=14 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:17.462922 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61e97320-962f-4d32-9ca6-ec938246f3c6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:17.465948 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61e97320-962f-4d32-9ca6-ec938246f3c6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:17.466443 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61e97320-962f-4d32-9ca6-ec938246f3c6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:17.469839 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61e97320-962f-4d32-9ca6-ec938246f3c6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:17.471335 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61e97320-962f-4d32-9ca6-ec938246f3c6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:17.471561 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61e97320-962f-4d32-9ca6-ec938246f3c6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:17.484751 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:17.710779 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-73c9d22e-f7f7-47f5-99ce-f0c6d5daad68 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:17.724654 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-73c9d22e-f7f7-47f5-99ce-f0c6d5daad68 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1473 microversion: 2.1 time: 0.315661 Oct 10 19:01:17.725733 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1219/2695] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:17 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1473 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:17.749233 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-318dd96f-fd3d-4628-9bbf-b8c51addf462 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:17.750196 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-318dd96f-fd3d-4628-9bbf-b8c51addf462 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:17.757670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-318dd96f-fd3d-4628-9bbf-b8c51addf462 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:17.758403 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-318dd96f-fd3d-4628-9bbf-b8c51addf462 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:17.759012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-318dd96f-fd3d-4628-9bbf-b8c51addf462 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:17.765949 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-318dd96f-fd3d-4628-9bbf-b8c51addf462 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:17.771249 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-318dd96f-fd3d-4628-9bbf-b8c51addf462 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:17.774119 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-318dd96f-fd3d-4628-9bbf-b8c51addf462 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:18.016100 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=12 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:18.026091 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-318dd96f-fd3d-4628-9bbf-b8c51addf462 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:18.044710 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-318dd96f-fd3d-4628-9bbf-b8c51addf462 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1309 microversion: 2.1 time: 0.294470 Oct 10 19:01:18.053397 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1220/2696] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:17 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1309 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:18.066821 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c37835aa-01ca-40fd-9a20-5d907c0e22a0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:18.066821 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c37835aa-01ca-40fd-9a20-5d907c0e22a0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:18.069092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-61e97320-962f-4d32-9ca6-ec938246f3c6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:18.071372 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c37835aa-01ca-40fd-9a20-5d907c0e22a0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:18.072172 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c37835aa-01ca-40fd-9a20-5d907c0e22a0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:18.072804 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c37835aa-01ca-40fd-9a20-5d907c0e22a0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:18.074251 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c37835aa-01ca-40fd-9a20-5d907c0e22a0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:18.074934 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c37835aa-01ca-40fd-9a20-5d907c0e22a0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:18.075597 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c37835aa-01ca-40fd-9a20-5d907c0e22a0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:18.076887 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-61e97320-962f-4d32-9ca6-ec938246f3c6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.641495 Oct 10 19:01:18.081037 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1477/2697] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:17 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:18.092675 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-519fa254-4372-449c-83de-adbcaf2fba26 req-2b973f7e-2208-4f5e-a437-c50e8c114f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769", "name": "network-vif-plugged", "status": "completed", "tag": "29dca69a-b2eb-4806-8479-4da7220dc095"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:18.115996 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-519fa254-4372-449c-83de-adbcaf2fba26 req-2b973f7e-2208-4f5e-a437-c50e8c114f64 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:18.116873 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-519fa254-4372-449c-83de-adbcaf2fba26 req-2b973f7e-2208-4f5e-a437-c50e8c114f64 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:18.117530 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-519fa254-4372-449c-83de-adbcaf2fba26 req-2b973f7e-2208-4f5e-a437-c50e8c114f64 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:18.135383 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-519fa254-4372-449c-83de-adbcaf2fba26 req-2b973f7e-2208-4f5e-a437-c50e8c114f64 service nova] Creating event network-vif-plugged:29dca69a-b2eb-4806-8479-4da7220dc095 for instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 on n-h1-860863-1 Oct 10 19:01:18.150418 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-519fa254-4372-449c-83de-adbcaf2fba26 req-2b973f7e-2208-4f5e-a437-c50e8c114f64 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067789 Oct 10 19:01:18.151379 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1478/2698] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:18.364170 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c37835aa-01ca-40fd-9a20-5d907c0e22a0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:18.374995 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c37835aa-01ca-40fd-9a20-5d907c0e22a0 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1334 microversion: 2.1 time: 0.320066 Oct 10 19:01:18.377348 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1221/2699] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:18 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1334 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:18.431805 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-89dbc349-3a8e-4af5-a8e1-da9401405dcc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:18.433053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-89dbc349-3a8e-4af5-a8e1-da9401405dcc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:18.445023 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-89dbc349-3a8e-4af5-a8e1-da9401405dcc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:18.448144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-89dbc349-3a8e-4af5-a8e1-da9401405dcc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:18.448800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-89dbc349-3a8e-4af5-a8e1-da9401405dcc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:18.451487 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-89dbc349-3a8e-4af5-a8e1-da9401405dcc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:18.452167 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-89dbc349-3a8e-4af5-a8e1-da9401405dcc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:18.453058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-89dbc349-3a8e-4af5-a8e1-da9401405dcc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:18.463675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-87436d65-eb60-4281-8239-742218146a31 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:18.464321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-87436d65-eb60-4281-8239-742218146a31 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: c22fa54d-372c-4887-8875-a3c56b3850b1] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:18.473820 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87436d65-eb60-4281-8239-742218146a31 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:18.476280 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87436d65-eb60-4281-8239-742218146a31 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:18.476280 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87436d65-eb60-4281-8239-742218146a31 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:18.476280 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87436d65-eb60-4281-8239-742218146a31 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:18.476280 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87436d65-eb60-4281-8239-742218146a31 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:18.477417 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87436d65-eb60-4281-8239-742218146a31 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:18.551670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87436d65-eb60-4281-8239-742218146a31 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:18.551670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87436d65-eb60-4281-8239-742218146a31 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:18.551670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-87436d65-eb60-4281-8239-742218146a31 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:18.551670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-87436d65-eb60-4281-8239-742218146a31 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lazy-loading 'fault' on Instance uuid c22fa54d-372c-4887-8875-a3c56b3850b1 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:01:18.624053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-87436d65-eb60-4281-8239-742218146a31 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:18.645787 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-87436d65-eb60-4281-8239-742218146a31 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1" status: 200 len: 1311 microversion: 2.1 time: 0.181710 Oct 10 19:01:18.645787 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1222/2700] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:18 2022] GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1 => generated 1311 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:18.761808 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bc9d3552-0e55-4985-a248-fc5a343e9df4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:18.762472 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bc9d3552-0e55-4985-a248-fc5a343e9df4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:18.773271 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc9d3552-0e55-4985-a248-fc5a343e9df4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:18.774280 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc9d3552-0e55-4985-a248-fc5a343e9df4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:18.775789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc9d3552-0e55-4985-a248-fc5a343e9df4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:18.776524 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc9d3552-0e55-4985-a248-fc5a343e9df4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:18.777733 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc9d3552-0e55-4985-a248-fc5a343e9df4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:18.778441 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bc9d3552-0e55-4985-a248-fc5a343e9df4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:18.843735 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=12 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:18.862431 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-89dbc349-3a8e-4af5-a8e1-da9401405dcc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:18.873123 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-89dbc349-3a8e-4af5-a8e1-da9401405dcc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1509 microversion: 2.1 time: 0.445448 Oct 10 19:01:18.873716 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1479/2701] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:18 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1509 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:18.899680 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e1d044ca-816d-4c0c-9c93-458f12cff138 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:18.909875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e1d044ca-816d-4c0c-9c93-458f12cff138 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:18.909875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1d044ca-816d-4c0c-9c93-458f12cff138 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:18.910879 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1d044ca-816d-4c0c-9c93-458f12cff138 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:18.911548 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1d044ca-816d-4c0c-9c93-458f12cff138 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:18.912742 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1d044ca-816d-4c0c-9c93-458f12cff138 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:18.913672 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1d044ca-816d-4c0c-9c93-458f12cff138 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:18.914218 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e1d044ca-816d-4c0c-9c93-458f12cff138 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.012829 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-bc9d3552-0e55-4985-a248-fc5a343e9df4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:19.021443 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bc9d3552-0e55-4985-a248-fc5a343e9df4 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1473 microversion: 2.1 time: 0.270319 Oct 10 19:01:19.022124 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1223/2702] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:18 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1473 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:19.026983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-0b59d76b-aba9-4d6c-bcf7-78c88df46937 req-c45dfead-9c37-4758-912f-7be0143c6935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22fa54d-372c-4887-8875-a3c56b3850b1", "name": "network-vif-deleted", "tag": "22ce5b61-90fe-4432-bece-f8ea63b95965"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:19.039982 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-0b59d76b-aba9-4d6c-bcf7-78c88df46937 req-c45dfead-9c37-4758-912f-7be0143c6935 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.040694 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-0b59d76b-aba9-4d6c-bcf7-78c88df46937 req-c45dfead-9c37-4758-912f-7be0143c6935 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.042185 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-0b59d76b-aba9-4d6c-bcf7-78c88df46937 req-c45dfead-9c37-4758-912f-7be0143c6935 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.058471 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-0b59d76b-aba9-4d6c-bcf7-78c88df46937 req-c45dfead-9c37-4758-912f-7be0143c6935 service nova] Creating event network-vif-deleted:22ce5b61-90fe-4432-bece-f8ea63b95965 for instance c22fa54d-372c-4887-8875-a3c56b3850b1 on n-h2-860863-1 Oct 10 19:01:19.065393 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-0b59d76b-aba9-4d6c-bcf7-78c88df46937 req-c45dfead-9c37-4758-912f-7be0143c6935 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041281 Oct 10 19:01:19.066641 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1224/2703] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:19.082189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-40668e23-2183-44ed-b26f-08b38ab4bc12 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:19.084966 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-40668e23-2183-44ed-b26f-08b38ab4bc12 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:19.091782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40668e23-2183-44ed-b26f-08b38ab4bc12 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.091782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40668e23-2183-44ed-b26f-08b38ab4bc12 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.091782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40668e23-2183-44ed-b26f-08b38ab4bc12 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.091782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40668e23-2183-44ed-b26f-08b38ab4bc12 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.091782 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40668e23-2183-44ed-b26f-08b38ab4bc12 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.092341 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-40668e23-2183-44ed-b26f-08b38ab4bc12 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.143591 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e1d044ca-816d-4c0c-9c93-458f12cff138 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:19.153763 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e1d044ca-816d-4c0c-9c93-458f12cff138 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1509 microversion: 2.1 time: 0.260321 Oct 10 19:01:19.154910 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1480/2704] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:18 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1509 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:19.161005 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-49eed358-891d-48b0-8352-bcff890ff1f4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:19.161952 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-49eed358-891d-48b0-8352-bcff890ff1f4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:19.170546 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-49eed358-891d-48b0-8352-bcff890ff1f4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.171203 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-49eed358-891d-48b0-8352-bcff890ff1f4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.171926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-49eed358-891d-48b0-8352-bcff890ff1f4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.173123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-49eed358-891d-48b0-8352-bcff890ff1f4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.173574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-49eed358-891d-48b0-8352-bcff890ff1f4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.173985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-49eed358-891d-48b0-8352-bcff890ff1f4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.282976 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-40668e23-2183-44ed-b26f-08b38ab4bc12 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:19.292907 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-40668e23-2183-44ed-b26f-08b38ab4bc12 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1309 microversion: 2.1 time: 0.225194 Oct 10 19:01:19.312105 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1225/2705] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:19 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1309 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:19.317594 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6dd53270-6918-45b8-9327-df3b956464c4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:19.324555 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6dd53270-6918-45b8-9327-df3b956464c4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:19.341026 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6dd53270-6918-45b8-9327-df3b956464c4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.344836 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6dd53270-6918-45b8-9327-df3b956464c4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.345307 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6dd53270-6918-45b8-9327-df3b956464c4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.346089 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6dd53270-6918-45b8-9327-df3b956464c4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.351889 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6dd53270-6918-45b8-9327-df3b956464c4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.351889 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6dd53270-6918-45b8-9327-df3b956464c4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.360569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-49eed358-891d-48b0-8352-bcff890ff1f4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:19.373707 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-49eed358-891d-48b0-8352-bcff890ff1f4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.216952 Oct 10 19:01:19.384955 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1481/2706] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:19 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:19.384955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-440d7f27-feca-4fa1-b715-b6ea6d053dbe req-df0334b5-00cd-4ce0-8c1f-c132c6837895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4098c038-9bbe-4f57-8b58-a6b33603f231", "name": "network-vif-deleted", "tag": "f24f31eb-483d-4f5b-a6a5-8c0d1e1cce67"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:19.403254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-440d7f27-feca-4fa1-b715-b6ea6d053dbe req-df0334b5-00cd-4ce0-8c1f-c132c6837895 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.403254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-440d7f27-feca-4fa1-b715-b6ea6d053dbe req-df0334b5-00cd-4ce0-8c1f-c132c6837895 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.404436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-440d7f27-feca-4fa1-b715-b6ea6d053dbe req-df0334b5-00cd-4ce0-8c1f-c132c6837895 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.430962 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-440d7f27-feca-4fa1-b715-b6ea6d053dbe req-df0334b5-00cd-4ce0-8c1f-c132c6837895 service nova] Creating event network-vif-deleted:f24f31eb-483d-4f5b-a6a5-8c0d1e1cce67 for instance 4098c038-9bbe-4f57-8b58-a6b33603f231 on n-h1-860863-1 Oct 10 19:01:19.430962 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-440d7f27-feca-4fa1-b715-b6ea6d053dbe req-df0334b5-00cd-4ce0-8c1f-c132c6837895 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048958 Oct 10 19:01:19.430962 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1482/2707] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:19.436179 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d18d2d5d-380e-4d84-a530-67ad62b8ba37 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:19.437040 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d18d2d5d-380e-4d84-a530-67ad62b8ba37 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:19.451555 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d18d2d5d-380e-4d84-a530-67ad62b8ba37 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.452290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d18d2d5d-380e-4d84-a530-67ad62b8ba37 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.452854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d18d2d5d-380e-4d84-a530-67ad62b8ba37 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.453676 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d18d2d5d-380e-4d84-a530-67ad62b8ba37 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.454226 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d18d2d5d-380e-4d84-a530-67ad62b8ba37 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.454863 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d18d2d5d-380e-4d84-a530-67ad62b8ba37 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.543035 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6dd53270-6918-45b8-9327-df3b956464c4 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "PUT /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1081 microversion: 2.1 time: 0.229263 Oct 10 19:01:19.543276 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1226/2708] 10.222.0.43 () {60 vars in 1256 bytes} [Mon Oct 10 19:01:19 2022] PUT /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1081 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:19.570293 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-edd19932-5303-4743-9be0-98dc162f4aa1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:19.570293 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-edd19932-5303-4743-9be0-98dc162f4aa1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:19.580720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edd19932-5303-4743-9be0-98dc162f4aa1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.580720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edd19932-5303-4743-9be0-98dc162f4aa1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.580720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edd19932-5303-4743-9be0-98dc162f4aa1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.580720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edd19932-5303-4743-9be0-98dc162f4aa1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.580720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edd19932-5303-4743-9be0-98dc162f4aa1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.580720 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-edd19932-5303-4743-9be0-98dc162f4aa1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.644420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d18d2d5d-380e-4d84-a530-67ad62b8ba37 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:19.653699 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d18d2d5d-380e-4d84-a530-67ad62b8ba37 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1334 microversion: 2.1 time: 0.222209 Oct 10 19:01:19.654568 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1483/2709] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:19 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1334 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:19.665710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fa99dfc9-8c88-4f94-ba2f-81b3b8302277 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:19.666725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fa99dfc9-8c88-4f94-ba2f-81b3b8302277 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: c22fa54d-372c-4887-8875-a3c56b3850b1] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:19.686023 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa99dfc9-8c88-4f94-ba2f-81b3b8302277 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.686522 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa99dfc9-8c88-4f94-ba2f-81b3b8302277 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.686957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa99dfc9-8c88-4f94-ba2f-81b3b8302277 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.688898 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa99dfc9-8c88-4f94-ba2f-81b3b8302277 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.689798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa99dfc9-8c88-4f94-ba2f-81b3b8302277 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.690517 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fa99dfc9-8c88-4f94-ba2f-81b3b8302277 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.723170 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-fa99dfc9-8c88-4f94-ba2f-81b3b8302277 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] HTTP exception thrown: Instance c22fa54d-372c-4887-8875-a3c56b3850b1 could not be found. Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fa99dfc9-8c88-4f94-ba2f-81b3b8302277 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Request method failure captured: Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1 HTTP/1.1 Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGueH1yj21OQo9spusNJ86KnqFGIUj5d__eOxFQuzC6ysNCVkuLFuO6i5WdrNvBH3JldTDtY_DnZzsiE4gC2AETI6PsxyEazOFGR7YrKnyLT2LZQKrJT6sLNQSIfdHlBcXbD9A0cyPY4wqWAtzRaL2dvNv9jbecxksv_Sbu3bEQAxvI Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b94e8833aa35458ea401de2ae6b0ba12 Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ListServerFiltersTestJSON-110530514 Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b94e8833aa35458ea401de2ae6b0ba12", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b94e8833aa35458ea401de2ae6b0ba12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b94e8833aa35458ea401de2ae6b0ba12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b94e8833aa35458ea401de2ae6b0ba12"}]}] Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ListServerFiltersTestJSON-110530514 Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b94e8833aa35458ea401de2ae6b0ba12 Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-110530514 Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ListServerFiltersTestJSON-110530514-project Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: adb4474eb77141ce942d1ad170fee56b Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ListServerFiltersTestJSON-110530514-project Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance c22fa54d-372c-4887-8875-a3c56b3850b1 could not be found. Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'c22fa54d-372c-4887-8875-a3c56b3850b1'} Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c22fa54d-372c-4887-8875-a3c56b3850b1 could not be found. Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c22fa54d-372c-4887-8875-a3c56b3850b1 could not be found. Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:19.726432 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:19.732312 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:19.732312 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:19.732312 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:19.732312 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:01:19.732312 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:01:19.732312 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c22fa54d-372c-4887-8875-a3c56b3850b1 could not be found. Oct 10 19:01:19.732312 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:19.732312 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fa99dfc9-8c88-4f94-ba2f-81b3b8302277 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Returning 404 to user: Instance c22fa54d-372c-4887-8875-a3c56b3850b1 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:01:19.732312 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fa99dfc9-8c88-4f94-ba2f-81b3b8302277 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1" status: 404 len: 111 microversion: 2.1 time: 0.064740 Oct 10 19:01:19.732312 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1484/2710] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:19 2022] GET /compute/v2.1/servers/c22fa54d-372c-4887-8875-a3c56b3850b1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:01:19.734866 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ff6c33fb-ee93-4da4-baa7-ced41e12c0da tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:19.735354 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ff6c33fb-ee93-4da4-baa7-ced41e12c0da tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:19.742101 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-edd19932-5303-4743-9be0-98dc162f4aa1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:19.742244 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ff6c33fb-ee93-4da4-baa7-ced41e12c0da tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.742738 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ff6c33fb-ee93-4da4-baa7-ced41e12c0da tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.743159 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ff6c33fb-ee93-4da4-baa7-ced41e12c0da tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.743850 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ff6c33fb-ee93-4da4-baa7-ced41e12c0da tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.744731 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ff6c33fb-ee93-4da4-baa7-ced41e12c0da tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.745158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ff6c33fb-ee93-4da4-baa7-ced41e12c0da tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.752559 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-edd19932-5303-4743-9be0-98dc162f4aa1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1507 microversion: 2.1 time: 0.189174 Oct 10 19:01:19.753234 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1227/2711] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:19 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:19.772938 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ff6c33fb-ee93-4da4-baa7-ced41e12c0da tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:01:19.781109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-78b17d81-83be-4a0a-9cc8-4dec5c6edc4e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:19.783872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-78b17d81-83be-4a0a-9cc8-4dec5c6edc4e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:19.791250 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-78b17d81-83be-4a0a-9cc8-4dec5c6edc4e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.792157 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-78b17d81-83be-4a0a-9cc8-4dec5c6edc4e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.792618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-78b17d81-83be-4a0a-9cc8-4dec5c6edc4e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.793640 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-78b17d81-83be-4a0a-9cc8-4dec5c6edc4e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.794103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-78b17d81-83be-4a0a-9cc8-4dec5c6edc4e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.794566 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-78b17d81-83be-4a0a-9cc8-4dec5c6edc4e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.954549 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-78b17d81-83be-4a0a-9cc8-4dec5c6edc4e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:19.965084 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-78b17d81-83be-4a0a-9cc8-4dec5c6edc4e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1507 microversion: 2.1 time: 0.193085 Oct 10 19:01:19.966476 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1228/2712] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:19 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:19.987717 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:19.991292 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:19.997887 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:19.998489 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:19.999195 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:19.999861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.000475 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.001051 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.016408 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ff6c33fb-ee93-4da4-baa7-ced41e12c0da tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 204 len: 0 microversion: 2.1 time: 0.284975 Oct 10 19:01:20.019365 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1485/2713] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:01:19 2022] DELETE /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:01:20.031596 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-de1131ef-3378-402e-b949-b20bca7b1255 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:20.032913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-de1131ef-3378-402e-b949-b20bca7b1255 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:20.044214 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de1131ef-3378-402e-b949-b20bca7b1255 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.044911 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de1131ef-3378-402e-b949-b20bca7b1255 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.045351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de1131ef-3378-402e-b949-b20bca7b1255 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.052796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de1131ef-3378-402e-b949-b20bca7b1255 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.052796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de1131ef-3378-402e-b949-b20bca7b1255 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.052796 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de1131ef-3378-402e-b949-b20bca7b1255 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.097040 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 19:01:20.097588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 19:01:20.098942 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 19:01:20.098942 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 19:01:20.099303 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 19:01:20.292514 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-de1131ef-3378-402e-b949-b20bca7b1255 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:20.300578 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-de1131ef-3378-402e-b949-b20bca7b1255 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1518 microversion: 2.1 time: 0.274998 Oct 10 19:01:20.309761 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1486/2714] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:20 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1518 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:20.309912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:20.310024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b7d24d6e-f716-4987-8c96-77687918e38c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:20.310024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b7d24d6e-f716-4987-8c96-77687918e38c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:20.310319 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.311983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.311983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.311983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.312373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.313431 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.318980 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7d24d6e-f716-4987-8c96-77687918e38c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.320091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7d24d6e-f716-4987-8c96-77687918e38c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.320651 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7d24d6e-f716-4987-8c96-77687918e38c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.321497 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7d24d6e-f716-4987-8c96-77687918e38c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.329088 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7d24d6e-f716-4987-8c96-77687918e38c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.329554 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7d24d6e-f716-4987-8c96-77687918e38c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.352274 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-bbf35baa-b1ee-47fd-af2c-0e7994131ba3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "POST /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2/action" status: 202 len: 1113 microversion: 2.1 time: 0.368514 Oct 10 19:01:20.355650 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1229/2715] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:01:19 2022] POST /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2/action => generated 1113 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 10 19:01:20.358154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-628d8063-ca0b-4290-af1e-15fbf79872ef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:20.358766 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-628d8063-ca0b-4290-af1e-15fbf79872ef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:20.366451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-628d8063-ca0b-4290-af1e-15fbf79872ef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.370977 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-628d8063-ca0b-4290-af1e-15fbf79872ef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.370977 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-628d8063-ca0b-4290-af1e-15fbf79872ef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.370977 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-628d8063-ca0b-4290-af1e-15fbf79872ef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.370977 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-628d8063-ca0b-4290-af1e-15fbf79872ef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.370977 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-628d8063-ca0b-4290-af1e-15fbf79872ef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.371388 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7d24d6e-f716-4987-8c96-77687918e38c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.371753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7d24d6e-f716-4987-8c96-77687918e38c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.372195 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b7d24d6e-f716-4987-8c96-77687918e38c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.372677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-b7d24d6e-f716-4987-8c96-77687918e38c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lazy-loading 'fault' on Instance uuid 4098c038-9bbe-4f57-8b58-a6b33603f231 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:01:20.424688 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b7d24d6e-f716-4987-8c96-77687918e38c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:20.433773 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b7d24d6e-f716-4987-8c96-77687918e38c tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1308 microversion: 2.1 time: 0.131575 Oct 10 19:01:20.434921 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1487/2716] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:20 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:20.446157 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-077ca554-a437-4b95-9787-2b6d0a42b489 req-4194be6e-a5c1-44c9-9c4c-9826909ff278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769", "name": "network-vif-plugged", "status": "completed", "tag": "b1c8c0c4-18f0-46ad-862b-c045e504c56e"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:20.455895 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:20.460221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-077ca554-a437-4b95-9787-2b6d0a42b489 req-4194be6e-a5c1-44c9-9c4c-9826909ff278 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.461665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-077ca554-a437-4b95-9787-2b6d0a42b489 req-4194be6e-a5c1-44c9-9c4c-9826909ff278 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.462118 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-077ca554-a437-4b95-9787-2b6d0a42b489 req-4194be6e-a5c1-44c9-9c4c-9826909ff278 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.475000 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-077ca554-a437-4b95-9787-2b6d0a42b489 req-4194be6e-a5c1-44c9-9c4c-9826909ff278 service nova] Creating event network-vif-plugged:b1c8c0c4-18f0-46ad-862b-c045e504c56e for instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 on n-h1-860863-1 Oct 10 19:01:20.480674 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-077ca554-a437-4b95-9787-2b6d0a42b489 req-4194be6e-a5c1-44c9-9c4c-9826909ff278 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044286 Oct 10 19:01:20.481491 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1488/2717] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:20.486345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2d268b9e-487b-4190-a4e8-eebb99554661 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:20.487069 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2d268b9e-487b-4190-a4e8-eebb99554661 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:20.493970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d268b9e-487b-4190-a4e8-eebb99554661 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.494453 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d268b9e-487b-4190-a4e8-eebb99554661 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.494891 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d268b9e-487b-4190-a4e8-eebb99554661 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.495634 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d268b9e-487b-4190-a4e8-eebb99554661 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.496160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d268b9e-487b-4190-a4e8-eebb99554661 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.496609 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d268b9e-487b-4190-a4e8-eebb99554661 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.527546 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-628d8063-ca0b-4290-af1e-15fbf79872ef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:20.536483 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-628d8063-ca0b-4290-af1e-15fbf79872ef tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1309 microversion: 2.1 time: 0.181973 Oct 10 19:01:20.537098 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1230/2718] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:20 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1309 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:20.541888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-33eb4420-4f17-411b-b3de-6f0fbee7dd38 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:20.542509 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-33eb4420-4f17-411b-b3de-6f0fbee7dd38 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:20.548784 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33eb4420-4f17-411b-b3de-6f0fbee7dd38 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.551529 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33eb4420-4f17-411b-b3de-6f0fbee7dd38 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.551529 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33eb4420-4f17-411b-b3de-6f0fbee7dd38 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.551529 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33eb4420-4f17-411b-b3de-6f0fbee7dd38 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.551950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33eb4420-4f17-411b-b3de-6f0fbee7dd38 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.552222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-33eb4420-4f17-411b-b3de-6f0fbee7dd38 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.696612 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-33eb4420-4f17-411b-b3de-6f0fbee7dd38 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:20.700710 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:20.705660 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-33eb4420-4f17-411b-b3de-6f0fbee7dd38 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.167596 Oct 10 19:01:20.706240 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1231/2719] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:20 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:20.711816 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dcb954ff-8400-4ef6-9a7f-63a8d7bb9366 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:20.712646 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-dcb954ff-8400-4ef6-9a7f-63a8d7bb9366 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:20.720218 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dcb954ff-8400-4ef6-9a7f-63a8d7bb9366 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.720743 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dcb954ff-8400-4ef6-9a7f-63a8d7bb9366 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.721181 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dcb954ff-8400-4ef6-9a7f-63a8d7bb9366 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.721884 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dcb954ff-8400-4ef6-9a7f-63a8d7bb9366 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:20.722480 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dcb954ff-8400-4ef6-9a7f-63a8d7bb9366 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:20.723595 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dcb954ff-8400-4ef6-9a7f-63a8d7bb9366 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:20.725194 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2d268b9e-487b-4190-a4e8-eebb99554661 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:20.733877 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2d268b9e-487b-4190-a4e8-eebb99554661 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.251417 Oct 10 19:01:20.734796 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1489/2720] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:20 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:20.870187 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-dcb954ff-8400-4ef6-9a7f-63a8d7bb9366 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:20.877818 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dcb954ff-8400-4ef6-9a7f-63a8d7bb9366 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1334 microversion: 2.1 time: 0.170497 Oct 10 19:01:20.878394 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1232/2721] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:20 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1334 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:21.325673 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0d6c5c15-9eb7-4c77-b428-121570951ec9 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:21.327431 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0d6c5c15-9eb7-4c77-b428-121570951ec9 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:21.335371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0d6c5c15-9eb7-4c77-b428-121570951ec9 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:21.336066 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0d6c5c15-9eb7-4c77-b428-121570951ec9 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:21.336620 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0d6c5c15-9eb7-4c77-b428-121570951ec9 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:21.337560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0d6c5c15-9eb7-4c77-b428-121570951ec9 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:21.338111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0d6c5c15-9eb7-4c77-b428-121570951ec9 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:21.338668 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0d6c5c15-9eb7-4c77-b428-121570951ec9 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:21.460884 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-64345cf9-ccce-4272-8764-47c7eef6f0a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:21.461491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-64345cf9-ccce-4272-8764-47c7eef6f0a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:21.469010 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64345cf9-ccce-4272-8764-47c7eef6f0a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:21.469491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64345cf9-ccce-4272-8764-47c7eef6f0a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:21.470096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64345cf9-ccce-4272-8764-47c7eef6f0a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:21.470817 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64345cf9-ccce-4272-8764-47c7eef6f0a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:21.471279 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64345cf9-ccce-4272-8764-47c7eef6f0a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:21.471675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64345cf9-ccce-4272-8764-47c7eef6f0a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:21.505030 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64345cf9-ccce-4272-8764-47c7eef6f0a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:21.505520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64345cf9-ccce-4272-8764-47c7eef6f0a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:21.505977 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-64345cf9-ccce-4272-8764-47c7eef6f0a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:21.506428 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-64345cf9-ccce-4272-8764-47c7eef6f0a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lazy-loading 'fault' on Instance uuid 4098c038-9bbe-4f57-8b58-a6b33603f231 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:01:21.510390 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0d6c5c15-9eb7-4c77-b428-121570951ec9 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:21.528101 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0d6c5c15-9eb7-4c77-b428-121570951ec9 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1518 microversion: 2.1 time: 0.206376 Oct 10 19:01:21.529550 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1490/2722] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:21 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1518 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:21.550108 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-64345cf9-ccce-4272-8764-47c7eef6f0a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:21.559834 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-64345cf9-ccce-4272-8764-47c7eef6f0a3 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 200 len: 1308 microversion: 2.1 time: 0.103209 Oct 10 19:01:21.569016 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1233/2723] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:21 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:21.576042 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e0c0292b-3af4-4cfc-90da-eb814f5f0e8c tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:21.576923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e0c0292b-3af4-4cfc-90da-eb814f5f0e8c tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:21.585687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e0c0292b-3af4-4cfc-90da-eb814f5f0e8c tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:21.587090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e0c0292b-3af4-4cfc-90da-eb814f5f0e8c tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:21.587542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e0c0292b-3af4-4cfc-90da-eb814f5f0e8c tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:21.588992 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e0c0292b-3af4-4cfc-90da-eb814f5f0e8c tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:21.589607 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e0c0292b-3af4-4cfc-90da-eb814f5f0e8c tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:21.590064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e0c0292b-3af4-4cfc-90da-eb814f5f0e8c tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:21.731541 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-05a6dd35-6d86-471f-8ff7-e866cb844c33 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:21.732497 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-05a6dd35-6d86-471f-8ff7-e866cb844c33 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:21.740818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05a6dd35-6d86-471f-8ff7-e866cb844c33 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:21.741977 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05a6dd35-6d86-471f-8ff7-e866cb844c33 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:21.742492 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05a6dd35-6d86-471f-8ff7-e866cb844c33 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:21.743278 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05a6dd35-6d86-471f-8ff7-e866cb844c33 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:21.743825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05a6dd35-6d86-471f-8ff7-e866cb844c33 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:21.744335 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05a6dd35-6d86-471f-8ff7-e866cb844c33 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:21.880828 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e0c0292b-3af4-4cfc-90da-eb814f5f0e8c tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:21.892963 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e0c0292b-3af4-4cfc-90da-eb814f5f0e8c tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1309 microversion: 2.1 time: 0.328545 Oct 10 19:01:21.909615 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1491/2724] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:21 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1309 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:21.917505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bb3da74d-29e1-4b94-92fa-0ec8ec73bd32 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:21.918436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bb3da74d-29e1-4b94-92fa-0ec8ec73bd32 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:21.926753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bb3da74d-29e1-4b94-92fa-0ec8ec73bd32 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:21.927810 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bb3da74d-29e1-4b94-92fa-0ec8ec73bd32 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:21.928895 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bb3da74d-29e1-4b94-92fa-0ec8ec73bd32 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:21.934400 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bb3da74d-29e1-4b94-92fa-0ec8ec73bd32 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:21.934400 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bb3da74d-29e1-4b94-92fa-0ec8ec73bd32 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:21.934400 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bb3da74d-29e1-4b94-92fa-0ec8ec73bd32 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:21.939936 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-05a6dd35-6d86-471f-8ff7-e866cb844c33 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:21.954258 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-05a6dd35-6d86-471f-8ff7-e866cb844c33 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.226491 Oct 10 19:01:21.973426 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1234/2725] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:21 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:21.992972 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6aec82b7-d979-496e-9781-a5b5f9988ad9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:21.993593 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6aec82b7-d979-496e-9781-a5b5f9988ad9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:21.999716 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6aec82b7-d979-496e-9781-a5b5f9988ad9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:22.000205 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6aec82b7-d979-496e-9781-a5b5f9988ad9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:22.000731 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6aec82b7-d979-496e-9781-a5b5f9988ad9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:22.001434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6aec82b7-d979-496e-9781-a5b5f9988ad9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:22.001887 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6aec82b7-d979-496e-9781-a5b5f9988ad9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:22.002308 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6aec82b7-d979-496e-9781-a5b5f9988ad9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:22.176372 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6aec82b7-d979-496e-9781-a5b5f9988ad9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:22.185853 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6aec82b7-d979-496e-9781-a5b5f9988ad9 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1334 microversion: 2.1 time: 0.212984 Oct 10 19:01:22.189713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bb3da74d-29e1-4b94-92fa-0ec8ec73bd32 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:22.201873 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1235/2726] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:21 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1334 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:22.204959 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bb3da74d-29e1-4b94-92fa-0ec8ec73bd32 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.291630 Oct 10 19:01:22.205713 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1492/2727] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:21 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:22.551156 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4d0ca409-c63a-4a23-a5e7-9813d953ad5a tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:22.553409 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4d0ca409-c63a-4a23-a5e7-9813d953ad5a tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:22.561308 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4d0ca409-c63a-4a23-a5e7-9813d953ad5a tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:22.561988 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4d0ca409-c63a-4a23-a5e7-9813d953ad5a tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:22.562656 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4d0ca409-c63a-4a23-a5e7-9813d953ad5a tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:22.563709 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4d0ca409-c63a-4a23-a5e7-9813d953ad5a tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:22.565044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4d0ca409-c63a-4a23-a5e7-9813d953ad5a tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:22.565646 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4d0ca409-c63a-4a23-a5e7-9813d953ad5a tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:22.585102 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3b99820a-ca44-4804-a8b2-0814dca15a5a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:22.585788 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3b99820a-ca44-4804-a8b2-0814dca15a5a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: 4098c038-9bbe-4f57-8b58-a6b33603f231] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:22.594997 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3b99820a-ca44-4804-a8b2-0814dca15a5a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:22.595562 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3b99820a-ca44-4804-a8b2-0814dca15a5a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:22.596115 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3b99820a-ca44-4804-a8b2-0814dca15a5a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:22.596790 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3b99820a-ca44-4804-a8b2-0814dca15a5a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:22.597243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3b99820a-ca44-4804-a8b2-0814dca15a5a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:22.597698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3b99820a-ca44-4804-a8b2-0814dca15a5a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:22.614813 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-3b99820a-ca44-4804-a8b2-0814dca15a5a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] HTTP exception thrown: Instance 4098c038-9bbe-4f57-8b58-a6b33603f231 could not be found. Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3b99820a-ca44-4804-a8b2-0814dca15a5a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Request method failure captured: Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 HTTP/1.1 Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGtX3GbBV5P58ePv_WO3aCDWERPqap_ORyR0bMBZKcOSIn9BfybCJ0GYj2viHGyFlTL_1qzoqn-SXZC_HIkkNEkSiSiImeF40jnqdXNA8jGeSzTdygrysJNoe7iqWUUKVfQ3VKk7nJEphOt07scthpZok1BbjYyuAzQIJFBqHicXHPU Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 77d197e4831748d9a1d12e4a3b44629d Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ListImageFiltersTestJSON-1667161161 Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_77d197e4831748d9a1d12e4a3b44629d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/77d197e4831748d9a1d12e4a3b44629d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77d197e4831748d9a1d12e4a3b44629d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77d197e4831748d9a1d12e4a3b44629d"}]}] Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ListImageFiltersTestJSON-1667161161 Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 77d197e4831748d9a1d12e4a3b44629d Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1667161161 Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ListImageFiltersTestJSON-1667161161-project Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: e36772b0f87c46b2b31d642729e02b50 Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ListImageFiltersTestJSON-1667161161-project Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 4098c038-9bbe-4f57-8b58-a6b33603f231 could not be found. Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '4098c038-9bbe-4f57-8b58-a6b33603f231'} Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4098c038-9bbe-4f57-8b58-a6b33603f231 could not be found. Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4098c038-9bbe-4f57-8b58-a6b33603f231 could not be found. Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:22.616429 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:22.621354 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:22.621354 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:22.621354 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:22.621354 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:01:22.621354 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:01:22.621354 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4098c038-9bbe-4f57-8b58-a6b33603f231 could not be found. Oct 10 19:01:22.621354 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:22.621354 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3b99820a-ca44-4804-a8b2-0814dca15a5a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Returning 404 to user: Instance 4098c038-9bbe-4f57-8b58-a6b33603f231 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:01:22.621354 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3b99820a-ca44-4804-a8b2-0814dca15a5a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231" status: 404 len: 111 microversion: 2.1 time: 0.038724 Oct 10 19:01:22.622253 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1493/2728] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:22 2022] GET /compute/v2.1/servers/4098c038-9bbe-4f57-8b58-a6b33603f231 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 19:01:22.631432 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9501fab7-eb24-4b09-9d89-399b1fb4f06f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:22.632503 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9501fab7-eb24-4b09-9d89-399b1fb4f06f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:22.640094 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9501fab7-eb24-4b09-9d89-399b1fb4f06f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:22.640612 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9501fab7-eb24-4b09-9d89-399b1fb4f06f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:22.641053 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9501fab7-eb24-4b09-9d89-399b1fb4f06f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:22.641771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9501fab7-eb24-4b09-9d89-399b1fb4f06f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:22.642367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9501fab7-eb24-4b09-9d89-399b1fb4f06f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:22.642800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9501fab7-eb24-4b09-9d89-399b1fb4f06f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:22.671663 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9501fab7-eb24-4b09-9d89-399b1fb4f06f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:01:22.676393 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4d0ca409-c63a-4a23-a5e7-9813d953ad5a tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:22.684412 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4d0ca409-c63a-4a23-a5e7-9813d953ad5a tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1476 microversion: 2.1 time: 0.137054 Oct 10 19:01:22.689411 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1236/2729] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:22 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1476 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:22.690776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:22.722196 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-9ea04b38-c319-4c6e-9b1a-4c529905890d req-59d2f008-8f79-43c1-9830-5551fcf34b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd4c6e16-56ef-4eb0-861f-f0da22f85d58", "name": "network-vif-deleted", "tag": "e9e14bef-c25f-4b3e-a8dc-fc782f23d82a"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:22.732099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-9ea04b38-c319-4c6e-9b1a-4c529905890d req-59d2f008-8f79-43c1-9830-5551fcf34b91 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:22.732814 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-9ea04b38-c319-4c6e-9b1a-4c529905890d req-59d2f008-8f79-43c1-9830-5551fcf34b91 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:22.733450 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-9ea04b38-c319-4c6e-9b1a-4c529905890d req-59d2f008-8f79-43c1-9830-5551fcf34b91 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:22.745662 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-9ea04b38-c319-4c6e-9b1a-4c529905890d req-59d2f008-8f79-43c1-9830-5551fcf34b91 service nova] Creating event network-vif-deleted:e9e14bef-c25f-4b3e-a8dc-fc782f23d82a for instance fd4c6e16-56ef-4eb0-861f-f0da22f85d58 on n-h1-860863-1 Oct 10 19:01:22.750730 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-9ea04b38-c319-4c6e-9b1a-4c529905890d req-59d2f008-8f79-43c1-9830-5551fcf34b91 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034595 Oct 10 19:01:22.751276 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1237/2730] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:22.919477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e12d4b27-04fc-4bac-92d7-420cff6a2f3b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:22.919477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e12d4b27-04fc-4bac-92d7-420cff6a2f3b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:22.926892 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e12d4b27-04fc-4bac-92d7-420cff6a2f3b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:22.927646 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e12d4b27-04fc-4bac-92d7-420cff6a2f3b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:22.928169 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e12d4b27-04fc-4bac-92d7-420cff6a2f3b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:22.929029 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e12d4b27-04fc-4bac-92d7-420cff6a2f3b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:22.929584 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e12d4b27-04fc-4bac-92d7-420cff6a2f3b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:22.930141 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e12d4b27-04fc-4bac-92d7-420cff6a2f3b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:23.043202 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9501fab7-eb24-4b09-9d89-399b1fb4f06f tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f" status: 204 len: 0 microversion: 2.1 time: 0.415670 Oct 10 19:01:23.047406 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1494/2731] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:01:22 2022] DELETE /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:01:23.055888 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7512d52e-8795-424e-a69e-47bb0199e0ff tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:23.056667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7512d52e-8795-424e-a69e-47bb0199e0ff tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:23.063542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7512d52e-8795-424e-a69e-47bb0199e0ff tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:23.064404 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7512d52e-8795-424e-a69e-47bb0199e0ff tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:23.065145 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7512d52e-8795-424e-a69e-47bb0199e0ff tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:23.066003 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7512d52e-8795-424e-a69e-47bb0199e0ff tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:23.067152 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7512d52e-8795-424e-a69e-47bb0199e0ff tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:23.067993 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7512d52e-8795-424e-a69e-47bb0199e0ff tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:23.134503 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e12d4b27-04fc-4bac-92d7-420cff6a2f3b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:23.146798 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e12d4b27-04fc-4bac-92d7-420cff6a2f3b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1309 microversion: 2.1 time: 0.232924 Oct 10 19:01:23.147620 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1238/2732] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:22 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1309 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:23.154083 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8a67fbff-ce9f-4e94-8363-e0121adb575b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:23.155082 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8a67fbff-ce9f-4e94-8363-e0121adb575b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:23.170835 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a67fbff-ce9f-4e94-8363-e0121adb575b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:23.171473 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a67fbff-ce9f-4e94-8363-e0121adb575b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:23.172125 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a67fbff-ce9f-4e94-8363-e0121adb575b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:23.174170 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a67fbff-ce9f-4e94-8363-e0121adb575b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:23.175451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a67fbff-ce9f-4e94-8363-e0121adb575b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:23.176583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8a67fbff-ce9f-4e94-8363-e0121adb575b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:23.258825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7512d52e-8795-424e-a69e-47bb0199e0ff tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:23.268317 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7512d52e-8795-424e-a69e-47bb0199e0ff tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.219416 Oct 10 19:01:23.269299 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1495/2733] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:23 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:23.280619 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c437a7d5-2d4a-41cf-a0f2-77ab6667af8c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:23.280619 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c437a7d5-2d4a-41cf-a0f2-77ab6667af8c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:23.283402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c437a7d5-2d4a-41cf-a0f2-77ab6667af8c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:23.283886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c437a7d5-2d4a-41cf-a0f2-77ab6667af8c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:23.284314 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c437a7d5-2d4a-41cf-a0f2-77ab6667af8c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:23.286193 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c437a7d5-2d4a-41cf-a0f2-77ab6667af8c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:23.286644 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c437a7d5-2d4a-41cf-a0f2-77ab6667af8c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:23.287221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c437a7d5-2d4a-41cf-a0f2-77ab6667af8c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:23.438190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c437a7d5-2d4a-41cf-a0f2-77ab6667af8c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:23.451068 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c437a7d5-2d4a-41cf-a0f2-77ab6667af8c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1334 microversion: 2.1 time: 0.180712 Oct 10 19:01:23.451676 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1496/2734] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:23 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1334 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:23.457551 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bca10fde-75d1-4ff4-aad5-5837da9acf12 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:23.461794 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bca10fde-75d1-4ff4-aad5-5837da9acf12 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:23.467791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bca10fde-75d1-4ff4-aad5-5837da9acf12 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:23.468424 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bca10fde-75d1-4ff4-aad5-5837da9acf12 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:23.468995 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bca10fde-75d1-4ff4-aad5-5837da9acf12 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:23.469841 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bca10fde-75d1-4ff4-aad5-5837da9acf12 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:23.470393 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bca10fde-75d1-4ff4-aad5-5837da9acf12 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:23.470943 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bca10fde-75d1-4ff4-aad5-5837da9acf12 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:23.622833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bca10fde-75d1-4ff4-aad5-5837da9acf12 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:23.631584 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bca10fde-75d1-4ff4-aad5-5837da9acf12 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.178837 Oct 10 19:01:23.632695 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1497/2735] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:23 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:23.637698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-bffd1aef-9c3c-4094-8774-255c09ff5266 req-e205266d-a3e2-486f-820c-4400483f7ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f8b3740-33b8-47a5-ada8-d3dd2ce3356a", "name": "network-vif-plugged", "status": "completed", "tag": "6a64c27f-e1a8-446d-9325-a7901a380021"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:23.648207 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-bffd1aef-9c3c-4094-8774-255c09ff5266 req-e205266d-a3e2-486f-820c-4400483f7ef7 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:23.649295 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-bffd1aef-9c3c-4094-8774-255c09ff5266 req-e205266d-a3e2-486f-820c-4400483f7ef7 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:23.649962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-bffd1aef-9c3c-4094-8774-255c09ff5266 req-e205266d-a3e2-486f-820c-4400483f7ef7 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:23.668640 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-bffd1aef-9c3c-4094-8774-255c09ff5266 req-e205266d-a3e2-486f-820c-4400483f7ef7 service nova] Creating event network-vif-plugged:6a64c27f-e1a8-446d-9325-a7901a380021 for instance 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a on n-h2-860863-1 Oct 10 19:01:23.673420 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-bffd1aef-9c3c-4094-8774-255c09ff5266 req-e205266d-a3e2-486f-820c-4400483f7ef7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039439 Oct 10 19:01:23.674026 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1498/2736] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:23.709622 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6b15481e-1f47-46fa-a919-3d9875e7b08e tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:23.710316 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6b15481e-1f47-46fa-a919-3d9875e7b08e tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:23.716685 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b15481e-1f47-46fa-a919-3d9875e7b08e tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:23.717363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b15481e-1f47-46fa-a919-3d9875e7b08e tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:23.718014 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b15481e-1f47-46fa-a919-3d9875e7b08e tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:23.718733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b15481e-1f47-46fa-a919-3d9875e7b08e tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:23.719186 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b15481e-1f47-46fa-a919-3d9875e7b08e tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:23.719611 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b15481e-1f47-46fa-a919-3d9875e7b08e tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:23.750022 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8a67fbff-ce9f-4e94-8363-e0121adb575b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:23.751718 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b15481e-1f47-46fa-a919-3d9875e7b08e tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:23.752207 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b15481e-1f47-46fa-a919-3d9875e7b08e tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:23.752665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b15481e-1f47-46fa-a919-3d9875e7b08e tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:23.753297 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-6b15481e-1f47-46fa-a919-3d9875e7b08e tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lazy-loading 'fault' on Instance uuid fd4c6e16-56ef-4eb0-861f-f0da22f85d58 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:01:23.761497 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8a67fbff-ce9f-4e94-8363-e0121adb575b tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f" status: 200 len: 1474 microversion: 2.1 time: 0.612775 Oct 10 19:01:23.762568 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1239/2737] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:23 2022] GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f => generated 1474 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:23.813852 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6b15481e-1f47-46fa-a919-3d9875e7b08e tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:23.821811 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6b15481e-1f47-46fa-a919-3d9875e7b08e tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1311 microversion: 2.1 time: 0.117079 Oct 10 19:01:23.822419 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1499/2738] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:23 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1311 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:24.170186 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7a8d2627-9a3b-4c4d-90a1-ad7e73a59d9b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:24.170794 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7a8d2627-9a3b-4c4d-90a1-ad7e73a59d9b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:24.176837 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7a8d2627-9a3b-4c4d-90a1-ad7e73a59d9b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:24.177317 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7a8d2627-9a3b-4c4d-90a1-ad7e73a59d9b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:24.177745 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7a8d2627-9a3b-4c4d-90a1-ad7e73a59d9b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:24.188944 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7a8d2627-9a3b-4c4d-90a1-ad7e73a59d9b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:24.188944 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7a8d2627-9a3b-4c4d-90a1-ad7e73a59d9b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:24.188944 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7a8d2627-9a3b-4c4d-90a1-ad7e73a59d9b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:24.292096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ac8d5dc4-d2c7-406f-a680-a571264be54b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:24.292791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ac8d5dc4-d2c7-406f-a680-a571264be54b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:24.298687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac8d5dc4-d2c7-406f-a680-a571264be54b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:24.299175 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac8d5dc4-d2c7-406f-a680-a571264be54b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:24.299615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac8d5dc4-d2c7-406f-a680-a571264be54b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:24.300313 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac8d5dc4-d2c7-406f-a680-a571264be54b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:24.300860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac8d5dc4-d2c7-406f-a680-a571264be54b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:24.301216 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ac8d5dc4-d2c7-406f-a680-a571264be54b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:24.319398 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7a8d2627-9a3b-4c4d-90a1-ad7e73a59d9b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:24.327975 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7a8d2627-9a3b-4c4d-90a1-ad7e73a59d9b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1309 microversion: 2.1 time: 0.161745 Oct 10 19:01:24.329033 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1240/2739] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:24 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1309 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:24.474502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a84f3c02-ad2a-46af-875c-cb8c61eb1367 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:24.475124 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a84f3c02-ad2a-46af-875c-cb8c61eb1367 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:24.481103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a84f3c02-ad2a-46af-875c-cb8c61eb1367 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:24.481672 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a84f3c02-ad2a-46af-875c-cb8c61eb1367 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:24.482012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a84f3c02-ad2a-46af-875c-cb8c61eb1367 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:24.482713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a84f3c02-ad2a-46af-875c-cb8c61eb1367 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:24.483174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a84f3c02-ad2a-46af-875c-cb8c61eb1367 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:24.483598 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a84f3c02-ad2a-46af-875c-cb8c61eb1367 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:24.553897 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ac8d5dc4-d2c7-406f-a680-a571264be54b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:24.565654 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ac8d5dc4-d2c7-406f-a680-a571264be54b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.277516 Oct 10 19:01:24.571812 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1500/2740] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:24 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:24.626853 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a84f3c02-ad2a-46af-875c-cb8c61eb1367 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:24.635675 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a84f3c02-ad2a-46af-875c-cb8c61eb1367 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1669 microversion: 2.1 time: 0.165079 Oct 10 19:01:24.648650 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1241/2741] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:24 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:24.655194 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2303022a-4905-4f1c-a8a7-1f96259bf4ed tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:24.655833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2303022a-4905-4f1c-a8a7-1f96259bf4ed tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:24.661959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2303022a-4905-4f1c-a8a7-1f96259bf4ed tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:24.662430 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2303022a-4905-4f1c-a8a7-1f96259bf4ed tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:24.662854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2303022a-4905-4f1c-a8a7-1f96259bf4ed tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:24.663801 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2303022a-4905-4f1c-a8a7-1f96259bf4ed tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:24.664241 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2303022a-4905-4f1c-a8a7-1f96259bf4ed tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:24.668507 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2303022a-4905-4f1c-a8a7-1f96259bf4ed tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:24.669383 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-941cdda8-7f06-4fe3-9b70-8210c445b6b3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:24.669878 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-941cdda8-7f06-4fe3-9b70-8210c445b6b3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:24.678097 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-941cdda8-7f06-4fe3-9b70-8210c445b6b3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:24.678579 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-941cdda8-7f06-4fe3-9b70-8210c445b6b3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:24.679003 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-941cdda8-7f06-4fe3-9b70-8210c445b6b3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:24.679689 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-941cdda8-7f06-4fe3-9b70-8210c445b6b3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:24.680141 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-941cdda8-7f06-4fe3-9b70-8210c445b6b3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:24.680567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-941cdda8-7f06-4fe3-9b70-8210c445b6b3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:24.723679 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-941cdda8-7f06-4fe3-9b70-8210c445b6b3 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769/ips" status: 200 len: 179 microversion: 2.1 time: 0.055863 Oct 10 19:01:24.730727 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1242/2742] 10.222.0.43 () {58 vars in 1248 bytes} [Mon Oct 10 19:01:24 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769/ips => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:24.735760 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b613ae22-600c-48d5-afbb-55c79b946101 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:24.740032 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b613ae22-600c-48d5-afbb-55c79b946101 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:24.742831 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b613ae22-600c-48d5-afbb-55c79b946101 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:24.743326 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b613ae22-600c-48d5-afbb-55c79b946101 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:24.744145 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b613ae22-600c-48d5-afbb-55c79b946101 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:24.744448 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b613ae22-600c-48d5-afbb-55c79b946101 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:24.744938 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b613ae22-600c-48d5-afbb-55c79b946101 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:24.745369 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b613ae22-600c-48d5-afbb-55c79b946101 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:24.771728 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b613ae22-600c-48d5-afbb-55c79b946101 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:01:24.957289 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2303022a-4905-4f1c-a8a7-1f96259bf4ed tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:24.973832 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2303022a-4905-4f1c-a8a7-1f96259bf4ed tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.322450 Oct 10 19:01:24.974605 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1501/2743] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:24 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:24.978895 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2bc59254-f53b-4ab7-865d-9a281914ec0d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:24.979500 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2bc59254-f53b-4ab7-865d-9a281914ec0d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:24.985620 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2bc59254-f53b-4ab7-865d-9a281914ec0d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:24.986315 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2bc59254-f53b-4ab7-865d-9a281914ec0d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:24.986894 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2bc59254-f53b-4ab7-865d-9a281914ec0d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:24.987751 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2bc59254-f53b-4ab7-865d-9a281914ec0d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:24.988959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2bc59254-f53b-4ab7-865d-9a281914ec0d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:24.989538 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2bc59254-f53b-4ab7-865d-9a281914ec0d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:25.022162 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b613ae22-600c-48d5-afbb-55c79b946101 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 204 len: 0 microversion: 2.1 time: 0.289898 Oct 10 19:01:25.023475 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1243/2744] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:01:24 2022] DELETE /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:01:25.028932 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-24b4d7cb-cc9c-4029-8590-86d2fa27c850 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:25.029965 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-24b4d7cb-cc9c-4029-8590-86d2fa27c850 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:25.037792 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24b4d7cb-cc9c-4029-8590-86d2fa27c850 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:25.038621 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24b4d7cb-cc9c-4029-8590-86d2fa27c850 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:25.039125 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24b4d7cb-cc9c-4029-8590-86d2fa27c850 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:25.039889 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24b4d7cb-cc9c-4029-8590-86d2fa27c850 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:25.040576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24b4d7cb-cc9c-4029-8590-86d2fa27c850 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:25.041606 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24b4d7cb-cc9c-4029-8590-86d2fa27c850 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:25.078820 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:25.082666 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24b4d7cb-cc9c-4029-8590-86d2fa27c850 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:25.083140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24b4d7cb-cc9c-4029-8590-86d2fa27c850 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:25.083576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-24b4d7cb-cc9c-4029-8590-86d2fa27c850 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:25.084033 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-24b4d7cb-cc9c-4029-8590-86d2fa27c850 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lazy-loading 'fault' on Instance uuid fd4c6e16-56ef-4eb0-861f-f0da22f85d58 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:01:25.135509 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-24b4d7cb-cc9c-4029-8590-86d2fa27c850 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:25.143796 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-24b4d7cb-cc9c-4029-8590-86d2fa27c850 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1311 microversion: 2.1 time: 0.118922 Oct 10 19:01:25.145273 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1244/2745] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:25 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1311 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:25.150092 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3802f575-583c-4873-bb4c-725a30ec5a6f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:25.150709 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3802f575-583c-4873-bb4c-725a30ec5a6f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:25.156345 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3802f575-583c-4873-bb4c-725a30ec5a6f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:25.156848 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3802f575-583c-4873-bb4c-725a30ec5a6f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:25.157273 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3802f575-583c-4873-bb4c-725a30ec5a6f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:25.157948 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3802f575-583c-4873-bb4c-725a30ec5a6f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:25.158389 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3802f575-583c-4873-bb4c-725a30ec5a6f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:25.158798 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3802f575-583c-4873-bb4c-725a30ec5a6f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:25.245121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2bc59254-f53b-4ab7-865d-9a281914ec0d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:25.253078 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2bc59254-f53b-4ab7-865d-9a281914ec0d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f" status: 200 len: 1474 microversion: 2.1 time: 0.277635 Oct 10 19:01:25.254273 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1502/2746] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:24 2022] GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f => generated 1474 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:25.306300 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3802f575-583c-4873-bb4c-725a30ec5a6f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:25.315490 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3802f575-583c-4873-bb4c-725a30ec5a6f tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1675 microversion: 2.1 time: 0.168875 Oct 10 19:01:25.316071 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1245/2747] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:25 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:25.351696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-523f79c7-0ce0-40b9-84ca-8818b148d6a6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:25.352304 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-523f79c7-0ce0-40b9-84ca-8818b148d6a6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:25.358402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-523f79c7-0ce0-40b9-84ca-8818b148d6a6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:25.358877 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-523f79c7-0ce0-40b9-84ca-8818b148d6a6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:25.359310 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-523f79c7-0ce0-40b9-84ca-8818b148d6a6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:25.359989 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-523f79c7-0ce0-40b9-84ca-8818b148d6a6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:25.360436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-523f79c7-0ce0-40b9-84ca-8818b148d6a6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:25.360877 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-523f79c7-0ce0-40b9-84ca-8818b148d6a6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:25.590356 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d53c3f62-885c-42bc-945a-ec4a4bfbdd96 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:25.590937 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d53c3f62-885c-42bc-945a-ec4a4bfbdd96 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:25.599209 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d53c3f62-885c-42bc-945a-ec4a4bfbdd96 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:25.599723 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d53c3f62-885c-42bc-945a-ec4a4bfbdd96 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:25.600165 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d53c3f62-885c-42bc-945a-ec4a4bfbdd96 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:25.600928 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d53c3f62-885c-42bc-945a-ec4a4bfbdd96 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:25.601384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d53c3f62-885c-42bc-945a-ec4a4bfbdd96 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:25.601813 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d53c3f62-885c-42bc-945a-ec4a4bfbdd96 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:25.746482 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d53c3f62-885c-42bc-945a-ec4a4bfbdd96 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:25.755268 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d53c3f62-885c-42bc-945a-ec4a4bfbdd96 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.169115 Oct 10 19:01:25.755841 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1246/2748] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:25 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:25.839999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-523f79c7-0ce0-40b9-84ca-8818b148d6a6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:25.847886 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-523f79c7-0ce0-40b9-84ca-8818b148d6a6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1491 microversion: 2.1 time: 0.500485 Oct 10 19:01:25.848471 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1503/2749] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:25 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1491 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:25.925222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3fe92560-ec91-4eef-b062-549f4584132b tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:25.926357 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3fe92560-ec91-4eef-b062-549f4584132b tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:25.932599 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe92560-ec91-4eef-b062-549f4584132b tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:25.933093 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe92560-ec91-4eef-b062-549f4584132b tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:25.933531 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe92560-ec91-4eef-b062-549f4584132b tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:25.934231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe92560-ec91-4eef-b062-549f4584132b tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:25.934721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe92560-ec91-4eef-b062-549f4584132b tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:25.935145 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3fe92560-ec91-4eef-b062-549f4584132b tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:25.939113 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:25.998833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-83a60cf5-a8f8-4652-b474-f583e6904931 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:25.999515 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-83a60cf5-a8f8-4652-b474-f583e6904931 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:26.008921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83a60cf5-a8f8-4652-b474-f583e6904931 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.009500 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83a60cf5-a8f8-4652-b474-f583e6904931 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.010128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83a60cf5-a8f8-4652-b474-f583e6904931 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.011180 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83a60cf5-a8f8-4652-b474-f583e6904931 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.011691 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83a60cf5-a8f8-4652-b474-f583e6904931 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.012346 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-83a60cf5-a8f8-4652-b474-f583e6904931 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.064203 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3fe92560-ec91-4eef-b062-549f4584132b tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1642 microversion: 2.1 time: 0.194709 Oct 10 19:01:26.064843 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1247/2750] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:25 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1642 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:26.086844 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-06530bf7-66ab-487a-a9cb-c64809051791 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:26.087449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-06530bf7-66ab-487a-a9cb-c64809051791 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:26.094194 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-06530bf7-66ab-487a-a9cb-c64809051791 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.094689 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-06530bf7-66ab-487a-a9cb-c64809051791 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.095130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-06530bf7-66ab-487a-a9cb-c64809051791 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.095816 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-06530bf7-66ab-487a-a9cb-c64809051791 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.096264 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-06530bf7-66ab-487a-a9cb-c64809051791 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.096713 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-06530bf7-66ab-487a-a9cb-c64809051791 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.229771 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-06530bf7-66ab-487a-a9cb-c64809051791 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1642 microversion: 2.1 time: 0.146909 Oct 10 19:01:26.230401 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1248/2751] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:26 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1642 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:26.234936 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-5b669453-f8eb-4cc2-8adc-915dc0a5c378 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:26.235544 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-5b669453-f8eb-4cc2-8adc-915dc0a5c378 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:26.242931 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b669453-f8eb-4cc2-8adc-915dc0a5c378 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.243409 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b669453-f8eb-4cc2-8adc-915dc0a5c378 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.243840 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b669453-f8eb-4cc2-8adc-915dc0a5c378 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.244553 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b669453-f8eb-4cc2-8adc-915dc0a5c378 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.245777 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b669453-f8eb-4cc2-8adc-915dc0a5c378 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.246210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b669453-f8eb-4cc2-8adc-915dc0a5c378 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.264578 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-83a60cf5-a8f8-4652-b474-f583e6904931 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:26.267807 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-83a60cf5-a8f8-4652-b474-f583e6904931 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.273022 Oct 10 19:01:26.268388 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1504/2752] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:25 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:26.272955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5fe1e1b5-4c22-4487-ab06-633e3bf0e519 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:26.276714 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5fe1e1b5-4c22-4487-ab06-633e3bf0e519 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.277379 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5fe1e1b5-4c22-4487-ab06-633e3bf0e519 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.277973 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5fe1e1b5-4c22-4487-ab06-633e3bf0e519 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.279122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5fe1e1b5-4c22-4487-ab06-633e3bf0e519 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.279716 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5fe1e1b5-4c22-4487-ab06-633e3bf0e519 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.280298 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5fe1e1b5-4c22-4487-ab06-633e3bf0e519 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.290324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b669453-f8eb-4cc2-8adc-915dc0a5c378 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.290807 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b669453-f8eb-4cc2-8adc-915dc0a5c378 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.291559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-5b669453-f8eb-4cc2-8adc-915dc0a5c378 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.291708 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-5b669453-f8eb-4cc2-8adc-915dc0a5c378 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lazy-loading 'fault' on Instance uuid fd4c6e16-56ef-4eb0-861f-f0da22f85d58 {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:01:26.306757 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5fe1e1b5-4c22-4487-ab06-633e3bf0e519 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.037087 Oct 10 19:01:26.307366 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1505/2753] 10.222.0.43 () {58 vars in 1176 bytes} [Mon Oct 10 19:01:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:26.314838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c7bea567-acc1-4974-9d06-1b0c02103c3d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:26.314838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c7bea567-acc1-4974-9d06-1b0c02103c3d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:26.321932 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7bea567-acc1-4974-9d06-1b0c02103c3d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.322417 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7bea567-acc1-4974-9d06-1b0c02103c3d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.322854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7bea567-acc1-4974-9d06-1b0c02103c3d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.323550 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7bea567-acc1-4974-9d06-1b0c02103c3d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.324104 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7bea567-acc1-4974-9d06-1b0c02103c3d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.324665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c7bea567-acc1-4974-9d06-1b0c02103c3d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.338927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-5b669453-f8eb-4cc2-8adc-915dc0a5c378 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb4474eb77141ce942d1ad170fee56b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94e8833aa35458ea401de2ae6b0ba12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:26.347052 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-5b669453-f8eb-4cc2-8adc-915dc0a5c378 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 200 len: 1311 microversion: 2.1 time: 0.115680 Oct 10 19:01:26.348178 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1249/2754] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:26 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:26.354233 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-56938061-fe0b-4b99-b000-02d51417cd91 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860863-1", "block_migration": true, "disk_over_commit": false}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:26.356199 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-56938061-fe0b-4b99-b000-02d51417cd91 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:26.362812 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56938061-fe0b-4b99-b000-02d51417cd91 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.363879 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56938061-fe0b-4b99-b000-02d51417cd91 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.364311 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56938061-fe0b-4b99-b000-02d51417cd91 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.365027 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56938061-fe0b-4b99-b000-02d51417cd91 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.365526 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56938061-fe0b-4b99-b000-02d51417cd91 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.365913 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-56938061-fe0b-4b99-b000-02d51417cd91 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.391502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-56938061-fe0b-4b99-b000-02d51417cd91 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lazy-loading 'flavor' on Instance uuid 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:01:26.403502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-56938061-fe0b-4b99-b000-02d51417cd91 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Going to try to live migrate instance to n-h1-860863-1 {{(pid=127289) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 19:01:26.514774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c7bea567-acc1-4974-9d06-1b0c02103c3d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:26.522698 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c7bea567-acc1-4974-9d06-1b0c02103c3d tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f" status: 200 len: 1474 microversion: 2.1 time: 0.212975 Oct 10 19:01:26.523271 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1506/2755] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:26 2022] GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f => generated 1474 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:26.527896 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4b07b755-580d-4066-a46c-b0189e1db976 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:26.528525 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4b07b755-580d-4066-a46c-b0189e1db976 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:26.534504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b07b755-580d-4066-a46c-b0189e1db976 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.535484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b07b755-580d-4066-a46c-b0189e1db976 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.535995 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b07b755-580d-4066-a46c-b0189e1db976 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.536714 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b07b755-580d-4066-a46c-b0189e1db976 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.537159 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b07b755-580d-4066-a46c-b0189e1db976 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.537637 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4b07b755-580d-4066-a46c-b0189e1db976 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.783074 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4b07b755-580d-4066-a46c-b0189e1db976 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:26.800870 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4b07b755-580d-4066-a46c-b0189e1db976 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1675 microversion: 2.1 time: 0.276387 Oct 10 19:01:26.801520 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1507/2756] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:26 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1675 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:26.819342 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ed62a18a-e7c3-4d30-ad7c-107948176ad4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:26.822060 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ed62a18a-e7c3-4d30-ad7c-107948176ad4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:26.831542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed62a18a-e7c3-4d30-ad7c-107948176ad4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.832938 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed62a18a-e7c3-4d30-ad7c-107948176ad4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.834980 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed62a18a-e7c3-4d30-ad7c-107948176ad4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:26.834980 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed62a18a-e7c3-4d30-ad7c-107948176ad4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:26.835306 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed62a18a-e7c3-4d30-ad7c-107948176ad4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:26.836107 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed62a18a-e7c3-4d30-ad7c-107948176ad4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:27.142536 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ed62a18a-e7c3-4d30-ad7c-107948176ad4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:27.151547 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ed62a18a-e7c3-4d30-ad7c-107948176ad4 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.348968 Oct 10 19:01:27.152190 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1508/2757] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:26 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:27.156687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-400221ce-432f-4857-bb87-ecb669bb64f5 req-a8744903-5515-428b-82d1-05b6f07425ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f", "name": "network-vif-deleted", "tag": "5bffc937-d058-4e1d-89e3-1fcc517f98e7"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:27.166443 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-400221ce-432f-4857-bb87-ecb669bb64f5 req-a8744903-5515-428b-82d1-05b6f07425ca service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:27.167816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-400221ce-432f-4857-bb87-ecb669bb64f5 req-a8744903-5515-428b-82d1-05b6f07425ca service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:27.167816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-400221ce-432f-4857-bb87-ecb669bb64f5 req-a8744903-5515-428b-82d1-05b6f07425ca service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:27.178871 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-400221ce-432f-4857-bb87-ecb669bb64f5 req-a8744903-5515-428b-82d1-05b6f07425ca service nova] Creating event network-vif-deleted:5bffc937-d058-4e1d-89e3-1fcc517f98e7 for instance bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f on n-h1-860863-1 Oct 10 19:01:27.183726 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-400221ce-432f-4857-bb87-ecb669bb64f5 req-a8744903-5515-428b-82d1-05b6f07425ca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030456 Oct 10 19:01:27.185228 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1509/2758] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:27.294848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a828bca9-a095-4f4f-91fd-37fa6a50ebd8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:27.295599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a828bca9-a095-4f4f-91fd-37fa6a50ebd8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:27.302707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a828bca9-a095-4f4f-91fd-37fa6a50ebd8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:27.303302 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a828bca9-a095-4f4f-91fd-37fa6a50ebd8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:27.303814 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a828bca9-a095-4f4f-91fd-37fa6a50ebd8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:27.304656 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a828bca9-a095-4f4f-91fd-37fa6a50ebd8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:27.305288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a828bca9-a095-4f4f-91fd-37fa6a50ebd8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:27.305707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a828bca9-a095-4f4f-91fd-37fa6a50ebd8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:27.514344 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a828bca9-a095-4f4f-91fd-37fa6a50ebd8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:27.531622 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a828bca9-a095-4f4f-91fd-37fa6a50ebd8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.240966 Oct 10 19:01:27.540526 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1510/2759] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:27 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:27.540526 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d42a587e-0187-4839-802a-4acb1059aa97 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:27.540526 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d42a587e-0187-4839-802a-4acb1059aa97 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] [instance: fd4c6e16-56ef-4eb0-861f-f0da22f85d58] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:27.552438 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d42a587e-0187-4839-802a-4acb1059aa97 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:27.553282 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d42a587e-0187-4839-802a-4acb1059aa97 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:27.554689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d42a587e-0187-4839-802a-4acb1059aa97 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:27.555473 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d42a587e-0187-4839-802a-4acb1059aa97 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:27.555939 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d42a587e-0187-4839-802a-4acb1059aa97 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:27.556364 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d42a587e-0187-4839-802a-4acb1059aa97 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-d42a587e-0187-4839-802a-4acb1059aa97 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] HTTP exception thrown: Instance fd4c6e16-56ef-4eb0-861f-f0da22f85d58 could not be found. Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d42a587e-0187-4839-802a-4acb1059aa97 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Request method failure captured: Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 HTTP/1.1 Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGueH1yj21OQo9spusNJ86KnqFGIUj5d__eOxFQuzC6ysNCVkuLFuO6i5WdrNvBH3JldTDtY_DnZzsiE4gC2AETI6PsxyEazOFGR7YrKnyLT2LZQKrJT6sLNQSIfdHlBcXbD9A0cyPY4wqWAtzRaL2dvNv9jbecxksv_Sbu3bEQAxvI Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: b94e8833aa35458ea401de2ae6b0ba12 Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ListServerFiltersTestJSON-110530514 Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b94e8833aa35458ea401de2ae6b0ba12", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b94e8833aa35458ea401de2ae6b0ba12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b94e8833aa35458ea401de2ae6b0ba12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b94e8833aa35458ea401de2ae6b0ba12"}]}] Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ListServerFiltersTestJSON-110530514 Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: b94e8833aa35458ea401de2ae6b0ba12 Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-110530514 Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ListServerFiltersTestJSON-110530514-project Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: adb4474eb77141ce942d1ad170fee56b Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ListServerFiltersTestJSON-110530514-project Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance fd4c6e16-56ef-4eb0-861f-f0da22f85d58 could not be found. Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'fd4c6e16-56ef-4eb0-861f-f0da22f85d58'} Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd4c6e16-56ef-4eb0-861f-f0da22f85d58 could not be found. Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:01:27.574875 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:01:27.579516 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd4c6e16-56ef-4eb0-861f-f0da22f85d58 could not be found. Oct 10 19:01:27.579516 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:27.579516 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:27.579516 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:27.579516 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:27.579516 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:27.579516 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:27.579516 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:01:27.579516 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:01:27.579516 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd4c6e16-56ef-4eb0-861f-f0da22f85d58 could not be found. Oct 10 19:01:27.579516 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:27.579516 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d42a587e-0187-4839-802a-4acb1059aa97 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] Returning 404 to user: Instance fd4c6e16-56ef-4eb0-861f-f0da22f85d58 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:01:27.579516 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d42a587e-0187-4839-802a-4acb1059aa97 tempest-ListServerFiltersTestJSON-110530514 tempest-ListServerFiltersTestJSON-110530514-project] 10.222.0.43 "GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58" status: 404 len: 111 microversion: 2.1 time: 0.042409 Oct 10 19:01:27.580509 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1511/2760] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:27 2022] GET /compute/v2.1/servers/fd4c6e16-56ef-4eb0-861f-f0da22f85d58 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:01:27.584744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-22c91468-d0c2-43f0-8807-82e991f03983 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:27.585699 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-22c91468-d0c2-43f0-8807-82e991f03983 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:27.592170 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c91468-d0c2-43f0-8807-82e991f03983 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:27.593059 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c91468-d0c2-43f0-8807-82e991f03983 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:27.593655 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c91468-d0c2-43f0-8807-82e991f03983 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:27.594531 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c91468-d0c2-43f0-8807-82e991f03983 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:27.597837 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c91468-d0c2-43f0-8807-82e991f03983 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:27.597837 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c91468-d0c2-43f0-8807-82e991f03983 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:27.666064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:27.681222 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c91468-d0c2-43f0-8807-82e991f03983 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:27.682758 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c91468-d0c2-43f0-8807-82e991f03983 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:27.683690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22c91468-d0c2-43f0-8807-82e991f03983 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:27.684305 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-22c91468-d0c2-43f0-8807-82e991f03983 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lazy-loading 'fault' on Instance uuid bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:01:27.809792 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-22c91468-d0c2-43f0-8807-82e991f03983 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e36772b0f87c46b2b31d642729e02b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d197e4831748d9a1d12e4a3b44629d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:27.824048 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-22c91468-d0c2-43f0-8807-82e991f03983 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f" status: 200 len: 1308 microversion: 2.1 time: 0.243025 Oct 10 19:01:27.840177 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1512/2761] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:27 2022] GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:27.840177 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-be89efea-bcd2-459d-81f0-3c2b1a3fb91a req-d7cea18c-6c7d-4ddd-b212-b9d4c19c1abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769", "name": "network-vif-deleted", "tag": "29dca69a-b2eb-4806-8479-4da7220dc095"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:27.860238 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-be89efea-bcd2-459d-81f0-3c2b1a3fb91a req-d7cea18c-6c7d-4ddd-b212-b9d4c19c1abb service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:27.860771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-be89efea-bcd2-459d-81f0-3c2b1a3fb91a req-d7cea18c-6c7d-4ddd-b212-b9d4c19c1abb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:27.861327 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-be89efea-bcd2-459d-81f0-3c2b1a3fb91a req-d7cea18c-6c7d-4ddd-b212-b9d4c19c1abb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:27.874610 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-be89efea-bcd2-459d-81f0-3c2b1a3fb91a req-d7cea18c-6c7d-4ddd-b212-b9d4c19c1abb service nova] Creating event network-vif-deleted:29dca69a-b2eb-4806-8479-4da7220dc095 for instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 on n-h1-860863-1 Oct 10 19:01:27.879521 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-be89efea-bcd2-459d-81f0-3c2b1a3fb91a req-d7cea18c-6c7d-4ddd-b212-b9d4c19c1abb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053012 Oct 10 19:01:27.883367 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1513/2762] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:27.889011 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-92720e7d-ea86-4c5e-a57e-aff262b40c2c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:27.889725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-92720e7d-ea86-4c5e-a57e-aff262b40c2c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:27.896278 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92720e7d-ea86-4c5e-a57e-aff262b40c2c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:27.896814 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92720e7d-ea86-4c5e-a57e-aff262b40c2c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:27.897252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92720e7d-ea86-4c5e-a57e-aff262b40c2c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:27.897962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92720e7d-ea86-4c5e-a57e-aff262b40c2c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:27.898417 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92720e7d-ea86-4c5e-a57e-aff262b40c2c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:27.898839 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-92720e7d-ea86-4c5e-a57e-aff262b40c2c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:28.031467 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-92720e7d-ea86-4c5e-a57e-aff262b40c2c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:28.040481 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-92720e7d-ea86-4c5e-a57e-aff262b40c2c tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1654 microversion: 2.1 time: 0.155878 Oct 10 19:01:28.041071 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1514/2763] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:27 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:28.174998 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-62bc5c5b-4692-43b0-a6b8-cea81d338361 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:28.180822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-62bc5c5b-4692-43b0-a6b8-cea81d338361 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:28.182327 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-62bc5c5b-4692-43b0-a6b8-cea81d338361 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:28.182880 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-62bc5c5b-4692-43b0-a6b8-cea81d338361 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:28.183384 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-62bc5c5b-4692-43b0-a6b8-cea81d338361 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:28.184157 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-62bc5c5b-4692-43b0-a6b8-cea81d338361 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:28.184737 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-62bc5c5b-4692-43b0-a6b8-cea81d338361 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:28.185357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-62bc5c5b-4692-43b0-a6b8-cea81d338361 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:28.478567 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-62bc5c5b-4692-43b0-a6b8-cea81d338361 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:28.486929 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-62bc5c5b-4692-43b0-a6b8-cea81d338361 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.315958 Oct 10 19:01:28.492382 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1515/2764] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:28 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:28.561546 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-18711feb-57af-4558-bffb-15c492929910 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:28.562813 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-18711feb-57af-4558-bffb-15c492929910 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:28.581288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-18711feb-57af-4558-bffb-15c492929910 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:28.581861 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-18711feb-57af-4558-bffb-15c492929910 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:28.585134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-18711feb-57af-4558-bffb-15c492929910 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:28.589496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-18711feb-57af-4558-bffb-15c492929910 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:28.590163 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-18711feb-57af-4558-bffb-15c492929910 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:28.590928 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-18711feb-57af-4558-bffb-15c492929910 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:28.868097 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-18711feb-57af-4558-bffb-15c492929910 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:28.877693 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-18711feb-57af-4558-bffb-15c492929910 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.323874 Oct 10 19:01:28.878595 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1516/2765] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:28 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:28.886589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f4b3878b-b570-4fc4-a1c6-339d3a9f89c2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:28.887454 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f4b3878b-b570-4fc4-a1c6-339d3a9f89c2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] [instance: bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:28.909190 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4b3878b-b570-4fc4-a1c6-339d3a9f89c2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:28.912940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4b3878b-b570-4fc4-a1c6-339d3a9f89c2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:28.914036 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4b3878b-b570-4fc4-a1c6-339d3a9f89c2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:28.915158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4b3878b-b570-4fc4-a1c6-339d3a9f89c2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:28.915814 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4b3878b-b570-4fc4-a1c6-339d3a9f89c2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:28.916440 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f4b3878b-b570-4fc4-a1c6-339d3a9f89c2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:28.946500 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-f4b3878b-b570-4fc4-a1c6-339d3a9f89c2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] HTTP exception thrown: Instance bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f could not be found. Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f4b3878b-b570-4fc4-a1c6-339d3a9f89c2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Request method failure captured: Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f HTTP/1.1 Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGtX3GbBV5P58ePv_WO3aCDWERPqap_ORyR0bMBZKcOSIn9BfybCJ0GYj2viHGyFlTL_1qzoqn-SXZC_HIkkNEkSiSiImeF40jnqdXNA8jGeSzTdygrysJNoe7iqWUUKVfQ3VKk7nJEphOt07scthpZok1BbjYyuAzQIJFBqHicXHPU Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 77d197e4831748d9a1d12e4a3b44629d Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ListImageFiltersTestJSON-1667161161 Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_77d197e4831748d9a1d12e4a3b44629d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/77d197e4831748d9a1d12e4a3b44629d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77d197e4831748d9a1d12e4a3b44629d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77d197e4831748d9a1d12e4a3b44629d"}]}] Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ListImageFiltersTestJSON-1667161161 Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 77d197e4831748d9a1d12e4a3b44629d Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1667161161 Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ListImageFiltersTestJSON-1667161161-project Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: e36772b0f87c46b2b31d642729e02b50 Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ListImageFiltersTestJSON-1667161161-project Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f could not be found. Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f'} Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f could not be found. Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f could not be found. Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:28.952285 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:28.962715 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:28.962715 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:28.962715 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:28.962715 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:01:28.962715 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:01:28.962715 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f could not be found. Oct 10 19:01:28.962715 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:28.962715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f4b3878b-b570-4fc4-a1c6-339d3a9f89c2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Returning 404 to user: Instance bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:01:28.962715 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f4b3878b-b570-4fc4-a1c6-339d3a9f89c2 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f" status: 404 len: 111 microversion: 2.1 time: 0.074239 Oct 10 19:01:28.962715 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1517/2766] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:28 2022] GET /compute/v2.1/servers/bb9d2ea5-56c8-42f6-b3a2-83501eaa3d8f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:01:28.986863 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3a20d929-45cd-4a69-ae1f-2d3c17a27ae0 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d4feaf0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:29.621616 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3a20d929-45cd-4a69-ae1f-2d3c17a27ae0 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "DELETE /compute/v2.1/images/ed1e231c-b66d-47cf-afc8-4077037f9550" status: 204 len: 0 microversion: 2.1 time: 0.662057 Oct 10 19:01:29.625642 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1518/2767] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:28 2022] DELETE /compute/v2.1/images/ed1e231c-b66d-47cf-afc8-4077037f9550 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 10 19:01:29.631516 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7ca1b7f4-6250-43a2-9666-7623a29c4e15 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:29.632137 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7ca1b7f4-6250-43a2-9666-7623a29c4e15 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:29.639615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ca1b7f4-6250-43a2-9666-7623a29c4e15 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:29.640351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ca1b7f4-6250-43a2-9666-7623a29c4e15 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:29.641046 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ca1b7f4-6250-43a2-9666-7623a29c4e15 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:29.642021 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ca1b7f4-6250-43a2-9666-7623a29c4e15 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:29.642847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ca1b7f4-6250-43a2-9666-7623a29c4e15 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:29.643497 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ca1b7f4-6250-43a2-9666-7623a29c4e15 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:29.689774 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ca1b7f4-6250-43a2-9666-7623a29c4e15 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:29.690269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ca1b7f4-6250-43a2-9666-7623a29c4e15 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:29.690705 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7ca1b7f4-6250-43a2-9666-7623a29c4e15 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:29.691181 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-7ca1b7f4-6250-43a2-9666-7623a29c4e15 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lazy-loading 'fault' on Instance uuid 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:01:29.958248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7ca1b7f4-6250-43a2-9666-7623a29c4e15 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d2fecfd1eb43dc9e050393017dede3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1206fcb7f08f4c09a019a4a560ccac71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:29.966766 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7ca1b7f4-6250-43a2-9666-7623a29c4e15 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 200 len: 1303 microversion: 2.1 time: 0.340079 Oct 10 19:01:29.967379 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1519/2768] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:29 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 1303 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:29.972030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-76cd4c7c-4a53-4afc-89b7-ed214a616bdd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:29.972824 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-76cd4c7c-4a53-4afc-89b7-ed214a616bdd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:29.978885 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-76cd4c7c-4a53-4afc-89b7-ed214a616bdd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:29.979490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-76cd4c7c-4a53-4afc-89b7-ed214a616bdd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:29.980501 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-76cd4c7c-4a53-4afc-89b7-ed214a616bdd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:29.981377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-76cd4c7c-4a53-4afc-89b7-ed214a616bdd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:29.981979 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-76cd4c7c-4a53-4afc-89b7-ed214a616bdd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:29.982550 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-76cd4c7c-4a53-4afc-89b7-ed214a616bdd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:30.179602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-76cd4c7c-4a53-4afc-89b7-ed214a616bdd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:30.184831 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-56938061-fe0b-4b99-b000-02d51417cd91 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a/action" status: 202 len: 0 microversion: 2.1 time: 3.834374 Oct 10 19:01:30.187725 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1250/2769] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:01:26 2022] POST /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a/action => generated 0 bytes in 3837 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 19:01:30.191377 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-76cd4c7c-4a53-4afc-89b7-ed214a616bdd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.222744 Oct 10 19:01:30.191845 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1bca024c-973e-4240-9355-752f00314ca8 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318dbbd700>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:30.191970 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1520/2770] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:29 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:30.196428 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-1d2a3646-2f78-4a5d-859e-5b5a6aa2efff req-aaac8947-169d-4d93-a406-17bf934c9aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769", "name": "network-vif-deleted", "tag": "b1c8c0c4-18f0-46ad-862b-c045e504c56e"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:30.211092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1d2a3646-2f78-4a5d-859e-5b5a6aa2efff req-aaac8947-169d-4d93-a406-17bf934c9aa4 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:30.213193 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1d2a3646-2f78-4a5d-859e-5b5a6aa2efff req-aaac8947-169d-4d93-a406-17bf934c9aa4 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:30.213193 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1d2a3646-2f78-4a5d-859e-5b5a6aa2efff req-aaac8947-169d-4d93-a406-17bf934c9aa4 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:30.231322 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-1d2a3646-2f78-4a5d-859e-5b5a6aa2efff req-aaac8947-169d-4d93-a406-17bf934c9aa4 service nova] Creating event network-vif-deleted:b1c8c0c4-18f0-46ad-862b-c045e504c56e for instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 on n-h1-860863-1 Oct 10 19:01:30.241290 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-1d2a3646-2f78-4a5d-859e-5b5a6aa2efff req-aaac8947-169d-4d93-a406-17bf934c9aa4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047902 Oct 10 19:01:30.245014 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1521/2771] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:30.247989 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6b229b02-e42f-4b66-adfb-861f7aacbe04 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:30.249150 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6b229b02-e42f-4b66-adfb-861f7aacbe04 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:30.256225 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b229b02-e42f-4b66-adfb-861f7aacbe04 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:30.256957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b229b02-e42f-4b66-adfb-861f7aacbe04 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:30.257443 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b229b02-e42f-4b66-adfb-861f7aacbe04 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:30.258063 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b229b02-e42f-4b66-adfb-861f7aacbe04 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:30.258850 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b229b02-e42f-4b66-adfb-861f7aacbe04 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:30.259985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b229b02-e42f-4b66-adfb-861f7aacbe04 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:30.508227 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6b229b02-e42f-4b66-adfb-861f7aacbe04 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:30.524204 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6b229b02-e42f-4b66-adfb-861f7aacbe04 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.280794 Oct 10 19:01:30.524985 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1522/2772] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:30 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:30.535623 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f594337d-5ea8-4530-be76-5b30101da136 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:30.536519 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f594337d-5ea8-4530-be76-5b30101da136 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:30.543418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f594337d-5ea8-4530-be76-5b30101da136 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:30.544023 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f594337d-5ea8-4530-be76-5b30101da136 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:30.548006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f594337d-5ea8-4530-be76-5b30101da136 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:30.549344 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f594337d-5ea8-4530-be76-5b30101da136 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:30.551505 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f594337d-5ea8-4530-be76-5b30101da136 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:30.552790 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f594337d-5ea8-4530-be76-5b30101da136 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:30.725330 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f594337d-5ea8-4530-be76-5b30101da136 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:30.735119 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f594337d-5ea8-4530-be76-5b30101da136 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1501 microversion: 2.1 time: 0.208797 Oct 10 19:01:30.736151 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1523/2773] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:30 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1501 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:30.867523 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1bca024c-973e-4240-9355-752f00314ca8 tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "DELETE /compute/v2.1/images/3024ac6e-7e3d-458c-af29-f7284129d81e" status: 204 len: 0 microversion: 2.1 time: 0.679855 Oct 10 19:01:30.867751 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1251/2774] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:30 2022] DELETE /compute/v2.1/images/3024ac6e-7e3d-458c-af29-f7284129d81e => generated 0 bytes in 681 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:01:30.877281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-edf185f9-79c9-4fb3-b335-e1191647253a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] Calling method '.version_select at 0x7f318d188dc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:30.990538 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c637e02a-0212-403b-a868-768006c04aeb tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:30.991559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c637e02a-0212-403b-a868-768006c04aeb tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:30.998174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c637e02a-0212-403b-a868-768006c04aeb tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:30.999567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c637e02a-0212-403b-a868-768006c04aeb tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:30.999567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c637e02a-0212-403b-a868-768006c04aeb tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:31.000168 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c637e02a-0212-403b-a868-768006c04aeb tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:31.000736 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c637e02a-0212-403b-a868-768006c04aeb tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:31.001242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c637e02a-0212-403b-a868-768006c04aeb tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:31.015896 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-c637e02a-0212-403b-a868-768006c04aeb tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] HTTP exception thrown: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c637e02a-0212-403b-a868-768006c04aeb tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Request method failure captured: Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 HTTP/1.1 Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGuO9V3CgMSt_l3JlD1RVQ4jd_M2uydLQLknLZT3pCKpJggVJyLLFaiF-k23VPd26y-i0lrktud9P1XZQ2CoLjc-1F0yzFH-zOPSgmZVi_zSdIbVOJi3CZIulBWpypaNz5QR0KZGLG-mREGURmSAP_GluiMr7lKFdocUKnauWYWJ82E Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 1206fcb7f08f4c09a019a4a560ccac71 Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1206fcb7f08f4c09a019a4a560ccac71", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1206fcb7f08f4c09a019a4a560ccac71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1206fcb7f08f4c09a019a4a560ccac71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1206fcb7f08f4c09a019a4a560ccac71"}]}] Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 1206fcb7f08f4c09a019a4a560ccac71 Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersTestMultiNic-447712075-project Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: f5d2fecfd1eb43dc9e050393017dede3 Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersTestMultiNic-447712075-project Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769'} Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:31.017664 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:31.029217 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:31.029217 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:31.029217 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:31.029217 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:01:31.029217 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:01:31.029217 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:31.029217 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:31.029217 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c637e02a-0212-403b-a868-768006c04aeb tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Returning 404 to user: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:01:31.029217 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c637e02a-0212-403b-a868-768006c04aeb tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 404 len: 111 microversion: 2.1 time: 0.035489 Oct 10 19:01:31.029217 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1252/2775] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:30 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:01:31.221728 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6a411c9a-188a-4f75-9ac2-18a77cda3b8e tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:31.223250 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6a411c9a-188a-4f75-9ac2-18a77cda3b8e tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:31.232418 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a411c9a-188a-4f75-9ac2-18a77cda3b8e tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:31.233420 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a411c9a-188a-4f75-9ac2-18a77cda3b8e tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:31.234211 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a411c9a-188a-4f75-9ac2-18a77cda3b8e tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:31.235147 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a411c9a-188a-4f75-9ac2-18a77cda3b8e tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:31.236012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a411c9a-188a-4f75-9ac2-18a77cda3b8e tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:31.237062 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6a411c9a-188a-4f75-9ac2-18a77cda3b8e tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:31.405979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6a411c9a-188a-4f75-9ac2-18a77cda3b8e tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:31.415699 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6a411c9a-188a-4f75-9ac2-18a77cda3b8e tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.198566 Oct 10 19:01:31.416276 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1253/2776] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:31 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:31.563789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-44fd4670-00b4-483d-ab29-dabd9e53b8ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:31.564414 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-44fd4670-00b4-483d-ab29-dabd9e53b8ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:31.571776 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44fd4670-00b4-483d-ab29-dabd9e53b8ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:31.572272 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44fd4670-00b4-483d-ab29-dabd9e53b8ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:31.572957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44fd4670-00b4-483d-ab29-dabd9e53b8ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:31.573888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44fd4670-00b4-483d-ab29-dabd9e53b8ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:31.574345 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44fd4670-00b4-483d-ab29-dabd9e53b8ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:31.583481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-44fd4670-00b4-483d-ab29-dabd9e53b8ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:31.943128 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-44fd4670-00b4-483d-ab29-dabd9e53b8ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:31.955255 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-44fd4670-00b4-483d-ab29-dabd9e53b8ca tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.396022 Oct 10 19:01:31.957640 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1254/2777] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:31 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:31.963934 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f0a921c7-451d-4e72-b7f4-aa4a926b8925 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:31.965495 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f0a921c7-451d-4e72-b7f4-aa4a926b8925 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:32.007366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0a921c7-451d-4e72-b7f4-aa4a926b8925 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:32.012638 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0a921c7-451d-4e72-b7f4-aa4a926b8925 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:32.013400 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0a921c7-451d-4e72-b7f4-aa4a926b8925 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:32.014450 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0a921c7-451d-4e72-b7f4-aa4a926b8925 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:32.020511 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0a921c7-451d-4e72-b7f4-aa4a926b8925 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:32.020511 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0a921c7-451d-4e72-b7f4-aa4a926b8925 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:32.297436 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-edf185f9-79c9-4fb3-b335-e1191647253a tempest-ListImageFiltersTestJSON-1667161161 tempest-ListImageFiltersTestJSON-1667161161-project] 10.222.0.43 "DELETE /compute/v2.1/images/2ca1f23d-20e0-4ce0-8bd4-9e3d3f0c5fbf" status: 204 len: 0 microversion: 2.1 time: 1.425326 Oct 10 19:01:32.302158 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1524/2778] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:30 2022] DELETE /compute/v2.1/images/2ca1f23d-20e0-4ce0-8bd4-9e3d3f0c5fbf => generated 0 bytes in 1427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:01:32.408111 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f0a921c7-451d-4e72-b7f4-aa4a926b8925 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:32.430308 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f0a921c7-451d-4e72-b7f4-aa4a926b8925 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1501 microversion: 2.1 time: 0.469615 Oct 10 19:01:32.432056 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1255/2779] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:31 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1501 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:32.452708 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-49f9452f-dcf7-478b-bacb-322ddabf02fd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:32.452708 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-49f9452f-dcf7-478b-bacb-322ddabf02fd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:32.469370 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-49f9452f-dcf7-478b-bacb-322ddabf02fd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:32.470094 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-49f9452f-dcf7-478b-bacb-322ddabf02fd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:32.470658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-49f9452f-dcf7-478b-bacb-322ddabf02fd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:32.473539 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-49f9452f-dcf7-478b-bacb-322ddabf02fd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:32.477772 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-49f9452f-dcf7-478b-bacb-322ddabf02fd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:32.477772 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-49f9452f-dcf7-478b-bacb-322ddabf02fd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:32.516378 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-dc607ca2-ba6d-410a-a67f-1c0c57bde899 req-f0311328-8ff7-4d9d-a4cd-271c66d0e1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f8b3740-33b8-47a5-ada8-d3dd2ce3356a", "name": "network-vif-unplugged", "status": "completed", "tag": "6a64c27f-e1a8-446d-9325-a7901a380021"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:32.526567 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-dc607ca2-ba6d-410a-a67f-1c0c57bde899 req-f0311328-8ff7-4d9d-a4cd-271c66d0e1a9 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:32.527210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-dc607ca2-ba6d-410a-a67f-1c0c57bde899 req-f0311328-8ff7-4d9d-a4cd-271c66d0e1a9 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:32.527647 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-dc607ca2-ba6d-410a-a67f-1c0c57bde899 req-f0311328-8ff7-4d9d-a4cd-271c66d0e1a9 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:32.540366 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-dc607ca2-ba6d-410a-a67f-1c0c57bde899 req-f0311328-8ff7-4d9d-a4cd-271c66d0e1a9 service nova] Creating event network-vif-unplugged:6a64c27f-e1a8-446d-9325-a7901a380021 for instance 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a on n-h2-860863-1 Oct 10 19:01:32.561053 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-dc607ca2-ba6d-410a-a67f-1c0c57bde899 req-f0311328-8ff7-4d9d-a4cd-271c66d0e1a9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048163 Oct 10 19:01:32.561665 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1256/2780] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 19:01:32.772217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-49f9452f-dcf7-478b-bacb-322ddabf02fd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:32.788174 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-49f9452f-dcf7-478b-bacb-322ddabf02fd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.338869 Oct 10 19:01:32.789095 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1525/2781] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:32 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:32.984729 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-582eb202-ea10-45b6-b6e1-0a7a2fd83eb6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:32.985441 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-582eb202-ea10-45b6-b6e1-0a7a2fd83eb6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:32.995552 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-582eb202-ea10-45b6-b6e1-0a7a2fd83eb6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:32.996052 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-582eb202-ea10-45b6-b6e1-0a7a2fd83eb6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:32.996484 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-582eb202-ea10-45b6-b6e1-0a7a2fd83eb6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:33.008987 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-582eb202-ea10-45b6-b6e1-0a7a2fd83eb6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:33.008987 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-582eb202-ea10-45b6-b6e1-0a7a2fd83eb6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:33.008987 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-582eb202-ea10-45b6-b6e1-0a7a2fd83eb6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:33.454548 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0dec4877-6e86-4d9c-b9f6-be4549e553d6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:33.455224 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0dec4877-6e86-4d9c-b9f6-be4549e553d6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:33.466068 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0dec4877-6e86-4d9c-b9f6-be4549e553d6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:33.466068 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0dec4877-6e86-4d9c-b9f6-be4549e553d6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:33.466068 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0dec4877-6e86-4d9c-b9f6-be4549e553d6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:33.466068 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0dec4877-6e86-4d9c-b9f6-be4549e553d6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:33.466068 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0dec4877-6e86-4d9c-b9f6-be4549e553d6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:33.466068 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0dec4877-6e86-4d9c-b9f6-be4549e553d6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:33.644627 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-582eb202-ea10-45b6-b6e1-0a7a2fd83eb6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:33.655720 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-582eb202-ea10-45b6-b6e1-0a7a2fd83eb6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.675653 Oct 10 19:01:33.661574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0dec4877-6e86-4d9c-b9f6-be4549e553d6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:33.677685 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0dec4877-6e86-4d9c-b9f6-be4549e553d6 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1501 microversion: 2.1 time: 0.226628 Oct 10 19:01:33.680163 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1257/2782] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:32 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:33.686338 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1526/2783] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:33 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1501 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:33.813167 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d6110cc2-e647-4a1d-8df0-ddb621a6c229 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:33.813887 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d6110cc2-e647-4a1d-8df0-ddb621a6c229 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:33.820427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d6110cc2-e647-4a1d-8df0-ddb621a6c229 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:33.820947 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d6110cc2-e647-4a1d-8df0-ddb621a6c229 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:33.822575 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d6110cc2-e647-4a1d-8df0-ddb621a6c229 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:33.822575 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d6110cc2-e647-4a1d-8df0-ddb621a6c229 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:33.823118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d6110cc2-e647-4a1d-8df0-ddb621a6c229 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:33.823557 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d6110cc2-e647-4a1d-8df0-ddb621a6c229 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:34.116986 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d6110cc2-e647-4a1d-8df0-ddb621a6c229 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:34.128059 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d6110cc2-e647-4a1d-8df0-ddb621a6c229 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.318426 Oct 10 19:01:34.129751 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1258/2784] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:33 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:34.611330 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-b2503fb0-c852-4cab-b41c-bfc8e8ababd4 req-2d2c06cb-a8ed-48ed-bc02-67e63ab14cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f8b3740-33b8-47a5-ada8-d3dd2ce3356a", "tag": "6a64c27f-e1a8-446d-9325-a7901a380021"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:34.628436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b2503fb0-c852-4cab-b41c-bfc8e8ababd4 req-2d2c06cb-a8ed-48ed-bc02-67e63ab14cdb service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:34.629494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b2503fb0-c852-4cab-b41c-bfc8e8ababd4 req-2d2c06cb-a8ed-48ed-bc02-67e63ab14cdb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:34.630042 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-b2503fb0-c852-4cab-b41c-bfc8e8ababd4 req-2d2c06cb-a8ed-48ed-bc02-67e63ab14cdb service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:34.655397 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-b2503fb0-c852-4cab-b41c-bfc8e8ababd4 req-2d2c06cb-a8ed-48ed-bc02-67e63ab14cdb service nova] Creating event network-changed:6a64c27f-e1a8-446d-9325-a7901a380021 for instance 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a on n-h2-860863-1 Oct 10 19:01:34.661690 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-b2503fb0-c852-4cab-b41c-bfc8e8ababd4 req-2d2c06cb-a8ed-48ed-bc02-67e63ab14cdb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054489 Oct 10 19:01:34.662793 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1527/2785] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:34.692324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ddc46e88-0ce7-4645-a50f-429b7d690e6d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:34.693929 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ddc46e88-0ce7-4645-a50f-429b7d690e6d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:34.701449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ddc46e88-0ce7-4645-a50f-429b7d690e6d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:34.702270 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ddc46e88-0ce7-4645-a50f-429b7d690e6d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:34.703303 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ddc46e88-0ce7-4645-a50f-429b7d690e6d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:34.704293 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ddc46e88-0ce7-4645-a50f-429b7d690e6d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:34.704413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1d67d954-ec38-4434-90a8-a6a81e031f74 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:34.705256 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1d67d954-ec38-4434-90a8-a6a81e031f74 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:34.709388 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ddc46e88-0ce7-4645-a50f-429b7d690e6d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:34.710113 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ddc46e88-0ce7-4645-a50f-429b7d690e6d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:34.714120 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d67d954-ec38-4434-90a8-a6a81e031f74 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:34.721468 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d67d954-ec38-4434-90a8-a6a81e031f74 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:34.721992 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d67d954-ec38-4434-90a8-a6a81e031f74 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:34.722746 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d67d954-ec38-4434-90a8-a6a81e031f74 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:34.723212 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d67d954-ec38-4434-90a8-a6a81e031f74 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:34.723707 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1d67d954-ec38-4434-90a8-a6a81e031f74 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:34.994493 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ddc46e88-0ce7-4645-a50f-429b7d690e6d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:35.002471 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ddc46e88-0ce7-4645-a50f-429b7d690e6d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.318456 Oct 10 19:01:35.003660 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1259/2786] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:34 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:35.157051 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a3c1440c-cc16-4bc2-bbfd-ab6c724bbdf5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:35.157676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a3c1440c-cc16-4bc2-bbfd-ab6c724bbdf5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:35.164926 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c1440c-cc16-4bc2-bbfd-ab6c724bbdf5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:35.165422 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c1440c-cc16-4bc2-bbfd-ab6c724bbdf5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:35.165861 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c1440c-cc16-4bc2-bbfd-ab6c724bbdf5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:35.166565 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c1440c-cc16-4bc2-bbfd-ab6c724bbdf5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:35.167023 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c1440c-cc16-4bc2-bbfd-ab6c724bbdf5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:35.170085 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3c1440c-cc16-4bc2-bbfd-ab6c724bbdf5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:35.294303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1d67d954-ec38-4434-90a8-a6a81e031f74 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:35.309885 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1d67d954-ec38-4434-90a8-a6a81e031f74 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1501 microversion: 2.1 time: 0.607518 Oct 10 19:01:35.312923 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1528/2787] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:34 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1501 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:35.406246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a3c1440c-cc16-4bc2-bbfd-ab6c724bbdf5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:35.416259 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a3c1440c-cc16-4bc2-bbfd-ab6c724bbdf5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.263492 Oct 10 19:01:35.416889 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1260/2788] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:35 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:35.577690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-03cfe9b1-3fab-4367-b3dc-756bb10c4a82 tempest-ListImagesTestJSON-474347336 tempest-ListImagesTestJSON-474347336-project] Calling method '.version_select at 0x7f318d56e820>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:35.643164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0421e98e-d40b-4755-9487-780640c60882 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:35.643710 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0421e98e-d40b-4755-9487-780640c60882 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:35.645573 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-03cfe9b1-3fab-4367-b3dc-756bb10c4a82 tempest-ListImagesTestJSON-474347336 tempest-ListImagesTestJSON-474347336-project] 10.222.0.43 "GET /compute/v2.1/images/b0a280ee-26ee-4c9a-8155-4326e368ccc9" status: 200 len: 784 microversion: 2.1 time: 0.268118 Oct 10 19:01:35.647054 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1529/2789] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:35 2022] GET /compute/v2.1/images/b0a280ee-26ee-4c9a-8155-4326e368ccc9 => generated 784 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 19:01:35.657985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0421e98e-d40b-4755-9487-780640c60882 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:35.657985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0421e98e-d40b-4755-9487-780640c60882 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:35.657985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0421e98e-d40b-4755-9487-780640c60882 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:35.657985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0421e98e-d40b-4755-9487-780640c60882 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:35.657985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0421e98e-d40b-4755-9487-780640c60882 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:35.657985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0421e98e-d40b-4755-9487-780640c60882 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:35.662465 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-683289e9-dc5e-4ebe-aded-b5468088cddb tempest-ListImagesTestJSON-474347336 tempest-ListImagesTestJSON-474347336-project] Calling method '.version_select at 0x7f318d0ffdc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:35.688058 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-0421e98e-d40b-4755-9487-780640c60882 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] HTTP exception thrown: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0421e98e-d40b-4755-9487-780640c60882 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Request method failure captured: Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 HTTP/1.1 Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGuO9V3CgMSt_l3JlD1RVQ4jd_M2uydLQLknLZT3pCKpJggVJyLLFaiF-k23VPd26y-i0lrktud9P1XZQ2CoLjc-1F0yzFH-zOPSgmZVi_zSdIbVOJi3CZIulBWpypaNz5QR0KZGLG-mREGURmSAP_GluiMr7lKFdocUKnauWYWJ82E Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 1206fcb7f08f4c09a019a4a560ccac71 Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1206fcb7f08f4c09a019a4a560ccac71", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1206fcb7f08f4c09a019a4a560ccac71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1206fcb7f08f4c09a019a4a560ccac71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1206fcb7f08f4c09a019a4a560ccac71"}]}] Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 1206fcb7f08f4c09a019a4a560ccac71 Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersTestMultiNic-447712075-project Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: f5d2fecfd1eb43dc9e050393017dede3 Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersTestMultiNic-447712075-project Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769'} Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:01:35.690011 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:01:35.695919 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:35.695919 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.695919 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:35.695919 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.695919 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:35.695919 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:35.695919 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:35.695919 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:01:35.695919 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:01:35.695919 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:35.695919 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.695919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0421e98e-d40b-4755-9487-780640c60882 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Returning 404 to user: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:01:35.700580 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0421e98e-d40b-4755-9487-780640c60882 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 404 len: 111 microversion: 2.1 time: 0.059428 Oct 10 19:01:35.700872 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1261/2790] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:01:35 2022] DELETE /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:01:35.721591 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-683289e9-dc5e-4ebe-aded-b5468088cddb tempest-ListImagesTestJSON-474347336 tempest-ListImagesTestJSON-474347336-project] 10.222.0.43 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.063951 Oct 10 19:01:35.725848 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3d9e4be8-e71c-46c8-8bd7-d1991b9bec9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:35.726436 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1530/2791] 10.222.0.43 () {58 vars in 1122 bytes} [Mon Oct 10 19:01:35 2022] GET /compute/v2.1/images => generated 445 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:35.727051 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3d9e4be8-e71c-46c8-8bd7-d1991b9bec9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:35.738969 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b74ec842-e33a-448a-8b0d-4e1d9d586720 tempest-ListImagesTestJSON-474347336 tempest-ListImagesTestJSON-474347336-project] Calling method '.version_select at 0x7f318d56e040>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:35.745142 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3d9e4be8-e71c-46c8-8bd7-d1991b9bec9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:35.745627 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3d9e4be8-e71c-46c8-8bd7-d1991b9bec9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:35.746056 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3d9e4be8-e71c-46c8-8bd7-d1991b9bec9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:35.746761 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3d9e4be8-e71c-46c8-8bd7-d1991b9bec9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:35.747206 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3d9e4be8-e71c-46c8-8bd7-d1991b9bec9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:35.747643 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3d9e4be8-e71c-46c8-8bd7-d1991b9bec9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:35.763517 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-3d9e4be8-e71c-46c8-8bd7-d1991b9bec9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] HTTP exception thrown: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3d9e4be8-e71c-46c8-8bd7-d1991b9bec9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Request method failure captured: Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 HTTP/1.1 Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGuO9V3CgMSt_l3JlD1RVQ4jd_M2uydLQLknLZT3pCKpJggVJyLLFaiF-k23VPd26y-i0lrktud9P1XZQ2CoLjc-1F0yzFH-zOPSgmZVi_zSdIbVOJi3CZIulBWpypaNz5QR0KZGLG-mREGURmSAP_GluiMr7lKFdocUKnauWYWJ82E Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 1206fcb7f08f4c09a019a4a560ccac71 Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1206fcb7f08f4c09a019a4a560ccac71", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1206fcb7f08f4c09a019a4a560ccac71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1206fcb7f08f4c09a019a4a560ccac71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1206fcb7f08f4c09a019a4a560ccac71"}]}] Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 1206fcb7f08f4c09a019a4a560ccac71 Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersTestMultiNic-447712075-project Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: f5d2fecfd1eb43dc9e050393017dede3 Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersTestMultiNic-447712075-project Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769'} Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:35.765104 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.773485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:35.773485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:35.773485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:35.773485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:01:35.773485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:01:35.773485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. Oct 10 19:01:35.773485 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.773485 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3d9e4be8-e71c-46c8-8bd7-d1991b9bec9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Returning 404 to user: Instance 6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:01:35.773485 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3d9e4be8-e71c-46c8-8bd7-d1991b9bec9a tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769" status: 404 len: 111 microversion: 2.1 time: 0.064577 Oct 10 19:01:35.773485 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1262/2792] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:35 2022] GET /compute/v2.1/servers/6c48cbf7-2d30-4ad6-b4ce-afcb7a1ea769 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:01:35.779667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6d51a277-e9c4-49a9-8460-9648c10d46a8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:35.780919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6d51a277-e9c4-49a9-8460-9648c10d46a8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:35.797309 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6d51a277-e9c4-49a9-8460-9648c10d46a8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:35.797795 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6d51a277-e9c4-49a9-8460-9648c10d46a8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:35.798232 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6d51a277-e9c4-49a9-8460-9648c10d46a8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:35.798928 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6d51a277-e9c4-49a9-8460-9648c10d46a8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:35.799550 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6d51a277-e9c4-49a9-8460-9648c10d46a8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:35.803551 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6d51a277-e9c4-49a9-8460-9648c10d46a8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:35.811451 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b74ec842-e33a-448a-8b0d-4e1d9d586720 tempest-ListImagesTestJSON-474347336 tempest-ListImagesTestJSON-474347336-project] 10.222.0.43 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.079542 Oct 10 19:01:35.812640 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1531/2793] 10.222.0.43 () {58 vars in 1143 bytes} [Mon Oct 10 19:01:35 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:35.846715 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-6d51a277-e9c4-49a9-8460-9648c10d46a8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] HTTP exception thrown: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6d51a277-e9c4-49a9-8460-9648c10d46a8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Request method failure captured: Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 HTTP/1.1 Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGuO9V3CgMSt_l3JlD1RVQ4jd_M2uydLQLknLZT3pCKpJggVJyLLFaiF-k23VPd26y-i0lrktud9P1XZQ2CoLjc-1F0yzFH-zOPSgmZVi_zSdIbVOJi3CZIulBWpypaNz5QR0KZGLG-mREGURmSAP_GluiMr7lKFdocUKnauWYWJ82E Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: 1206fcb7f08f4c09a019a4a560ccac71 Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1206fcb7f08f4c09a019a4a560ccac71", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1206fcb7f08f4c09a019a4a560ccac71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1206fcb7f08f4c09a019a4a560ccac71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1206fcb7f08f4c09a019a4a560ccac71"}]}] Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: 1206fcb7f08f4c09a019a4a560ccac71 Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServersTestMultiNic-447712075-project Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: f5d2fecfd1eb43dc9e050393017dede3 Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServersTestMultiNic-447712075-project Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': 'c3b24fdb-281e-478a-8aca-665e35082ba4'} Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:01:35.848731 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:01:35.853240 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:01:35.853240 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.853240 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:35.853240 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.853240 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:35.853240 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:35.853240 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:35.853240 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:01:35.853240 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:01:35.853240 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:01:35.853240 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.853240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6d51a277-e9c4-49a9-8460-9648c10d46a8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Returning 404 to user: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:01:35.853240 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6d51a277-e9c4-49a9-8460-9648c10d46a8 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 404 len: 111 microversion: 2.1 time: 0.078746 Oct 10 19:01:35.854921 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1263/2794] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:01:35 2022] DELETE /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 10 19:01:35.861208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-613d5a7f-abe3-4d7d-a714-8432c42a24e5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:35.862056 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-613d5a7f-abe3-4d7d-a714-8432c42a24e5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] [instance: c3b24fdb-281e-478a-8aca-665e35082ba4] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:35.869461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-613d5a7f-abe3-4d7d-a714-8432c42a24e5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:35.870231 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-613d5a7f-abe3-4d7d-a714-8432c42a24e5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:35.870833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-613d5a7f-abe3-4d7d-a714-8432c42a24e5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:35.871702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-613d5a7f-abe3-4d7d-a714-8432c42a24e5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:35.872450 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-613d5a7f-abe3-4d7d-a714-8432c42a24e5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:35.873125 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-613d5a7f-abe3-4d7d-a714-8432c42a24e5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:35.890690 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-613d5a7f-abe3-4d7d-a714-8432c42a24e5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] HTTP exception thrown: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-613d5a7f-abe3-4d7d-a714-8432c42a24e5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Request method failure captured: Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 HTTP/1.1 Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGuO9V3CgMSt_l3JlD1RVQ4jd_M2uydLQLknLZT3pCKpJggVJyLLFaiF-k23VPd26y-i0lrktud9P1XZQ2CoLjc-1F0yzFH-zOPSgmZVi_zSdIbVOJi3CZIulBWpypaNz5QR0KZGLG-mREGURmSAP_GluiMr7lKFdocUKnauWYWJ82E Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 1206fcb7f08f4c09a019a4a560ccac71 Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1206fcb7f08f4c09a019a4a560ccac71", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1206fcb7f08f4c09a019a4a560ccac71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1206fcb7f08f4c09a019a4a560ccac71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1206fcb7f08f4c09a019a4a560ccac71"}]}] Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 1206fcb7f08f4c09a019a4a560ccac71 Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServersTestMultiNic-447712075 Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServersTestMultiNic-447712075-project Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: f5d2fecfd1eb43dc9e050393017dede3 Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServersTestMultiNic-447712075-project Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'c3b24fdb-281e-478a-8aca-665e35082ba4'} Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:01:35.892603 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.897717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:01:35.897717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:01:35.897717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:01:35.897717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:01:35.897717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:01:35.897717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. Oct 10 19:01:35.897717 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:01:35.899617 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-613d5a7f-abe3-4d7d-a714-8432c42a24e5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] Returning 404 to user: Instance c3b24fdb-281e-478a-8aca-665e35082ba4 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:01:35.900736 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-613d5a7f-abe3-4d7d-a714-8432c42a24e5 tempest-ServersTestMultiNic-447712075 tempest-ServersTestMultiNic-447712075-project] 10.222.0.43 "GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4" status: 404 len: 111 microversion: 2.1 time: 0.044240 Oct 10 19:01:35.901847 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1532/2795] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:35 2022] GET /compute/v2.1/servers/c3b24fdb-281e-478a-8aca-665e35082ba4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:01:36.030480 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-31b18540-2fe1-4ca9-a619-764454633465 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:36.031473 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-31b18540-2fe1-4ca9-a619-764454633465 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:36.039262 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31b18540-2fe1-4ca9-a619-764454633465 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:36.040123 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31b18540-2fe1-4ca9-a619-764454633465 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:36.040689 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31b18540-2fe1-4ca9-a619-764454633465 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:36.041577 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31b18540-2fe1-4ca9-a619-764454633465 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:36.042525 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31b18540-2fe1-4ca9-a619-764454633465 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:36.043068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-31b18540-2fe1-4ca9-a619-764454633465 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:36.335666 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-fd9228a4-475d-4422-a84a-bf46ac39b730 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:36.336490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-fd9228a4-475d-4422-a84a-bf46ac39b730 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:36.340934 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-31b18540-2fe1-4ca9-a619-764454633465 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:36.342384 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:36.344527 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd9228a4-475d-4422-a84a-bf46ac39b730 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:36.345406 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd9228a4-475d-4422-a84a-bf46ac39b730 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:36.345979 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd9228a4-475d-4422-a84a-bf46ac39b730 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:36.346861 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd9228a4-475d-4422-a84a-bf46ac39b730 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:36.347885 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd9228a4-475d-4422-a84a-bf46ac39b730 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:36.348451 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-fd9228a4-475d-4422-a84a-bf46ac39b730 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:36.360491 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-31b18540-2fe1-4ca9-a619-764454633465 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.334087 Oct 10 19:01:36.379093 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1264/2796] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:36 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:36.448649 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-37d010af-af81-4eaa-9bb8-08b20b86f971 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:36.450447 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-37d010af-af81-4eaa-9bb8-08b20b86f971 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:36.460123 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37d010af-af81-4eaa-9bb8-08b20b86f971 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:36.461459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37d010af-af81-4eaa-9bb8-08b20b86f971 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:36.462122 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37d010af-af81-4eaa-9bb8-08b20b86f971 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:36.463471 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37d010af-af81-4eaa-9bb8-08b20b86f971 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:36.464809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37d010af-af81-4eaa-9bb8-08b20b86f971 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:36.465395 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-37d010af-af81-4eaa-9bb8-08b20b86f971 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:36.571976 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-fd9228a4-475d-4422-a84a-bf46ac39b730 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:36.583762 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-fd9228a4-475d-4422-a84a-bf46ac39b730 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1501 microversion: 2.1 time: 0.250078 Oct 10 19:01:36.589664 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1533/2797] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:36 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1501 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:36.677979 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-37d010af-af81-4eaa-9bb8-08b20b86f971 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:36.681669 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:36.686261 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-37d010af-af81-4eaa-9bb8-08b20b86f971 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.242845 Oct 10 19:01:36.686848 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1265/2798] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:36 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:37.387116 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c2a1a02d-3c51-48d8-b8a1-08c533208880 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:37.387731 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c2a1a02d-3c51-48d8-b8a1-08c533208880 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:37.395986 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c2a1a02d-3c51-48d8-b8a1-08c533208880 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:37.396612 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c2a1a02d-3c51-48d8-b8a1-08c533208880 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:37.402599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c2a1a02d-3c51-48d8-b8a1-08c533208880 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:37.402599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c2a1a02d-3c51-48d8-b8a1-08c533208880 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:37.402599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c2a1a02d-3c51-48d8-b8a1-08c533208880 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:37.402599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c2a1a02d-3c51-48d8-b8a1-08c533208880 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:37.541006 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c2a1a02d-3c51-48d8-b8a1-08c533208880 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:37.552493 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c2a1a02d-3c51-48d8-b8a1-08c533208880 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.167379 Oct 10 19:01:37.565854 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1534/2799] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:37 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:37.610651 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-1c7b38e7-76f2-46aa-bf8d-b7a4dfae151b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:37.610651 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-1c7b38e7-76f2-46aa-bf8d-b7a4dfae151b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:37.619817 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c7b38e7-76f2-46aa-bf8d-b7a4dfae151b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:37.620401 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c7b38e7-76f2-46aa-bf8d-b7a4dfae151b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:37.620916 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c7b38e7-76f2-46aa-bf8d-b7a4dfae151b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:37.621739 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c7b38e7-76f2-46aa-bf8d-b7a4dfae151b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:37.622686 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c7b38e7-76f2-46aa-bf8d-b7a4dfae151b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:37.623318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-1c7b38e7-76f2-46aa-bf8d-b7a4dfae151b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:37.710533 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1b547302-5af1-4b79-8c74-b8911b6b8089 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:37.711158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1b547302-5af1-4b79-8c74-b8911b6b8089 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:37.717913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b547302-5af1-4b79-8c74-b8911b6b8089 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:37.718577 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b547302-5af1-4b79-8c74-b8911b6b8089 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:37.719007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b547302-5af1-4b79-8c74-b8911b6b8089 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:37.719713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b547302-5af1-4b79-8c74-b8911b6b8089 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:37.720162 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b547302-5af1-4b79-8c74-b8911b6b8089 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:37.720631 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1b547302-5af1-4b79-8c74-b8911b6b8089 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:37.869499 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-1b547302-5af1-4b79-8c74-b8911b6b8089 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:37.877343 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1b547302-5af1-4b79-8c74-b8911b6b8089 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.171603 Oct 10 19:01:37.877917 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1535/2800] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:37 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:37.907947 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-1c7b38e7-76f2-46aa-bf8d-b7a4dfae151b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:37.917035 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-1c7b38e7-76f2-46aa-bf8d-b7a4dfae151b tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1501 microversion: 2.1 time: 0.313592 Oct 10 19:01:37.917685 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1266/2801] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:37 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1501 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:38.577411 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7d63731f-5b89-44af-be22-c303a1527bc2 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:38.578800 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7d63731f-5b89-44af-be22-c303a1527bc2 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:38.583509 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:38.587253 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7d63731f-5b89-44af-be22-c303a1527bc2 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:38.587982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7d63731f-5b89-44af-be22-c303a1527bc2 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:38.588409 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7d63731f-5b89-44af-be22-c303a1527bc2 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:38.589414 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7d63731f-5b89-44af-be22-c303a1527bc2 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:38.590624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7d63731f-5b89-44af-be22-c303a1527bc2 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:38.591082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7d63731f-5b89-44af-be22-c303a1527bc2 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:38.737504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7d63731f-5b89-44af-be22-c303a1527bc2 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:38.747667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:38.755070 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7d63731f-5b89-44af-be22-c303a1527bc2 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.183557 Oct 10 19:01:38.756891 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1536/2802] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:38 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:38.899997 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ec356147-bc51-497e-842b-332bb51afe43 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:38.900636 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ec356147-bc51-497e-842b-332bb51afe43 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:38.907539 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec356147-bc51-497e-842b-332bb51afe43 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:38.908015 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec356147-bc51-497e-842b-332bb51afe43 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:38.921109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec356147-bc51-497e-842b-332bb51afe43 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:38.921109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec356147-bc51-497e-842b-332bb51afe43 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:38.921109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec356147-bc51-497e-842b-332bb51afe43 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:38.921109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec356147-bc51-497e-842b-332bb51afe43 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:38.942564 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d97d6907-f75e-40ef-9c62-7f19726bcdcc tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:38.944090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d97d6907-f75e-40ef-9c62-7f19726bcdcc tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:38.950220 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d97d6907-f75e-40ef-9c62-7f19726bcdcc tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:38.950702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d97d6907-f75e-40ef-9c62-7f19726bcdcc tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:38.951135 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d97d6907-f75e-40ef-9c62-7f19726bcdcc tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:38.951886 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d97d6907-f75e-40ef-9c62-7f19726bcdcc tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:38.952337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d97d6907-f75e-40ef-9c62-7f19726bcdcc tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:38.953007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d97d6907-f75e-40ef-9c62-7f19726bcdcc tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:39.247847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d97d6907-f75e-40ef-9c62-7f19726bcdcc tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:39.269660 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d97d6907-f75e-40ef-9c62-7f19726bcdcc tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1501 microversion: 2.1 time: 0.333462 Oct 10 19:01:39.270499 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1537/2803] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:38 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1501 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:39.317488 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ec356147-bc51-497e-842b-332bb51afe43 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:39.329396 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ec356147-bc51-497e-842b-332bb51afe43 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.432453 Oct 10 19:01:39.332056 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1267/2804] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:38 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:39.784576 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-00ba2567-f1ed-4842-ac9a-85cd1ca79caf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:39.785797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-00ba2567-f1ed-4842-ac9a-85cd1ca79caf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:39.796071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00ba2567-f1ed-4842-ac9a-85cd1ca79caf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:39.796892 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00ba2567-f1ed-4842-ac9a-85cd1ca79caf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:39.799091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00ba2567-f1ed-4842-ac9a-85cd1ca79caf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:39.801883 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00ba2567-f1ed-4842-ac9a-85cd1ca79caf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:39.802691 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00ba2567-f1ed-4842-ac9a-85cd1ca79caf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:39.803446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00ba2567-f1ed-4842-ac9a-85cd1ca79caf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:40.296388 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8f9d5d40-a425-467c-9d93-9a398e5d4c52 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:40.297022 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8f9d5d40-a425-467c-9d93-9a398e5d4c52 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:40.311495 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f9d5d40-a425-467c-9d93-9a398e5d4c52 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:40.313062 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f9d5d40-a425-467c-9d93-9a398e5d4c52 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:40.313522 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f9d5d40-a425-467c-9d93-9a398e5d4c52 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:40.323246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f9d5d40-a425-467c-9d93-9a398e5d4c52 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:40.323759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f9d5d40-a425-467c-9d93-9a398e5d4c52 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:40.327833 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f9d5d40-a425-467c-9d93-9a398e5d4c52 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:40.406560 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-00ba2567-f1ed-4842-ac9a-85cd1ca79caf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:40.423642 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-00ba2567-f1ed-4842-ac9a-85cd1ca79caf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.645951 Oct 10 19:01:40.428635 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1538/2805] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:39 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:40.429674 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ed67d5b5-be01-4367-b34d-1165cdb68809 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:40.430298 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ed67d5b5-be01-4367-b34d-1165cdb68809 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:40.447771 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed67d5b5-be01-4367-b34d-1165cdb68809 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:40.448267 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed67d5b5-be01-4367-b34d-1165cdb68809 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:40.448736 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed67d5b5-be01-4367-b34d-1165cdb68809 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:40.449456 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed67d5b5-be01-4367-b34d-1165cdb68809 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:40.449906 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed67d5b5-be01-4367-b34d-1165cdb68809 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:40.450325 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ed67d5b5-be01-4367-b34d-1165cdb68809 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:40.820496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ed67d5b5-be01-4367-b34d-1165cdb68809 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:40.833062 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ed67d5b5-be01-4367-b34d-1165cdb68809 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.405935 Oct 10 19:01:40.834854 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1539/2806] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:40 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:40.854067 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8f9d5d40-a425-467c-9d93-9a398e5d4c52 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:40.863889 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8f9d5d40-a425-467c-9d93-9a398e5d4c52 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1501 microversion: 2.1 time: 0.572534 Oct 10 19:01:40.869621 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1268/2807] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:40 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1501 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:41.454308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7aa9aeab-9e88-488d-a798-8c172188a0dc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:41.454823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7aa9aeab-9e88-488d-a798-8c172188a0dc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:41.462635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7aa9aeab-9e88-488d-a798-8c172188a0dc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:41.465161 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7aa9aeab-9e88-488d-a798-8c172188a0dc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:41.470205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7aa9aeab-9e88-488d-a798-8c172188a0dc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:41.471175 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7aa9aeab-9e88-488d-a798-8c172188a0dc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:41.471792 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7aa9aeab-9e88-488d-a798-8c172188a0dc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:41.472959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7aa9aeab-9e88-488d-a798-8c172188a0dc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:41.731531 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7aa9aeab-9e88-488d-a798-8c172188a0dc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:41.743482 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7aa9aeab-9e88-488d-a798-8c172188a0dc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.293514 Oct 10 19:01:41.762957 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1540/2808] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:41 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:41.857698 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4e9821d6-0e7c-4db0-90e7-0fb5633340b0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:41.858321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4e9821d6-0e7c-4db0-90e7-0fb5633340b0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:41.872167 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4e9821d6-0e7c-4db0-90e7-0fb5633340b0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:41.872692 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4e9821d6-0e7c-4db0-90e7-0fb5633340b0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:41.873130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4e9821d6-0e7c-4db0-90e7-0fb5633340b0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:41.873837 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4e9821d6-0e7c-4db0-90e7-0fb5633340b0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:41.874298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4e9821d6-0e7c-4db0-90e7-0fb5633340b0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:41.874695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4e9821d6-0e7c-4db0-90e7-0fb5633340b0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:41.898483 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a92d9423-fe52-4528-b779-0711c17bde6a tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:41.899191 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a92d9423-fe52-4528-b779-0711c17bde6a tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:41.912838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a92d9423-fe52-4528-b779-0711c17bde6a tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:41.913418 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a92d9423-fe52-4528-b779-0711c17bde6a tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:41.914290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a92d9423-fe52-4528-b779-0711c17bde6a tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:41.915229 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a92d9423-fe52-4528-b779-0711c17bde6a tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:41.917271 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a92d9423-fe52-4528-b779-0711c17bde6a tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:41.920985 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a92d9423-fe52-4528-b779-0711c17bde6a tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:42.347717 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a92d9423-fe52-4528-b779-0711c17bde6a tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:42.357172 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a92d9423-fe52-4528-b779-0711c17bde6a tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1501 microversion: 2.1 time: 0.463136 Oct 10 19:01:42.363619 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1541/2809] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:41 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1501 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:42.771962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e5aba8f9-e7d6-4c9c-a858-d9443cf54baf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:42.772976 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e5aba8f9-e7d6-4c9c-a858-d9443cf54baf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:42.781044 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5aba8f9-e7d6-4c9c-a858-d9443cf54baf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:42.781656 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5aba8f9-e7d6-4c9c-a858-d9443cf54baf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:42.782160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5aba8f9-e7d6-4c9c-a858-d9443cf54baf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:42.782935 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5aba8f9-e7d6-4c9c-a858-d9443cf54baf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:42.783474 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5aba8f9-e7d6-4c9c-a858-d9443cf54baf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:42.783969 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e5aba8f9-e7d6-4c9c-a858-d9443cf54baf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:42.852599 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4e9821d6-0e7c-4db0-90e7-0fb5633340b0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:42.864194 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4e9821d6-0e7c-4db0-90e7-0fb5633340b0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 1.010354 Oct 10 19:01:42.864959 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1269/2810] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:41 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:43.043181 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e5aba8f9-e7d6-4c9c-a858-d9443cf54baf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:43.052272 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e5aba8f9-e7d6-4c9c-a858-d9443cf54baf tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.284793 Oct 10 19:01:43.057430 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1542/2811] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:42 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:43.381925 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9c00f858-41ee-48de-9680-2f08ce7d6285 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:43.383214 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9c00f858-41ee-48de-9680-2f08ce7d6285 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:43.400480 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c00f858-41ee-48de-9680-2f08ce7d6285 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:43.401371 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c00f858-41ee-48de-9680-2f08ce7d6285 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:43.401709 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c00f858-41ee-48de-9680-2f08ce7d6285 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:43.402639 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c00f858-41ee-48de-9680-2f08ce7d6285 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:43.403491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c00f858-41ee-48de-9680-2f08ce7d6285 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:43.404095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9c00f858-41ee-48de-9680-2f08ce7d6285 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:43.890615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-61f6fbf9-367d-4e18-9ea9-fbffd5f867c8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:43.893246 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-61f6fbf9-367d-4e18-9ea9-fbffd5f867c8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:43.920369 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61f6fbf9-367d-4e18-9ea9-fbffd5f867c8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:43.920369 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61f6fbf9-367d-4e18-9ea9-fbffd5f867c8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:43.920369 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61f6fbf9-367d-4e18-9ea9-fbffd5f867c8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:43.920369 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61f6fbf9-367d-4e18-9ea9-fbffd5f867c8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:43.920369 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61f6fbf9-367d-4e18-9ea9-fbffd5f867c8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:43.920369 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-61f6fbf9-367d-4e18-9ea9-fbffd5f867c8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:43.977179 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9c00f858-41ee-48de-9680-2f08ce7d6285 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:44.000757 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9c00f858-41ee-48de-9680-2f08ce7d6285 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1491 microversion: 2.1 time: 0.622989 Oct 10 19:01:44.002600 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1270/2812] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:43 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1491 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:44.028518 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fe1aba93-f0f2-4462-bf12-6716156f6afd tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Calling method '.version_select at 0x7f318dbbd820>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:44.040911 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe1aba93-f0f2-4462-bf12-6716156f6afd tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:44.053897 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe1aba93-f0f2-4462-bf12-6716156f6afd tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:44.056437 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fe1aba93-f0f2-4462-bf12-6716156f6afd tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:44.116904 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fe1aba93-f0f2-4462-bf12-6716156f6afd tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.092916 Oct 10 19:01:44.118204 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1271/2813] 10.222.0.43 () {58 vars in 1143 bytes} [Mon Oct 10 19:01:44 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:44.133164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e2b3dfd6-8b49-4abc-9549-826b49acd971 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:44.151602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e2b3dfd6-8b49-4abc-9549-826b49acd971 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:44.160219 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2b3dfd6-8b49-4abc-9549-826b49acd971 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:44.171786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2b3dfd6-8b49-4abc-9549-826b49acd971 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:44.172515 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2b3dfd6-8b49-4abc-9549-826b49acd971 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:44.173491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2b3dfd6-8b49-4abc-9549-826b49acd971 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:44.174118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2b3dfd6-8b49-4abc-9549-826b49acd971 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:44.174709 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2b3dfd6-8b49-4abc-9549-826b49acd971 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:44.306873 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-61f6fbf9-367d-4e18-9ea9-fbffd5f867c8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:44.316691 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-61f6fbf9-367d-4e18-9ea9-fbffd5f867c8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.432957 Oct 10 19:01:44.319847 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1543/2814] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:43 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:44.329500 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-98e46815-1c41-4ba5-a620-dffbe63685e0 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:44.330510 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-98e46815-1c41-4ba5-a620-dffbe63685e0 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] [instance: 2f8b3740-33b8-47a5-ada8-d3dd2ce3356a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:44.336930 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98e46815-1c41-4ba5-a620-dffbe63685e0 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:44.337687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98e46815-1c41-4ba5-a620-dffbe63685e0 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:44.338279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98e46815-1c41-4ba5-a620-dffbe63685e0 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:44.339425 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98e46815-1c41-4ba5-a620-dffbe63685e0 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:44.339879 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98e46815-1c41-4ba5-a620-dffbe63685e0 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:44.340491 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-98e46815-1c41-4ba5-a620-dffbe63685e0 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:44.664322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e2b3dfd6-8b49-4abc-9549-826b49acd971 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:44.674658 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e2b3dfd6-8b49-4abc-9549-826b49acd971 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.554669 Oct 10 19:01:44.698014 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1272/2815] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:44 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:44.987045 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-98e46815-1c41-4ba5-a620-dffbe63685e0 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a" status: 200 len: 1642 microversion: 2.1 time: 0.664583 Oct 10 19:01:44.987852 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1544/2816] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:44 2022] GET /compute/v2.1/servers/2f8b3740-33b8-47a5-ada8-d3dd2ce3356a => generated 1642 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:45.170472 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-845308190", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "8fe474f1-4c55-4478-ae57-c7d795da4502"}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:45.257580 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] validate_networks() for [('8fe474f1-4c55-4478-ae57-c7d795da4502', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 19:01:45.342510 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cc78f977-85db-4654-bfa7-eadc3755129d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:45.343788 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cc78f977-85db-4654-bfa7-eadc3755129d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:45.361666 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cc78f977-85db-4654-bfa7-eadc3755129d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:45.362234 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cc78f977-85db-4654-bfa7-eadc3755129d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:45.366802 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cc78f977-85db-4654-bfa7-eadc3755129d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:45.367602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cc78f977-85db-4654-bfa7-eadc3755129d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:45.368077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cc78f977-85db-4654-bfa7-eadc3755129d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:45.368506 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cc78f977-85db-4654-bfa7-eadc3755129d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:45.820608 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cc78f977-85db-4654-bfa7-eadc3755129d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:45.837992 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cc78f977-85db-4654-bfa7-eadc3755129d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1497 microversion: 2.1 time: 0.498955 Oct 10 19:01:45.838614 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1545/2817] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:45 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1497 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:46.075018 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1212088609", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:46.151317 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] validate_networks() for [('398b36bd-88f2-463a-b481-95c7ab10825e', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 19:01:46.641528 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 19:01:46.642074 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 19:01:46.642405 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 19:01:46.643013 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 19:01:46.643588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 19:01:46.658225 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:46.661459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:46.661967 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:46.662792 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:46.663264 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:46.665957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:46.712139 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Getting quotas for project 9d12307b731846928ce877a98bce8c10. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 19:01:46.726410 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Getting quotas for user 3ee224c527494aec81a29103a3c3332e and project 9d12307b731846928ce877a98bce8c10. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 19:01:46.746970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 19:01:46.749793 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 19:01:46.887481 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c519ca51-f301-4658-af8d-a5257c54cc64 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.723903 Oct 10 19:01:46.888702 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1273/2818] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 19:01:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 19:01:46.893412 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-dce038e4-81d8-4533-b182-76283ac6d425 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:46.895763 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-dce038e4-81d8-4533-b182-76283ac6d425 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:46.903727 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dce038e4-81d8-4533-b182-76283ac6d425 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:46.904712 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dce038e4-81d8-4533-b182-76283ac6d425 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:46.905451 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dce038e4-81d8-4533-b182-76283ac6d425 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:46.906338 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dce038e4-81d8-4533-b182-76283ac6d425 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:46.906959 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dce038e4-81d8-4533-b182-76283ac6d425 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:46.907662 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-dce038e4-81d8-4533-b182-76283ac6d425 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:47.185345 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 19:01:47.185957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 19:01:47.186933 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 19:01:47.187558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 19:01:47.188024 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 19:01:47.207999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:47.207999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:47.207999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:47.207999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:47.207999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:47.207999 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:47.230320 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-dce038e4-81d8-4533-b182-76283ac6d425 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:47.245641 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-dce038e4-81d8-4533-b182-76283ac6d425 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.353556 Oct 10 19:01:47.247673 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1274/2819] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:46 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:47.259349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f3a56865-1563-4276-88db-93852fab0256 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:47.266532 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f3a56865-1563-4276-88db-93852fab0256 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:47.286829 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f3a56865-1563-4276-88db-93852fab0256 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:47.287329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f3a56865-1563-4276-88db-93852fab0256 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:47.287769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f3a56865-1563-4276-88db-93852fab0256 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:47.288482 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f3a56865-1563-4276-88db-93852fab0256 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:47.289823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Getting quotas for project 0df728c13f03436ba9a26693457ca1e9. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 19:01:47.303174 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f3a56865-1563-4276-88db-93852fab0256 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:47.305032 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f3a56865-1563-4276-88db-93852fab0256 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:47.306495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Getting quotas for user 807e5d15f2cd4a2890bce3ce2c9edfba and project 0df728c13f03436ba9a26693457ca1e9. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 19:01:47.350061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 19:01:47.352425 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 19:01:47.534161 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f3a56865-1563-4276-88db-93852fab0256 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:47.560666 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f3a56865-1563-4276-88db-93852fab0256 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 200 len: 1474 microversion: 2.1 time: 0.309138 Oct 10 19:01:47.561540 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1275/2820] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:47 2022] GET /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 1474 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:47.567046 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3223e3b5-7b14-4468-ada6-46fcb857315d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:47.567883 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3223e3b5-7b14-4468-ada6-46fcb857315d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:47.682460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3223e3b5-7b14-4468-ada6-46fcb857315d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:47.682460 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3223e3b5-7b14-4468-ada6-46fcb857315d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1210 microversion: 2.1 time: 0.090673 Oct 10 19:01:47.682460 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1276/2821] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:47 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:47.682460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e10ab6c6-27a2-4f7d-8ddc-891ba8fbac72 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-423863842"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:47.682460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e10ab6c6-27a2-4f7d-8ddc-891ba8fbac72 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:47.687537 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e10ab6c6-27a2-4f7d-8ddc-891ba8fbac72 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:47.688260 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e10ab6c6-27a2-4f7d-8ddc-891ba8fbac72 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:47.688912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e10ab6c6-27a2-4f7d-8ddc-891ba8fbac72 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:47.689810 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e10ab6c6-27a2-4f7d-8ddc-891ba8fbac72 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:47.690436 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e10ab6c6-27a2-4f7d-8ddc-891ba8fbac72 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:47.691044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e10ab6c6-27a2-4f7d-8ddc-891ba8fbac72 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:48.058615 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1c668d84-b22c-4041-bead-81f200646904 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.214425 Oct 10 19:01:48.061735 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1546/2822] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 19:01:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 19:01:48.074008 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d5abe1fe-1207-4258-9ab0-89c2a8aa66e8 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:48.074008 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d5abe1fe-1207-4258-9ab0-89c2a8aa66e8 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:48.304941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d5abe1fe-1207-4258-9ab0-89c2a8aa66e8 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:48.315327 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d5abe1fe-1207-4258-9ab0-89c2a8aa66e8 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1214 microversion: 2.1 time: 0.246951 Oct 10 19:01:48.331396 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1547/2823] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:48 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1214 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:48.340470 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bbda7478-641e-4b3e-acf0-3dc1d92c2695 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:48.344071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bbda7478-641e-4b3e-acf0-3dc1d92c2695 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:48.348097 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bbda7478-641e-4b3e-acf0-3dc1d92c2695 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:48.349321 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bbda7478-641e-4b3e-acf0-3dc1d92c2695 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:48.349778 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bbda7478-641e-4b3e-acf0-3dc1d92c2695 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:48.351057 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bbda7478-641e-4b3e-acf0-3dc1d92c2695 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:48.351528 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bbda7478-641e-4b3e-acf0-3dc1d92c2695 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:48.351945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bbda7478-641e-4b3e-acf0-3dc1d92c2695 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:48.429748 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e10ab6c6-27a2-4f7d-8ddc-891ba8fbac72 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "POST /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b/action" status: 202 len: 0 microversion: 2.1 time: 0.774338 Oct 10 19:01:48.433256 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1277/2824] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:01:47 2022] POST /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b/action => generated 0 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 19:01:48.445293 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7ad23db0-697c-4d3a-8c24-80b2b9e8ee89 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f31923809d0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:48.494763 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7ad23db0-697c-4d3a-8c24-80b2b9e8ee89 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1413 microversion: 2.1 time: 0.054472 Oct 10 19:01:48.495529 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1278/2825] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:48 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:48.691569 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6c15445e-cde0-45f7-99c2-0c36df857ce8 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:48.693320 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6c15445e-cde0-45f7-99c2-0c36df857ce8 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:48.830829 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6c15445e-cde0-45f7-99c2-0c36df857ce8 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:48.840716 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6c15445e-cde0-45f7-99c2-0c36df857ce8 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1210 microversion: 2.1 time: 0.152323 Oct 10 19:01:48.857874 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1279/2826] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:48 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1210 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:48.886397 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bbda7478-641e-4b3e-acf0-3dc1d92c2695 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:48.942258 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bbda7478-641e-4b3e-acf0-3dc1d92c2695 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.584512 Oct 10 19:01:48.943487 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1548/2827] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:48 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:49.343257 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c0b16b74-a698-4022-b432-5948e8b70599 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:49.344237 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c0b16b74-a698-4022-b432-5948e8b70599 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:49.513063 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f350846a-e2e3-4391-a110-52c78339babf tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f31921cc160>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:49.551509 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c0b16b74-a698-4022-b432-5948e8b70599 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:49.568055 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c0b16b74-a698-4022-b432-5948e8b70599 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1214 microversion: 2.1 time: 0.225510 Oct 10 19:01:49.571744 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1280/2828] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:49 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1214 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:49.617239 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f350846a-e2e3-4391-a110-52c78339babf tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1413 microversion: 2.1 time: 0.109479 Oct 10 19:01:49.619195 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1549/2829] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:49 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1413 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:49.864270 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6b17cf45-61b0-42e6-a752-8ba1162fd5dd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:49.865082 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6b17cf45-61b0-42e6-a752-8ba1162fd5dd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:49.883995 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b17cf45-61b0-42e6-a752-8ba1162fd5dd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:49.886127 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b17cf45-61b0-42e6-a752-8ba1162fd5dd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:49.886747 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b17cf45-61b0-42e6-a752-8ba1162fd5dd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:49.891637 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b17cf45-61b0-42e6-a752-8ba1162fd5dd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:49.892269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b17cf45-61b0-42e6-a752-8ba1162fd5dd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:49.894987 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6b17cf45-61b0-42e6-a752-8ba1162fd5dd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:49.986623 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0312171a-620b-46b7-af65-46c65e2adc07 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:49.987254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0312171a-620b-46b7-af65-46c65e2adc07 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:50.010182 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0312171a-620b-46b7-af65-46c65e2adc07 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:50.010924 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0312171a-620b-46b7-af65-46c65e2adc07 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:50.011369 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0312171a-620b-46b7-af65-46c65e2adc07 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:50.012288 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0312171a-620b-46b7-af65-46c65e2adc07 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:50.014652 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0312171a-620b-46b7-af65-46c65e2adc07 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:50.019391 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0312171a-620b-46b7-af65-46c65e2adc07 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:50.133918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6b17cf45-61b0-42e6-a752-8ba1162fd5dd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:50.152580 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6b17cf45-61b0-42e6-a752-8ba1162fd5dd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1262 microversion: 2.1 time: 0.282912 Oct 10 19:01:50.153906 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1281/2830] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:49 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1262 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:50.317720 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0312171a-620b-46b7-af65-46c65e2adc07 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:50.334791 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0312171a-620b-46b7-af65-46c65e2adc07 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.362769 Oct 10 19:01:50.338131 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1550/2831] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:49 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:50.591592 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-561061c7-7b7f-452d-b82a-bf9236f9fe92 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:50.592443 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-561061c7-7b7f-452d-b82a-bf9236f9fe92 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:50.616443 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-561061c7-7b7f-452d-b82a-bf9236f9fe92 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:50.617240 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-561061c7-7b7f-452d-b82a-bf9236f9fe92 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:50.617957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-561061c7-7b7f-452d-b82a-bf9236f9fe92 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:50.618948 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-561061c7-7b7f-452d-b82a-bf9236f9fe92 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:50.619671 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-561061c7-7b7f-452d-b82a-bf9236f9fe92 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:50.620139 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-561061c7-7b7f-452d-b82a-bf9236f9fe92 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:50.638531 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-60cfc18e-2b30-4f01-829f-b9aa0dc257f0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318d4fe940>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:50.765229 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-60cfc18e-2b30-4f01-829f-b9aa0dc257f0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1413 microversion: 2.1 time: 0.134273 Oct 10 19:01:50.766348 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1551/2832] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:50 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:50.956906 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-561061c7-7b7f-452d-b82a-bf9236f9fe92 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:50.977128 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-561061c7-7b7f-452d-b82a-bf9236f9fe92 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1266 microversion: 2.1 time: 0.389246 Oct 10 19:01:50.978316 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1282/2833] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:50 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1266 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:51.184962 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e503b10d-d69b-4db7-8a3e-ad8c3ac334c8 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:51.185628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e503b10d-d69b-4db7-8a3e-ad8c3ac334c8 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:51.204058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e503b10d-d69b-4db7-8a3e-ad8c3ac334c8 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:51.204645 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e503b10d-d69b-4db7-8a3e-ad8c3ac334c8 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:51.205260 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e503b10d-d69b-4db7-8a3e-ad8c3ac334c8 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:51.206855 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e503b10d-d69b-4db7-8a3e-ad8c3ac334c8 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:51.207328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e503b10d-d69b-4db7-8a3e-ad8c3ac334c8 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:51.207761 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e503b10d-d69b-4db7-8a3e-ad8c3ac334c8 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:51.358328 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-36f181fa-17a1-4024-b8dd-52ea01b75cd1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:51.358954 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-36f181fa-17a1-4024-b8dd-52ea01b75cd1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:51.375786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e503b10d-d69b-4db7-8a3e-ad8c3ac334c8 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:51.382737 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36f181fa-17a1-4024-b8dd-52ea01b75cd1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:51.389190 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e503b10d-d69b-4db7-8a3e-ad8c3ac334c8 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1268 microversion: 2.1 time: 0.214803 Oct 10 19:01:51.394682 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1552/2834] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:51 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1268 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:51.397180 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36f181fa-17a1-4024-b8dd-52ea01b75cd1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:51.397810 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36f181fa-17a1-4024-b8dd-52ea01b75cd1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:51.400930 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36f181fa-17a1-4024-b8dd-52ea01b75cd1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:51.401553 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36f181fa-17a1-4024-b8dd-52ea01b75cd1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:51.407764 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-36f181fa-17a1-4024-b8dd-52ea01b75cd1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:51.782920 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-184cb785-ff9a-40c7-ae66-53ceeacac874 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318d826af0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:51.872409 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-184cb785-ff9a-40c7-ae66-53ceeacac874 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1413 microversion: 2.1 time: 0.095066 Oct 10 19:01:51.873035 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1553/2835] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:51 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:52.015114 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f03bfc9d-bf0b-4463-b50e-21b1e2ee85c2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:52.015765 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f03bfc9d-bf0b-4463-b50e-21b1e2ee85c2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:52.036064 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f03bfc9d-bf0b-4463-b50e-21b1e2ee85c2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:52.036581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f03bfc9d-bf0b-4463-b50e-21b1e2ee85c2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:52.037029 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f03bfc9d-bf0b-4463-b50e-21b1e2ee85c2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:52.037801 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f03bfc9d-bf0b-4463-b50e-21b1e2ee85c2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:52.038264 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f03bfc9d-bf0b-4463-b50e-21b1e2ee85c2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:52.038951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f03bfc9d-bf0b-4463-b50e-21b1e2ee85c2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:52.079801 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-36f181fa-17a1-4024-b8dd-52ea01b75cd1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:52.090216 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-36f181fa-17a1-4024-b8dd-52ea01b75cd1 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1518 microversion: 2.1 time: 0.735735 Oct 10 19:01:52.094945 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1283/2836] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:51 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1518 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:52.192848 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-f03bfc9d-bf0b-4463-b50e-21b1e2ee85c2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:52.215343 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f03bfc9d-bf0b-4463-b50e-21b1e2ee85c2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1284 microversion: 2.1 time: 0.211792 Oct 10 19:01:52.219087 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1554/2837] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:51 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1284 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:52.428679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3f55ba65-274f-4d08-a04c-009fd9853c62 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:52.428679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3f55ba65-274f-4d08-a04c-009fd9853c62 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:52.437951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f55ba65-274f-4d08-a04c-009fd9853c62 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:52.445197 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f55ba65-274f-4d08-a04c-009fd9853c62 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:52.446377 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f55ba65-274f-4d08-a04c-009fd9853c62 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:52.447149 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f55ba65-274f-4d08-a04c-009fd9853c62 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:52.452933 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f55ba65-274f-4d08-a04c-009fd9853c62 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:52.453740 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3f55ba65-274f-4d08-a04c-009fd9853c62 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:52.485536 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b4715ed8-8afb-4f45-b781-5156d6bbfe6d tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Action: 'create', calling method: .version_select at 0x7f318e237a60>, body: {"keypair": {"name": "tempest-keypair-158845923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYq24EC1WuxKg/OFkBFJSma/4ja+BPQWLY2GmMudC7ZdecepZBrFggxEBMOZq4am/xqRY84rwfj8hyiJRVOCUzQ/lKUw6SYCnjMHv5fBvXhLm9mAg31XLaEZbptc7Mx2g=="}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:52.509509 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:52.519734 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-b4715ed8-8afb-4f45-b781-5156d6bbfe6d tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Getting quotas for project 6482edb6681449208592d3bb035d7e8a. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 19:01:52.527629 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-b4715ed8-8afb-4f45-b781-5156d6bbfe6d tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Getting quotas for user 0c1f0c5ec9fe47768424f04a8f721e46 and project 6482edb6681449208592d3bb035d7e8a. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 19:01:52.636115 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3f55ba65-274f-4d08-a04c-009fd9853c62 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:52.649248 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3f55ba65-274f-4d08-a04c-009fd9853c62 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1268 microversion: 2.1 time: 0.229842 Oct 10 19:01:52.650715 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1555/2838] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:52 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1268 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:52.671649 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b4715ed8-8afb-4f45-b781-5156d6bbfe6d tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.369240 Oct 10 19:01:52.677630 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1284/2839] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 19:01:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:52.889347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c7cede11-9b31-4932-8820-8625f11609e8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318d0b5310>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:52.935961 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-b43f68ab-1dff-49d2-8976-e38de66d29e0 req-bb766b17-5e73-42a0-9e2f-d867eef2f867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154d20fa-a1d2-4bfd-99ab-024ddf8ae67b", "name": "network-vif-plugged", "status": "completed", "tag": "d76218a1-c511-4bbd-bdc9-d8d4fda923c7"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:52.953476 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-b43f68ab-1dff-49d2-8976-e38de66d29e0 req-bb766b17-5e73-42a0-9e2f-d867eef2f867 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:52.954231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-b43f68ab-1dff-49d2-8976-e38de66d29e0 req-bb766b17-5e73-42a0-9e2f-d867eef2f867 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:52.954669 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-b43f68ab-1dff-49d2-8976-e38de66d29e0 req-bb766b17-5e73-42a0-9e2f-d867eef2f867 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:52.963843 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c7cede11-9b31-4932-8820-8625f11609e8 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1413 microversion: 2.1 time: 0.078313 Oct 10 19:01:52.964443 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1556/2840] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:52 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:52.970157 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-b43f68ab-1dff-49d2-8976-e38de66d29e0 req-bb766b17-5e73-42a0-9e2f-d867eef2f867 service nova] Creating event network-vif-plugged:d76218a1-c511-4bbd-bdc9-d8d4fda923c7 for instance 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b on n-h1-860863-1 Oct 10 19:01:52.976918 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-b43f68ab-1dff-49d2-8976-e38de66d29e0 req-bb766b17-5e73-42a0-9e2f-d867eef2f867 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047044 Oct 10 19:01:52.978824 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1285/2841] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:53.118841 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e710ad49-a56c-4178-b07d-e540b0738533 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:53.122411 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e710ad49-a56c-4178-b07d-e540b0738533 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:53.150949 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e710ad49-a56c-4178-b07d-e540b0738533 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:53.155556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e710ad49-a56c-4178-b07d-e540b0738533 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:53.155556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e710ad49-a56c-4178-b07d-e540b0738533 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:53.155556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e710ad49-a56c-4178-b07d-e540b0738533 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:53.159045 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e710ad49-a56c-4178-b07d-e540b0738533 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:53.160379 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e710ad49-a56c-4178-b07d-e540b0738533 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:53.255635 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b3cb7873-7c58-4ee5-8974-cbc6a70fc348 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:53.256392 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b3cb7873-7c58-4ee5-8974-cbc6a70fc348 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:53.280361 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3cb7873-7c58-4ee5-8974-cbc6a70fc348 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:53.282640 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3cb7873-7c58-4ee5-8974-cbc6a70fc348 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:53.283440 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3cb7873-7c58-4ee5-8974-cbc6a70fc348 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:53.287615 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3cb7873-7c58-4ee5-8974-cbc6a70fc348 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:53.288497 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3cb7873-7c58-4ee5-8974-cbc6a70fc348 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:53.297486 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b3cb7873-7c58-4ee5-8974-cbc6a70fc348 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:53.654891 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b3cb7873-7c58-4ee5-8974-cbc6a70fc348 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:53.665638 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b3cb7873-7c58-4ee5-8974-cbc6a70fc348 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1272 microversion: 2.1 time: 0.419148 Oct 10 19:01:53.668109 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1286/2842] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:53 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1272 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:53.683373 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a9b07488-f56b-4907-97f1-88b479c491a9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:53.684340 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a9b07488-f56b-4907-97f1-88b479c491a9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:53.698850 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9b07488-f56b-4907-97f1-88b479c491a9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:53.699506 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9b07488-f56b-4907-97f1-88b479c491a9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:53.700141 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9b07488-f56b-4907-97f1-88b479c491a9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:53.700996 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9b07488-f56b-4907-97f1-88b479c491a9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:53.701579 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9b07488-f56b-4907-97f1-88b479c491a9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:53.704919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a9b07488-f56b-4907-97f1-88b479c491a9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:53.978963 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e710ad49-a56c-4178-b07d-e540b0738533 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:53.990412 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e710ad49-a56c-4178-b07d-e540b0738533 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1524 microversion: 2.1 time: 0.873282 Oct 10 19:01:54.005912 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1557/2843] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:53 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1524 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:54.029102 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-24b714cb-1471-4b30-b467-af963fcab3dd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318d4fee50>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:54.102598 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-24b714cb-1471-4b30-b467-af963fcab3dd tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1413 microversion: 2.1 time: 0.094110 Oct 10 19:01:54.103792 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1558/2844] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:54 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:54.497690 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a9b07488-f56b-4907-97f1-88b479c491a9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:54.509917 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a9b07488-f56b-4907-97f1-88b479c491a9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1310 microversion: 2.1 time: 0.830437 Oct 10 19:01:54.510634 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1287/2845] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:53 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1310 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:54.697968 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-251f7c1c-ad98-4563-af92-2d7de13873bd tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:54.698795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-251f7c1c-ad98-4563-af92-2d7de13873bd tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:54.709689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-251f7c1c-ad98-4563-af92-2d7de13873bd tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:54.711357 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-251f7c1c-ad98-4563-af92-2d7de13873bd tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:54.712695 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-251f7c1c-ad98-4563-af92-2d7de13873bd tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:54.713485 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-251f7c1c-ad98-4563-af92-2d7de13873bd tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:54.713980 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-251f7c1c-ad98-4563-af92-2d7de13873bd tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:54.716330 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-251f7c1c-ad98-4563-af92-2d7de13873bd tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:54.990737 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-251f7c1c-ad98-4563-af92-2d7de13873bd tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:55.007348 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-251f7c1c-ad98-4563-af92-2d7de13873bd tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1272 microversion: 2.1 time: 0.313467 Oct 10 19:01:55.014082 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1559/2846] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:54 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1272 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:55.019364 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-816ef497-24c3-49b7-9eb9-53ed89648872 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:55.021293 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-816ef497-24c3-49b7-9eb9-53ed89648872 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:55.036655 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-816ef497-24c3-49b7-9eb9-53ed89648872 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:55.037513 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-816ef497-24c3-49b7-9eb9-53ed89648872 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:55.038135 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-816ef497-24c3-49b7-9eb9-53ed89648872 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:55.039326 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-816ef497-24c3-49b7-9eb9-53ed89648872 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:55.041665 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-816ef497-24c3-49b7-9eb9-53ed89648872 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:55.043132 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-816ef497-24c3-49b7-9eb9-53ed89648872 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:55.074867 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:55.119665 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-39bc16f9-d3ed-4431-959c-336bc6791b92 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f319236b430>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:55.240224 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-39bc16f9-d3ed-4431-959c-336bc6791b92 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1413 microversion: 2.1 time: 0.124196 Oct 10 19:01:55.243442 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1560/2847] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:55 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1413 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:55.536017 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c4d1203e-ebfe-44ee-9a14-5fb61f662b0d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:55.536680 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c4d1203e-ebfe-44ee-9a14-5fb61f662b0d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:55.551340 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4d1203e-ebfe-44ee-9a14-5fb61f662b0d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:55.551844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4d1203e-ebfe-44ee-9a14-5fb61f662b0d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:55.552286 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4d1203e-ebfe-44ee-9a14-5fb61f662b0d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:55.553038 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4d1203e-ebfe-44ee-9a14-5fb61f662b0d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:55.553504 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4d1203e-ebfe-44ee-9a14-5fb61f662b0d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:55.553930 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c4d1203e-ebfe-44ee-9a14-5fb61f662b0d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:55.576641 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=100 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:56.095201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-816ef497-24c3-49b7-9eb9-53ed89648872 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:56.104505 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-816ef497-24c3-49b7-9eb9-53ed89648872 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1524 microversion: 2.1 time: 1.088950 Oct 10 19:01:56.113475 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1288/2848] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:55 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1524 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:56.161268 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f0e601af-f879-423b-8c00-6209d5a61f42 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:56.162198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f0e601af-f879-423b-8c00-6209d5a61f42 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:56.174759 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0e601af-f879-423b-8c00-6209d5a61f42 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:56.176124 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0e601af-f879-423b-8c00-6209d5a61f42 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:56.185254 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0e601af-f879-423b-8c00-6209d5a61f42 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:56.186270 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0e601af-f879-423b-8c00-6209d5a61f42 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:56.186913 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0e601af-f879-423b-8c00-6209d5a61f42 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:56.187502 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f0e601af-f879-423b-8c00-6209d5a61f42 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:56.311108 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c4d1203e-ebfe-44ee-9a14-5fb61f662b0d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:56.321232 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c4d1203e-ebfe-44ee-9a14-5fb61f662b0d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1310 microversion: 2.1 time: 0.789077 Oct 10 19:01:56.322720 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1561/2849] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:55 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1310 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:56.330238 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e4a4327e-fce3-4e5c-ad26-7e9ffeb84845 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f31922b23a0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:56.427210 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e4a4327e-fce3-4e5c-ad26-7e9ffeb84845 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1413 microversion: 2.1 time: 0.102773 Oct 10 19:01:56.427931 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1562/2850] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:56 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:56.613363 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f0e601af-f879-423b-8c00-6209d5a61f42 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:56.622240 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f0e601af-f879-423b-8c00-6209d5a61f42 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1314 microversion: 2.1 time: 0.487628 Oct 10 19:01:56.639205 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1289/2851] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:56 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:56.984463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-fdc4b595-0afa-4cea-8e04-2db66fd24cbe req-03baee0e-4205-4b19-9663-f83b22842572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e33016a-8156-4050-bcbd-fdd7a29b865b", "tag": "94d9fd5e-4a38-41be-9347-cbd7946570c6"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:57.008274 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-fdc4b595-0afa-4cea-8e04-2db66fd24cbe req-03baee0e-4205-4b19-9663-f83b22842572 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:57.013340 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-fdc4b595-0afa-4cea-8e04-2db66fd24cbe req-03baee0e-4205-4b19-9663-f83b22842572 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:57.014120 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-fdc4b595-0afa-4cea-8e04-2db66fd24cbe req-03baee0e-4205-4b19-9663-f83b22842572 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:57.038174 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-fdc4b595-0afa-4cea-8e04-2db66fd24cbe req-03baee0e-4205-4b19-9663-f83b22842572 service nova] Creating event network-changed:94d9fd5e-4a38-41be-9347-cbd7946570c6 for instance 7e33016a-8156-4050-bcbd-fdd7a29b865b on n-h1-860863-1 Oct 10 19:01:57.058923 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-fdc4b595-0afa-4cea-8e04-2db66fd24cbe req-03baee0e-4205-4b19-9663-f83b22842572 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079431 Oct 10 19:01:57.061094 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1563/2852] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:57.141620 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:57.174395 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-91369918-c92e-442f-b622-2e5bd0a5d0d6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:57.175079 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-91369918-c92e-442f-b622-2e5bd0a5d0d6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:57.190178 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91369918-c92e-442f-b622-2e5bd0a5d0d6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:57.197376 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91369918-c92e-442f-b622-2e5bd0a5d0d6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:57.200401 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91369918-c92e-442f-b622-2e5bd0a5d0d6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:57.212853 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91369918-c92e-442f-b622-2e5bd0a5d0d6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:57.213569 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91369918-c92e-442f-b622-2e5bd0a5d0d6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:57.214322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-91369918-c92e-442f-b622-2e5bd0a5d0d6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:57.349989 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cb8ef707-7464-480f-bf10-21a7ce2c3acd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:57.350605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cb8ef707-7464-480f-bf10-21a7ce2c3acd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:57.352697 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:57.370884 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cb8ef707-7464-480f-bf10-21a7ce2c3acd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:57.372487 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cb8ef707-7464-480f-bf10-21a7ce2c3acd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:57.373139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cb8ef707-7464-480f-bf10-21a7ce2c3acd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:57.374532 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cb8ef707-7464-480f-bf10-21a7ce2c3acd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:57.375160 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cb8ef707-7464-480f-bf10-21a7ce2c3acd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:57.376251 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cb8ef707-7464-480f-bf10-21a7ce2c3acd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:57.673903 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-91369918-c92e-442f-b622-2e5bd0a5d0d6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:57.694593 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-91369918-c92e-442f-b622-2e5bd0a5d0d6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1524 microversion: 2.1 time: 0.556209 Oct 10 19:01:57.703879 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1290/2853] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:57 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1524 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:57.736290 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ddd92071-59a6-4588-a554-eba1c9cb23df tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318db83430>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:57.831426 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ddd92071-59a6-4588-a554-eba1c9cb23df tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1413 microversion: 2.1 time: 0.121377 Oct 10 19:01:57.831905 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1291/2854] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:57 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1413 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:57.840063 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7aeb524e-8e87-4004-8662-23d5d0903ddc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:57.846576 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7aeb524e-8e87-4004-8662-23d5d0903ddc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:57.859583 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7aeb524e-8e87-4004-8662-23d5d0903ddc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:57.860809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7aeb524e-8e87-4004-8662-23d5d0903ddc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:57.861433 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7aeb524e-8e87-4004-8662-23d5d0903ddc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:57.862326 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7aeb524e-8e87-4004-8662-23d5d0903ddc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:57.863722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7aeb524e-8e87-4004-8662-23d5d0903ddc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:57.868490 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7aeb524e-8e87-4004-8662-23d5d0903ddc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:58.307129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cb8ef707-7464-480f-bf10-21a7ce2c3acd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:58.320268 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=8 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:01:58.325883 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cb8ef707-7464-480f-bf10-21a7ce2c3acd tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1310 microversion: 2.1 time: 0.983390 Oct 10 19:01:58.326843 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1564/2855] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:57 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1310 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:58.379328 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7aeb524e-8e87-4004-8662-23d5d0903ddc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:58.390720 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7aeb524e-8e87-4004-8662-23d5d0903ddc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1314 microversion: 2.1 time: 0.557081 Oct 10 19:01:58.398168 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1292/2856] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:57 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:58.725439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bbc6f54b-3ada-4b01-8b56-82d9a98e22c8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:58.726078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bbc6f54b-3ada-4b01-8b56-82d9a98e22c8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:58.740219 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bbc6f54b-3ada-4b01-8b56-82d9a98e22c8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:58.741812 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bbc6f54b-3ada-4b01-8b56-82d9a98e22c8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:58.745426 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bbc6f54b-3ada-4b01-8b56-82d9a98e22c8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:58.746252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bbc6f54b-3ada-4b01-8b56-82d9a98e22c8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:58.746728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bbc6f54b-3ada-4b01-8b56-82d9a98e22c8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:58.747164 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bbc6f54b-3ada-4b01-8b56-82d9a98e22c8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:58.851321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-66cdff52-3eed-4300-842e-8f7a3bd46b85 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f3192229ca0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:58.951291 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-66cdff52-3eed-4300-842e-8f7a3bd46b85 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1413 microversion: 2.1 time: 0.107895 Oct 10 19:01:58.952233 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1293/2857] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:01:58 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1413 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:01:59.289397 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-cfc4a8f6-c5f7-47ba-9db1-769b6a22cb93 req-6688e246-95da-4377-bef8-2b66b1f9b952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c42d068-855b-4bd5-8269-ba4ac1d9949d", "tag": "3b30b8b6-7518-4fe2-bcb7-33c9494f7f67"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:01:59.314811 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-cfc4a8f6-c5f7-47ba-9db1-769b6a22cb93 req-6688e246-95da-4377-bef8-2b66b1f9b952 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:59.315299 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-cfc4a8f6-c5f7-47ba-9db1-769b6a22cb93 req-6688e246-95da-4377-bef8-2b66b1f9b952 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:59.318845 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-cfc4a8f6-c5f7-47ba-9db1-769b6a22cb93 req-6688e246-95da-4377-bef8-2b66b1f9b952 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:59.348329 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-cfc4a8f6-c5f7-47ba-9db1-769b6a22cb93 req-6688e246-95da-4377-bef8-2b66b1f9b952 service nova] Creating event network-changed:3b30b8b6-7518-4fe2-bcb7-33c9494f7f67 for instance 2c42d068-855b-4bd5-8269-ba4ac1d9949d on n-h1-860863-1 Oct 10 19:01:59.367736 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bbc6f54b-3ada-4b01-8b56-82d9a98e22c8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:01:59.393655 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-cfc4a8f6-c5f7-47ba-9db1-769b6a22cb93 req-6688e246-95da-4377-bef8-2b66b1f9b952 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108238 Oct 10 19:01:59.395857 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bbc6f54b-3ada-4b01-8b56-82d9a98e22c8 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1524 microversion: 2.1 time: 0.674268 Oct 10 19:01:59.396438 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1565/2858] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:58 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1524 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:01:59.400371 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1294/2859] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:01:59.407065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8ac83454-46b8-498b-bea2-3d703bccdb05 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:59.419199 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-731b790c-d1d4-4f34-9c6f-5d8dbc05a07a tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:01:59.424474 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8ac83454-46b8-498b-bea2-3d703bccdb05 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:59.434131 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-731b790c-d1d4-4f34-9c6f-5d8dbc05a07a tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:01:59.445790 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ac83454-46b8-498b-bea2-3d703bccdb05 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:59.446292 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ac83454-46b8-498b-bea2-3d703bccdb05 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:59.446733 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ac83454-46b8-498b-bea2-3d703bccdb05 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:59.447455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ac83454-46b8-498b-bea2-3d703bccdb05 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:59.447918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ac83454-46b8-498b-bea2-3d703bccdb05 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:59.448349 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8ac83454-46b8-498b-bea2-3d703bccdb05 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:59.454070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-731b790c-d1d4-4f34-9c6f-5d8dbc05a07a tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:59.454675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-731b790c-d1d4-4f34-9c6f-5d8dbc05a07a tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:59.455130 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-731b790c-d1d4-4f34-9c6f-5d8dbc05a07a tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:01:59.455894 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-731b790c-d1d4-4f34-9c6f-5d8dbc05a07a tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:01:59.456384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-731b790c-d1d4-4f34-9c6f-5d8dbc05a07a tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:01:59.456843 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-731b790c-d1d4-4f34-9c6f-5d8dbc05a07a tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:00.563080 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-731b790c-d1d4-4f34-9c6f-5d8dbc05a07a tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:00.571808 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-731b790c-d1d4-4f34-9c6f-5d8dbc05a07a tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1314 microversion: 2.1 time: 1.160498 Oct 10 19:02:00.572398 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1295/2860] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:59 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1314 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:02:00.582646 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-565de37f-2605-49bf-ab23-b9f37b010692 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318dbd45e0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:00.663325 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-565de37f-2605-49bf-ab23-b9f37b010692 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1413 microversion: 2.1 time: 0.087303 Oct 10 19:02:00.671907 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1296/2861] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:02:00 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:00.677699 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-ebeb4bd3-499e-468e-9621-069549cd7d90 req-faef0337-66e1-4f3e-9024-045af9ce9647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cc13ed-22f0-4a0a-a65f-208bd80d70b2", "name": "network-vif-plugged", "status": "completed", "tag": "35cd11dc-afb2-4ad8-839a-5e9279495af4"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:00.699816 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-ebeb4bd3-499e-468e-9621-069549cd7d90 req-faef0337-66e1-4f3e-9024-045af9ce9647 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:00.700333 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-ebeb4bd3-499e-468e-9621-069549cd7d90 req-faef0337-66e1-4f3e-9024-045af9ce9647 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:00.701670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-ebeb4bd3-499e-468e-9621-069549cd7d90 req-faef0337-66e1-4f3e-9024-045af9ce9647 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:00.724813 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-ebeb4bd3-499e-468e-9621-069549cd7d90 req-faef0337-66e1-4f3e-9024-045af9ce9647 service nova] Creating event network-vif-plugged:35cd11dc-afb2-4ad8-839a-5e9279495af4 for instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 on n-h2-860863-1 Oct 10 19:02:00.733647 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-ebeb4bd3-499e-468e-9621-069549cd7d90 req-faef0337-66e1-4f3e-9024-045af9ce9647 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060156 Oct 10 19:02:00.740098 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1297/2862] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:00.762330 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8ac83454-46b8-498b-bea2-3d703bccdb05 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:00.796863 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8952fd84-d3e4-42fe-99aa-4ed56fec249e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:00.797587 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8952fd84-d3e4-42fe-99aa-4ed56fec249e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:00.798304 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8ac83454-46b8-498b-bea2-3d703bccdb05 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1310 microversion: 2.1 time: 1.377832 Oct 10 19:02:00.799559 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1566/2863] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:01:59 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1310 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:00.823961 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8952fd84-d3e4-42fe-99aa-4ed56fec249e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:00.829670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8952fd84-d3e4-42fe-99aa-4ed56fec249e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:00.831447 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8952fd84-d3e4-42fe-99aa-4ed56fec249e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:00.836950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8952fd84-d3e4-42fe-99aa-4ed56fec249e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:00.836950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8952fd84-d3e4-42fe-99aa-4ed56fec249e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:00.836950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8952fd84-d3e4-42fe-99aa-4ed56fec249e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:01.191564 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8952fd84-d3e4-42fe-99aa-4ed56fec249e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:01.201595 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8952fd84-d3e4-42fe-99aa-4ed56fec249e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1524 microversion: 2.1 time: 0.459164 Oct 10 19:02:01.219643 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1298/2864] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:00 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1524 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:01.602559 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0ac8884e-4cca-43f0-be16-48d638b5bf41 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:01.603829 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0ac8884e-4cca-43f0-be16-48d638b5bf41 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:01.610436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ac8884e-4cca-43f0-be16-48d638b5bf41 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:01.611068 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ac8884e-4cca-43f0-be16-48d638b5bf41 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:01.611615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ac8884e-4cca-43f0-be16-48d638b5bf41 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:01.612472 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ac8884e-4cca-43f0-be16-48d638b5bf41 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:01.613446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ac8884e-4cca-43f0-be16-48d638b5bf41 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:01.613995 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0ac8884e-4cca-43f0-be16-48d638b5bf41 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:01.680706 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fbc952d2-d5ce-493a-b80b-85d186919516 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318dcce280>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:01.759506 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fbc952d2-d5ce-493a-b80b-85d186919516 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1413 microversion: 2.1 time: 0.083158 Oct 10 19:02:01.760609 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1299/2865] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:02:01 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:02:01.825757 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cb73fa88-0511-4c5d-b5e6-9493bf018d36 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:01.827063 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cb73fa88-0511-4c5d-b5e6-9493bf018d36 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:01.839486 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cb73fa88-0511-4c5d-b5e6-9493bf018d36 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:01.841381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cb73fa88-0511-4c5d-b5e6-9493bf018d36 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:01.843628 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cb73fa88-0511-4c5d-b5e6-9493bf018d36 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:01.848207 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cb73fa88-0511-4c5d-b5e6-9493bf018d36 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:01.849864 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cb73fa88-0511-4c5d-b5e6-9493bf018d36 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:01.850661 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cb73fa88-0511-4c5d-b5e6-9493bf018d36 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:02.238923 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0ac8884e-4cca-43f0-be16-48d638b5bf41 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:02.254300 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0ac8884e-4cca-43f0-be16-48d638b5bf41 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1314 microversion: 2.1 time: 0.654133 Oct 10 19:02:02.255670 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1567/2866] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:01 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:02.272978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-5bbd004e-81bd-4e2f-bbf4-8076d992641d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:02.278122 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-5bbd004e-81bd-4e2f-bbf4-8076d992641d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:02.290826 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5bbd004e-81bd-4e2f-bbf4-8076d992641d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:02.291654 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5bbd004e-81bd-4e2f-bbf4-8076d992641d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:02.294641 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5bbd004e-81bd-4e2f-bbf4-8076d992641d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:02.298416 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5bbd004e-81bd-4e2f-bbf4-8076d992641d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:02.299098 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5bbd004e-81bd-4e2f-bbf4-8076d992641d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:02.299823 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-5bbd004e-81bd-4e2f-bbf4-8076d992641d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:02.407210 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cb73fa88-0511-4c5d-b5e6-9493bf018d36 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:02.420528 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cb73fa88-0511-4c5d-b5e6-9493bf018d36 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1310 microversion: 2.1 time: 0.599269 Oct 10 19:02:02.434285 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1300/2867] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:01 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1310 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:02.727031 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-5bbd004e-81bd-4e2f-bbf4-8076d992641d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:02.736089 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-5bbd004e-81bd-4e2f-bbf4-8076d992641d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1524 microversion: 2.1 time: 0.479300 Oct 10 19:02:02.743014 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1568/2868] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:02 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1524 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:02.776983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8ef534fc-2283-404a-88dc-3111ee043daa tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318e7c6790>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:02.783563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=16 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:02.851230 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8ef534fc-2283-404a-88dc-3111ee043daa tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1413 microversion: 2.1 time: 0.078160 Oct 10 19:02:02.852593 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1301/2869] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:02:02 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:03.282280 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-aa1a9dce-d110-482e-91b7-ae5288fadf88 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:03.283407 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-aa1a9dce-d110-482e-91b7-ae5288fadf88 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:03.295393 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-aa1a9dce-d110-482e-91b7-ae5288fadf88 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:03.296413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-aa1a9dce-d110-482e-91b7-ae5288fadf88 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:03.296413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-aa1a9dce-d110-482e-91b7-ae5288fadf88 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:03.303743 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-aa1a9dce-d110-482e-91b7-ae5288fadf88 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:03.309319 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-aa1a9dce-d110-482e-91b7-ae5288fadf88 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:03.309869 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-aa1a9dce-d110-482e-91b7-ae5288fadf88 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:03.449596 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f762920a-ce32-489d-89c2-ae7c14b00feb tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:03.457818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f762920a-ce32-489d-89c2-ae7c14b00feb tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:03.476520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f762920a-ce32-489d-89c2-ae7c14b00feb tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:03.480043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f762920a-ce32-489d-89c2-ae7c14b00feb tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:03.480663 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f762920a-ce32-489d-89c2-ae7c14b00feb tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:03.481411 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f762920a-ce32-489d-89c2-ae7c14b00feb tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:03.481874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f762920a-ce32-489d-89c2-ae7c14b00feb tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:03.482303 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f762920a-ce32-489d-89c2-ae7c14b00feb tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:03.896136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f762920a-ce32-489d-89c2-ae7c14b00feb tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:03.906210 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f762920a-ce32-489d-89c2-ae7c14b00feb tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1310 microversion: 2.1 time: 0.462513 Oct 10 19:02:03.909430 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1302/2870] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:03 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1310 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:03.936721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-140df117-56fc-4214-bb98-6a0fb116d96f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:03.942265 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-140df117-56fc-4214-bb98-6a0fb116d96f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:03.957970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140df117-56fc-4214-bb98-6a0fb116d96f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:03.958419 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140df117-56fc-4214-bb98-6a0fb116d96f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:03.958850 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140df117-56fc-4214-bb98-6a0fb116d96f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:03.959549 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140df117-56fc-4214-bb98-6a0fb116d96f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:03.959994 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140df117-56fc-4214-bb98-6a0fb116d96f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:03.960616 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-140df117-56fc-4214-bb98-6a0fb116d96f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:04.265704 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-aa1a9dce-d110-482e-91b7-ae5288fadf88 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:04.285287 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-aa1a9dce-d110-482e-91b7-ae5288fadf88 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1314 microversion: 2.1 time: 1.006376 Oct 10 19:02:04.306532 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1569/2871] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:03 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1314 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:04.312436 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-169a0c9a-9af4-4d10-a926-564f3e51329d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318d0ff790>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:04.388051 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-169a0c9a-9af4-4d10-a926-564f3e51329d tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1413 microversion: 2.1 time: 0.087866 Oct 10 19:02:04.408052 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1570/2872] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:02:04 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:04.498118 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-140df117-56fc-4214-bb98-6a0fb116d96f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:04.514269 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-140df117-56fc-4214-bb98-6a0fb116d96f tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1509 microversion: 2.1 time: 0.587080 Oct 10 19:02:04.539459 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1303/2873] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:03 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1509 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:04.544908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8e26ad97-39ad-4697-b786-eedb54035171 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:04.545610 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8e26ad97-39ad-4697-b786-eedb54035171 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:04.555710 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e26ad97-39ad-4697-b786-eedb54035171 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:04.561342 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e26ad97-39ad-4697-b786-eedb54035171 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:04.565951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e26ad97-39ad-4697-b786-eedb54035171 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:04.565951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e26ad97-39ad-4697-b786-eedb54035171 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:04.565951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e26ad97-39ad-4697-b786-eedb54035171 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:04.565951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e26ad97-39ad-4697-b786-eedb54035171 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:04.749442 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-d4018e0e-785c-4922-b476-fe91d44f888a req-fbffcb6f-574e-4380-9d2f-18d807271daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e33016a-8156-4050-bcbd-fdd7a29b865b", "name": "network-vif-plugged", "status": "completed", "tag": "94d9fd5e-4a38-41be-9347-cbd7946570c6"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:04.765336 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d4018e0e-785c-4922-b476-fe91d44f888a req-fbffcb6f-574e-4380-9d2f-18d807271daf service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:04.768772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d4018e0e-785c-4922-b476-fe91d44f888a req-fbffcb6f-574e-4380-9d2f-18d807271daf service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:04.768772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-d4018e0e-785c-4922-b476-fe91d44f888a req-fbffcb6f-574e-4380-9d2f-18d807271daf service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:04.782495 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-d4018e0e-785c-4922-b476-fe91d44f888a req-fbffcb6f-574e-4380-9d2f-18d807271daf service nova] Creating event network-vif-plugged:94d9fd5e-4a38-41be-9347-cbd7946570c6 for instance 7e33016a-8156-4050-bcbd-fdd7a29b865b on n-h1-860863-1 Oct 10 19:02:04.789957 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-d4018e0e-785c-4922-b476-fe91d44f888a req-fbffcb6f-574e-4380-9d2f-18d807271daf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043583 Oct 10 19:02:04.796274 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1304/2874] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:04.813356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-8e26ad97-39ad-4697-b786-eedb54035171 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:04.821308 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8e26ad97-39ad-4697-b786-eedb54035171 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 200 len: 1509 microversion: 2.1 time: 0.280958 Oct 10 19:02:04.825497 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1571/2875] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:04 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:04.855821 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8d2bf0ac-fda4-457a-9cf3-e88bd8692545 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:04.856613 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8d2bf0ac-fda4-457a-9cf3-e88bd8692545 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:04.893047 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d2bf0ac-fda4-457a-9cf3-e88bd8692545 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:04.893556 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d2bf0ac-fda4-457a-9cf3-e88bd8692545 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:04.901237 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d2bf0ac-fda4-457a-9cf3-e88bd8692545 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:04.903542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d2bf0ac-fda4-457a-9cf3-e88bd8692545 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:04.911747 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d2bf0ac-fda4-457a-9cf3-e88bd8692545 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:04.915694 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8d2bf0ac-fda4-457a-9cf3-e88bd8692545 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:05.016103 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8d2bf0ac-fda4-457a-9cf3-e88bd8692545 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:02:05.178836 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-758306128", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "27bdd9b1-d3c3-47a6-969c-6db215f9409f"}]}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:05.486927 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8d2bf0ac-fda4-457a-9cf3-e88bd8692545 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 204 len: 0 microversion: 2.1 time: 0.633498 Oct 10 19:02:05.486927 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1572/2876] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:02:04 2022] DELETE /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:02:05.510917 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-3a52ffdd-01a1-44e0-9da3-eb3d3ad375f7 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:05.510917 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-3a52ffdd-01a1-44e0-9da3-eb3d3ad375f7 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:05.539958 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a52ffdd-01a1-44e0-9da3-eb3d3ad375f7 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:05.539958 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a52ffdd-01a1-44e0-9da3-eb3d3ad375f7 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:05.540157 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a52ffdd-01a1-44e0-9da3-eb3d3ad375f7 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:05.545745 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a52ffdd-01a1-44e0-9da3-eb3d3ad375f7 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:05.546548 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a52ffdd-01a1-44e0-9da3-eb3d3ad375f7 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:05.553880 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-3a52ffdd-01a1-44e0-9da3-eb3d3ad375f7 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:05.833614 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-3a52ffdd-01a1-44e0-9da3-eb3d3ad375f7 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:05.845631 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-3a52ffdd-01a1-44e0-9da3-eb3d3ad375f7 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1310 microversion: 2.1 time: 0.345738 Oct 10 19:02:05.847147 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1573/2877] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:05 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1310 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:05.868209 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6b57c9e6-1154-48f0-9172-fa4c99546b80 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:05.871303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6b57c9e6-1154-48f0-9172-fa4c99546b80 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:05.888600 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b57c9e6-1154-48f0-9172-fa4c99546b80 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:05.890290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b57c9e6-1154-48f0-9172-fa4c99546b80 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:05.890881 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b57c9e6-1154-48f0-9172-fa4c99546b80 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:05.894220 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b57c9e6-1154-48f0-9172-fa4c99546b80 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:05.895658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b57c9e6-1154-48f0-9172-fa4c99546b80 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:05.896194 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6b57c9e6-1154-48f0-9172-fa4c99546b80 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:06.105658 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6b57c9e6-1154-48f0-9172-fa4c99546b80 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:06.115921 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6b57c9e6-1154-48f0-9172-fa4c99546b80 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1314 microversion: 2.1 time: 0.262176 Oct 10 19:02:06.116951 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1574/2878] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:05 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:06.123071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-653012d4-1b05-480c-a5fa-e87f95a05f04 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318ddbc820>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:14.199672 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.network.neutron [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] validate_networks() for [('27bdd9b1-d3c3-47a6-969c-6db215f9409f', None, None, None, None, None)] {{(pid=127289) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 19:02:14.233894 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-653012d4-1b05-480c-a5fa-e87f95a05f04 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1422 microversion: 2.1 time: 8.112985 Oct 10 19:02:14.236399 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1575/2879] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:02:06 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1422 bytes in 8118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:14.250290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-652109003", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "472b8abb-e92b-4e24-8d15-9ea81e05fe68"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:14.278692 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:14.353534 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] validate_networks() for [('472b8abb-e92b-4e24-8d15-9ea81e05fe68', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 19:02:14.767479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Flavor limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 19:02:14.769469 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Image limits 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 19:02:14.770198 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Flavor pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 19:02:14.770786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Image pref 0:0:0 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 19:02:14.771380 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.virt.hardware [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127289) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 19:02:14.778263 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=58 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:14.786862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:14.787723 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:14.788884 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:14.790180 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:14.790816 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:14.791300 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:14.814984 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Getting quotas for project 5eb1c539ef954d02a72a38ad8d8061e5. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 19:02:14.817730 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Getting quotas for user 2e80178dc7fa41f2bc7253dae37e7624 and project 5eb1c539ef954d02a72a38ad8d8061e5. Resources: {'ram', 'cores', 'instances'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 19:02:14.832801 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Going to run 1 instances... {{(pid=127289) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 19:02:14.835559 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127289) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 19:02:15.016370 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d1a05413-998b-48c2-a2a6-af1b70f7f064 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.211399 Oct 10 19:02:15.022666 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1305/2880] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 19:02:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 10218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 19:02:15.043769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3b40b481-ff52-4027-8dfa-4cb893292029 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:15.045327 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3b40b481-ff52-4027-8dfa-4cb893292029 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:15.062148 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b40b481-ff52-4027-8dfa-4cb893292029 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:15.062827 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b40b481-ff52-4027-8dfa-4cb893292029 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:15.063370 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b40b481-ff52-4027-8dfa-4cb893292029 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:15.064303 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b40b481-ff52-4027-8dfa-4cb893292029 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:15.065794 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b40b481-ff52-4027-8dfa-4cb893292029 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:15.066595 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3b40b481-ff52-4027-8dfa-4cb893292029 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:15.353296 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 19:02:15.363109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 19:02:15.363109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 19:02:15.363109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 19:02:15.363109 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 19:02:15.364463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:15.364982 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:15.365420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:15.366157 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:15.366614 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:15.367331 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:15.389574 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Getting quotas for project e2cfbbf586f5441e80930980df18d471. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 19:02:15.397589 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Getting quotas for user b83cb923e3064ac7aeb1bd6883415e9f and project e2cfbbf586f5441e80930980df18d471. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 19:02:15.404518 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3b40b481-ff52-4027-8dfa-4cb893292029 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:15.413500 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 19:02:15.416342 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 19:02:15.419832 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3b40b481-ff52-4027-8dfa-4cb893292029 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1493 microversion: 2.1 time: 0.394512 Oct 10 19:02:15.431912 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1306/2881] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:15 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1493 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:15.431912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d035fda2-fbf1-45d3-af6c-ffd1458c9b18 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:15.431912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d035fda2-fbf1-45d3-af6c-ffd1458c9b18 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:15.438756 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d035fda2-fbf1-45d3-af6c-ffd1458c9b18 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:15.439563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d035fda2-fbf1-45d3-af6c-ffd1458c9b18 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:15.440161 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d035fda2-fbf1-45d3-af6c-ffd1458c9b18 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:15.441661 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d035fda2-fbf1-45d3-af6c-ffd1458c9b18 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:15.442499 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d035fda2-fbf1-45d3-af6c-ffd1458c9b18 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:15.443039 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d035fda2-fbf1-45d3-af6c-ffd1458c9b18 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:15.600328 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-64690030-31a8-468a-be92-8caeed5c6f3a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.360384 Oct 10 19:02:15.603678 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1576/2882] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 19:02:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 19:02:15.614663 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-0a597a70-3c6d-4ed6-b6d6-c7de0bc5ba89 req-18696a36-2c02-45de-8f9e-11a433e3aa86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cc13ed-22f0-4a0a-a65f-208bd80d70b2", "name": "network-vif-deleted", "tag": "35cd11dc-afb2-4ad8-839a-5e9279495af4"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:15.643835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0a597a70-3c6d-4ed6-b6d6-c7de0bc5ba89 req-18696a36-2c02-45de-8f9e-11a433e3aa86 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:15.644320 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0a597a70-3c6d-4ed6-b6d6-c7de0bc5ba89 req-18696a36-2c02-45de-8f9e-11a433e3aa86 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:15.644784 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-0a597a70-3c6d-4ed6-b6d6-c7de0bc5ba89 req-18696a36-2c02-45de-8f9e-11a433e3aa86 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:15.659445 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-0a597a70-3c6d-4ed6-b6d6-c7de0bc5ba89 req-18696a36-2c02-45de-8f9e-11a433e3aa86 service nova] Creating event network-vif-deleted:35cd11dc-afb2-4ad8-839a-5e9279495af4 for instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 on n-h2-860863-1 Oct 10 19:02:15.665237 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-0a597a70-3c6d-4ed6-b6d6-c7de0bc5ba89 req-18696a36-2c02-45de-8f9e-11a433e3aa86 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062536 Oct 10 19:02:15.666063 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1577/2883] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:15.672864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-401decff-d595-4a79-9014-5c994c047c60 req-c8c78d0b-9098-42b1-b9a5-c766e4ca02f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c42d068-855b-4bd5-8269-ba4ac1d9949d", "name": "network-vif-plugged", "status": "completed", "tag": "3b30b8b6-7518-4fe2-bcb7-33c9494f7f67"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:15.698713 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-401decff-d595-4a79-9014-5c994c047c60 req-c8c78d0b-9098-42b1-b9a5-c766e4ca02f7 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:15.700074 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-401decff-d595-4a79-9014-5c994c047c60 req-c8c78d0b-9098-42b1-b9a5-c766e4ca02f7 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:15.702175 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-401decff-d595-4a79-9014-5c994c047c60 req-c8c78d0b-9098-42b1-b9a5-c766e4ca02f7 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:15.729611 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-401decff-d595-4a79-9014-5c994c047c60 req-c8c78d0b-9098-42b1-b9a5-c766e4ca02f7 service nova] Creating event network-vif-plugged:3b30b8b6-7518-4fe2-bcb7-33c9494f7f67 for instance 2c42d068-855b-4bd5-8269-ba4ac1d9949d on n-h1-860863-1 Oct 10 19:02:15.745270 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-401decff-d595-4a79-9014-5c994c047c60 req-c8c78d0b-9098-42b1-b9a5-c766e4ca02f7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077351 Oct 10 19:02:15.746225 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1578/2884] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:15.758769 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9210f0f1-c1e0-4716-8e86-26e4499af2aa tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318d1353a0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:15.847531 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9210f0f1-c1e0-4716-8e86-26e4499af2aa tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 200 len: 1422 microversion: 2.1 time: 0.099450 Oct 10 19:02:15.848126 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1579/2885] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:02:15 2022] GET /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:15.865650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bbf7e8cf-b637-4aed-9525-04fb43d9ea19 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:15.873679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bbf7e8cf-b637-4aed-9525-04fb43d9ea19 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:16.014667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bbf7e8cf-b637-4aed-9525-04fb43d9ea19 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:16.025621 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bbf7e8cf-b637-4aed-9525-04fb43d9ea19 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1224 microversion: 2.1 time: 0.176375 Oct 10 19:02:16.026332 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1580/2886] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:15 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1224 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:16.042829 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d035fda2-fbf1-45d3-af6c-ffd1458c9b18 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:16.043760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2c3656d2-ea59-49e6-8612-024165da6736 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:16.044698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2c3656d2-ea59-49e6-8612-024165da6736 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:16.054055 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c3656d2-ea59-49e6-8612-024165da6736 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:16.054705 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c3656d2-ea59-49e6-8612-024165da6736 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:16.055248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c3656d2-ea59-49e6-8612-024165da6736 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:16.056066 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c3656d2-ea59-49e6-8612-024165da6736 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:16.056961 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c3656d2-ea59-49e6-8612-024165da6736 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:16.057452 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d035fda2-fbf1-45d3-af6c-ffd1458c9b18 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1314 microversion: 2.1 time: 0.635576 Oct 10 19:02:16.057760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2c3656d2-ea59-49e6-8612-024165da6736 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:16.058249 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1307/2887] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:15 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:16.067727 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b05fd91e-df0f-415d-a5ab-547d526a7f96 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:16.073756 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b05fd91e-df0f-415d-a5ab-547d526a7f96 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:16.276072 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b05fd91e-df0f-415d-a5ab-547d526a7f96 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:16.286264 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b05fd91e-df0f-415d-a5ab-547d526a7f96 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1217 microversion: 2.1 time: 0.226782 Oct 10 19:02:16.296565 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1308/2888] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:16 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1217 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:16.302697 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f6669178-8ee3-4b44-8ee5-e804f22bef93 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318dd535e0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:16.353304 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2c3656d2-ea59-49e6-8612-024165da6736 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1644 microversion: 2.1 time: 0.314619 Oct 10 19:02:16.353957 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1581/2889] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:16 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1644 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:16.379897 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-59897e75-262c-4ad4-84a6-e6dd4abc5f9d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:16.380508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-59897e75-262c-4ad4-84a6-e6dd4abc5f9d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:16.387211 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59897e75-262c-4ad4-84a6-e6dd4abc5f9d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:16.387907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59897e75-262c-4ad4-84a6-e6dd4abc5f9d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:16.388510 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59897e75-262c-4ad4-84a6-e6dd4abc5f9d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:16.389450 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59897e75-262c-4ad4-84a6-e6dd4abc5f9d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:16.390044 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59897e75-262c-4ad4-84a6-e6dd4abc5f9d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:16.390624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-59897e75-262c-4ad4-84a6-e6dd4abc5f9d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:16.607113 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-59897e75-262c-4ad4-84a6-e6dd4abc5f9d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1644 microversion: 2.1 time: 0.230445 Oct 10 19:02:16.608628 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1582/2890] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:16 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1644 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:16.639217 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a073cd2d-6bb5-4d4c-94a4-48bfdb5e90f1 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:16.646158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a073cd2d-6bb5-4d4c-94a4-48bfdb5e90f1 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:16.646973 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a073cd2d-6bb5-4d4c-94a4-48bfdb5e90f1 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:16.647650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a073cd2d-6bb5-4d4c-94a4-48bfdb5e90f1 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:16.651602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a073cd2d-6bb5-4d4c-94a4-48bfdb5e90f1 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:16.651602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a073cd2d-6bb5-4d4c-94a4-48bfdb5e90f1 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:16.651602 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a073cd2d-6bb5-4d4c-94a4-48bfdb5e90f1 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:16.683878 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a073cd2d-6bb5-4d4c-94a4-48bfdb5e90f1 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.056774 Oct 10 19:02:16.693711 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1583/2891] 10.222.0.43 () {58 vars in 1176 bytes} [Mon Oct 10 19:02:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 19:02:16.708913 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-04682646-a2a1-4277-87bf-378c56166ace tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:16.709854 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-04682646-a2a1-4277-87bf-378c56166ace tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:16.724565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04682646-a2a1-4277-87bf-378c56166ace tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:16.726316 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04682646-a2a1-4277-87bf-378c56166ace tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:16.726316 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04682646-a2a1-4277-87bf-378c56166ace tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:16.726818 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04682646-a2a1-4277-87bf-378c56166ace tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:16.727293 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04682646-a2a1-4277-87bf-378c56166ace tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:16.727722 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04682646-a2a1-4277-87bf-378c56166ace tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:16.774091 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:17.120496 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-04682646-a2a1-4277-87bf-378c56166ace tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b/action" status: 202 len: 0 microversion: 2.1 time: 0.421385 Oct 10 19:02:17.122280 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1584/2892] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:02:16 2022] POST /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 19:02:17.134570 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d3fea7b8-deba-4aa3-b30c-230771d1ef95 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:17.138460 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d3fea7b8-deba-4aa3-b30c-230771d1ef95 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:17.153202 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d3fea7b8-deba-4aa3-b30c-230771d1ef95 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:17.154210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d3fea7b8-deba-4aa3-b30c-230771d1ef95 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:17.154841 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d3fea7b8-deba-4aa3-b30c-230771d1ef95 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:17.155753 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d3fea7b8-deba-4aa3-b30c-230771d1ef95 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:17.158765 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d3fea7b8-deba-4aa3-b30c-230771d1ef95 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:17.160689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d3fea7b8-deba-4aa3-b30c-230771d1ef95 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:17.252414 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d3fea7b8-deba-4aa3-b30c-230771d1ef95 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:17.270703 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d3fea7b8-deba-4aa3-b30c-230771d1ef95 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1220 microversion: 2.1 time: 0.146359 Oct 10 19:02:17.287889 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1585/2893] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:17 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1220 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:17.299078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c732f171-94a1-4800-a7f5-06b0132c784c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:17.299078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c732f171-94a1-4800-a7f5-06b0132c784c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:17.305260 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c732f171-94a1-4800-a7f5-06b0132c784c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:17.307208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c732f171-94a1-4800-a7f5-06b0132c784c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:17.307208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c732f171-94a1-4800-a7f5-06b0132c784c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:17.307208 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c732f171-94a1-4800-a7f5-06b0132c784c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:17.307957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c732f171-94a1-4800-a7f5-06b0132c784c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:17.307957 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c732f171-94a1-4800-a7f5-06b0132c784c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:17.802360 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c732f171-94a1-4800-a7f5-06b0132c784c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:17.819020 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c732f171-94a1-4800-a7f5-06b0132c784c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1314 microversion: 2.1 time: 0.523936 Oct 10 19:02:17.819020 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1586/2894] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:17 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:17.819715 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-273b037d-71cd-4360-920e-e59a5eddc10c tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:17.820328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-273b037d-71cd-4360-920e-e59a5eddc10c tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:17.832317 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-273b037d-71cd-4360-920e-e59a5eddc10c tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:17.833071 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-273b037d-71cd-4360-920e-e59a5eddc10c tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:17.833745 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-273b037d-71cd-4360-920e-e59a5eddc10c tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:17.834677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-273b037d-71cd-4360-920e-e59a5eddc10c tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:17.835347 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-273b037d-71cd-4360-920e-e59a5eddc10c tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:17.836137 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-273b037d-71cd-4360-920e-e59a5eddc10c tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:17.941181 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f6669178-8ee3-4b44-8ee5-e804f22bef93 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "DELETE /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537" status: 204 len: 0 microversion: 2.1 time: 1.646681 Oct 10 19:02:17.941181 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1309/2895] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:16 2022] DELETE /compute/v2.1/images/d9f05114-7962-47fb-bf3f-e1107635b537 => generated 0 bytes in 1648 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:02:17.943175 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c84fa982-bad3-429a-854c-a1a573cb530d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:17.943775 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c84fa982-bad3-429a-854c-a1a573cb530d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:17.951836 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c84fa982-bad3-429a-854c-a1a573cb530d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:17.952324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c84fa982-bad3-429a-854c-a1a573cb530d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:17.952787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c84fa982-bad3-429a-854c-a1a573cb530d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:17.953473 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c84fa982-bad3-429a-854c-a1a573cb530d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:17.954195 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c84fa982-bad3-429a-854c-a1a573cb530d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:17.954622 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c84fa982-bad3-429a-854c-a1a573cb530d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:18.028723 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-273b037d-71cd-4360-920e-e59a5eddc10c tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1629 microversion: 2.1 time: 0.213615 Oct 10 19:02:18.031342 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1587/2896] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:17 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1629 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:18.032099 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c84fa982-bad3-429a-854c-a1a573cb530d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:18.037615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-1a9ba5e6-d245-46fa-968f-f9acd0d022a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:18.038413 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1a9ba5e6-d245-46fa-968f-f9acd0d022a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:18.047072 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c84fa982-bad3-429a-854c-a1a573cb530d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1213 microversion: 2.1 time: 0.108271 Oct 10 19:02:18.048135 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a9ba5e6-d245-46fa-968f-f9acd0d022a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:18.050518 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1310/2897] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:17 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:18.064675 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a9ba5e6-d245-46fa-968f-f9acd0d022a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:18.064675 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a9ba5e6-d245-46fa-968f-f9acd0d022a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:18.064675 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a9ba5e6-d245-46fa-968f-f9acd0d022a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:18.064675 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a9ba5e6-d245-46fa-968f-f9acd0d022a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:18.064675 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-1a9ba5e6-d245-46fa-968f-f9acd0d022a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:18.065109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-95ee302e-377a-4623-9af9-56c1773e8a97 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860863-1", "block_migration": true, "disk_over_commit": false}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:18.065109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-95ee302e-377a-4623-9af9-56c1773e8a97 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:18.065109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-95ee302e-377a-4623-9af9-56c1773e8a97 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:18.065109 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-95ee302e-377a-4623-9af9-56c1773e8a97 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:18.065504 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-95ee302e-377a-4623-9af9-56c1773e8a97 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:18.066386 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-95ee302e-377a-4623-9af9-56c1773e8a97 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:18.067132 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-95ee302e-377a-4623-9af9-56c1773e8a97 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:18.067779 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-95ee302e-377a-4623-9af9-56c1773e8a97 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:18.102442 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-95ee302e-377a-4623-9af9-56c1773e8a97 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lazy-loading 'flavor' on Instance uuid 7e33016a-8156-4050-bcbd-fdd7a29b865b {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:02:18.104594 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-1a9ba5e6-d245-46fa-968f-f9acd0d022a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:02:18.121212 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-95ee302e-377a-4623-9af9-56c1773e8a97 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Going to try to live migrate instance to n-h2-860863-1 {{(pid=127289) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 10 19:02:18.404191 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-1a9ba5e6-d245-46fa-968f-f9acd0d022a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "DELETE /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b" status: 204 len: 0 microversion: 2.1 time: 0.373044 Oct 10 19:02:18.405254 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1588/2898] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:02:18 2022] DELETE /compute/v2.1/servers/154d20fa-a1d2-4bfd-99ab-024ddf8ae67b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:02:18.414885 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-04f0c562-e8d5-4d4d-8bb3-440800669935 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:18.416729 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-04f0c562-e8d5-4d4d-8bb3-440800669935 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:18.425563 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04f0c562-e8d5-4d4d-8bb3-440800669935 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:18.426309 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04f0c562-e8d5-4d4d-8bb3-440800669935 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:18.427095 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04f0c562-e8d5-4d4d-8bb3-440800669935 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:18.429759 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04f0c562-e8d5-4d4d-8bb3-440800669935 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:18.430624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04f0c562-e8d5-4d4d-8bb3-440800669935 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:18.431573 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-04f0c562-e8d5-4d4d-8bb3-440800669935 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:18.665978 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-04f0c562-e8d5-4d4d-8bb3-440800669935 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:18.679384 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-04f0c562-e8d5-4d4d-8bb3-440800669935 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1284 microversion: 2.1 time: 0.272770 Oct 10 19:02:18.681704 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1589/2899] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:18 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1284 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:18.686262 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1354354358", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "66c8ea36-6ebd-4d4c-b51b-1928dacdf136"}]}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:18.789376 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] validate_networks() for [('66c8ea36-6ebd-4d4c-b51b-1928dacdf136', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 19:02:19.461558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 19:02:19.462718 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 19:02:19.463433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 19:02:19.464267 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 19:02:19.465188 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 19:02:19.476335 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:19.477049 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:19.478788 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:19.478788 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:19.479164 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:19.479758 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:19.508155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Getting quotas for project bd2cfdbce62b4c72b773d5312d02ab40. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 19:02:19.508155 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Getting quotas for user 76ba48b4475d429f884546750a467e14 and project bd2cfdbce62b4c72b773d5312d02ab40. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 19:02:19.530317 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 19:02:19.540762 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 19:02:19.702809 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-f7b33dc2-0729-409f-810b-596347ca6a1a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.021466 Oct 10 19:02:19.703509 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1590/2900] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 19:02:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 19:02:19.718167 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a73eae27-aa9c-4d8d-80a2-9ab2be234dc2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:19.718167 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a73eae27-aa9c-4d8d-80a2-9ab2be234dc2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:19.725495 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a73eae27-aa9c-4d8d-80a2-9ab2be234dc2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:19.726363 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a73eae27-aa9c-4d8d-80a2-9ab2be234dc2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:19.726994 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a73eae27-aa9c-4d8d-80a2-9ab2be234dc2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:19.727921 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a73eae27-aa9c-4d8d-80a2-9ab2be234dc2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:19.729569 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a73eae27-aa9c-4d8d-80a2-9ab2be234dc2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:19.730664 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a73eae27-aa9c-4d8d-80a2-9ab2be234dc2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:20.126179 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a73eae27-aa9c-4d8d-80a2-9ab2be234dc2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:20.136503 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a73eae27-aa9c-4d8d-80a2-9ab2be234dc2 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1500 microversion: 2.1 time: 0.423701 Oct 10 19:02:20.149468 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1591/2901] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:19 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1500 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:20.170251 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-d0c0b0ac-5dea-4e1f-9cb6-6c439df77b24 req-5964646b-c908-4ba1-bb92-ba56b1b0c3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154d20fa-a1d2-4bfd-99ab-024ddf8ae67b", "name": "network-vif-unplugged", "status": "completed", "tag": "d76218a1-c511-4bbd-bdc9-d8d4fda923c7"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:20.185044 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d0c0b0ac-5dea-4e1f-9cb6-6c439df77b24 req-5964646b-c908-4ba1-bb92-ba56b1b0c3b7 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:20.186344 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d0c0b0ac-5dea-4e1f-9cb6-6c439df77b24 req-5964646b-c908-4ba1-bb92-ba56b1b0c3b7 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:20.188151 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-d0c0b0ac-5dea-4e1f-9cb6-6c439df77b24 req-5964646b-c908-4ba1-bb92-ba56b1b0c3b7 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:20.202646 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-d0c0b0ac-5dea-4e1f-9cb6-6c439df77b24 req-5964646b-c908-4ba1-bb92-ba56b1b0c3b7 service nova] Creating event network-vif-unplugged:d76218a1-c511-4bbd-bdc9-d8d4fda923c7 for instance 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b on n-h1-860863-1 Oct 10 19:02:20.210397 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-d0c0b0ac-5dea-4e1f-9cb6-6c439df77b24 req-5964646b-c908-4ba1-bb92-ba56b1b0c3b7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058836 Oct 10 19:02:20.211187 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1592/2902] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:20.216756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ba39360c-ac09-4a72-8218-3a3d2a902bff tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:20.217459 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ba39360c-ac09-4a72-8218-3a3d2a902bff tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:20.226565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba39360c-ac09-4a72-8218-3a3d2a902bff tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:20.226565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba39360c-ac09-4a72-8218-3a3d2a902bff tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:20.226565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba39360c-ac09-4a72-8218-3a3d2a902bff tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:20.226565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba39360c-ac09-4a72-8218-3a3d2a902bff tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:20.227038 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba39360c-ac09-4a72-8218-3a3d2a902bff tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:20.227457 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba39360c-ac09-4a72-8218-3a3d2a902bff tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:20.351248 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ba39360c-ac09-4a72-8218-3a3d2a902bff tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:20.365792 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ba39360c-ac09-4a72-8218-3a3d2a902bff tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1275 microversion: 2.1 time: 0.153167 Oct 10 19:02:20.372591 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1593/2903] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:20 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:20.380411 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-17c3da82-f47e-42f9-a18e-f704d12406fc tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:20.383010 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-17c3da82-f47e-42f9-a18e-f704d12406fc tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:20.406269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17c3da82-f47e-42f9-a18e-f704d12406fc tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:20.406269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17c3da82-f47e-42f9-a18e-f704d12406fc tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:20.406269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17c3da82-f47e-42f9-a18e-f704d12406fc tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:20.406269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17c3da82-f47e-42f9-a18e-f704d12406fc tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:20.406269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17c3da82-f47e-42f9-a18e-f704d12406fc tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:20.406269 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-17c3da82-f47e-42f9-a18e-f704d12406fc tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:20.660611 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-17c3da82-f47e-42f9-a18e-f704d12406fc tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:20.669773 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-17c3da82-f47e-42f9-a18e-f704d12406fc tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1324 microversion: 2.1 time: 0.295776 Oct 10 19:02:20.677324 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1594/2904] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:20 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:20.684508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cd1f1efe-5887-4268-96d3-e35226c3100b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:20.685182 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cd1f1efe-5887-4268-96d3-e35226c3100b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:20.785617 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cd1f1efe-5887-4268-96d3-e35226c3100b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:20.798629 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cd1f1efe-5887-4268-96d3-e35226c3100b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1208 microversion: 2.1 time: 0.120034 Oct 10 19:02:20.816672 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1595/2905] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:20 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1208 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:20.816672 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-db1b9a19-aaf2-46e8-a2c7-630dd5e724d4 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:20.816672 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-db1b9a19-aaf2-46e8-a2c7-630dd5e724d4 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:20.825910 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db1b9a19-aaf2-46e8-a2c7-630dd5e724d4 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:20.826523 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db1b9a19-aaf2-46e8-a2c7-630dd5e724d4 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:20.827369 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db1b9a19-aaf2-46e8-a2c7-630dd5e724d4 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:20.828490 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db1b9a19-aaf2-46e8-a2c7-630dd5e724d4 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:20.829154 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db1b9a19-aaf2-46e8-a2c7-630dd5e724d4 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:20.829926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-db1b9a19-aaf2-46e8-a2c7-630dd5e724d4 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:20.863791 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-db1b9a19-aaf2-46e8-a2c7-630dd5e724d4 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lazy-loading 'flavor' on Instance uuid 2c42d068-855b-4bd5-8269-ba4ac1d9949d {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:02:21.295585 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-db1b9a19-aaf2-46e8-a2c7-630dd5e724d4 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "POST /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d/action" status: 200 len: 32 microversion: 2.1 time: 0.489434 Oct 10 19:02:21.296973 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1596/2906] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:02:20 2022] POST /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d/action => generated 32 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 10 19:02:21.347912 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d264a579-b916-4634-9108-78aa96616d60 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:21.353983 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d264a579-b916-4634-9108-78aa96616d60 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:21.361956 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d264a579-b916-4634-9108-78aa96616d60 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:21.363097 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d264a579-b916-4634-9108-78aa96616d60 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:21.363655 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d264a579-b916-4634-9108-78aa96616d60 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:21.364474 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d264a579-b916-4634-9108-78aa96616d60 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:21.365267 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d264a579-b916-4634-9108-78aa96616d60 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:21.365865 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d264a579-b916-4634-9108-78aa96616d60 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:21.809399 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d264a579-b916-4634-9108-78aa96616d60 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:21.838134 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d264a579-b916-4634-9108-78aa96616d60 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.526929 Oct 10 19:02:21.840487 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1597/2907] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:21 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:21.848061 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e079172d-7bbb-4dba-9c0d-d73bca68dc4a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:21.855045 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e079172d-7bbb-4dba-9c0d-d73bca68dc4a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:21.863158 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e079172d-7bbb-4dba-9c0d-d73bca68dc4a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:21.864723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e079172d-7bbb-4dba-9c0d-d73bca68dc4a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:21.865368 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e079172d-7bbb-4dba-9c0d-d73bca68dc4a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:21.866300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e079172d-7bbb-4dba-9c0d-d73bca68dc4a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:21.867798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e079172d-7bbb-4dba-9c0d-d73bca68dc4a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:21.868427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e079172d-7bbb-4dba-9c0d-d73bca68dc4a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:22.490958 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-95ee302e-377a-4623-9af9-56c1773e8a97 tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b/action" status: 202 len: 0 microversion: 2.1 time: 4.440894 Oct 10 19:02:22.491672 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1311/2908] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:02:18 2022] POST /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b/action => generated 0 bytes in 4442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 19:02:22.496827 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-5d0dbfcf-7577-48c2-be80-363bab8504a8 req-ac32b51e-b5fc-42e9-890f-83cd8c7344cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038abd42-6364-44c6-84e9-9590cdde6694", "tag": "d30dc884-4c47-4e80-bc36-38126af3d801"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:22.516197 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-5d0dbfcf-7577-48c2-be80-363bab8504a8 req-ac32b51e-b5fc-42e9-890f-83cd8c7344cc service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:22.517331 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-5d0dbfcf-7577-48c2-be80-363bab8504a8 req-ac32b51e-b5fc-42e9-890f-83cd8c7344cc service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:22.523606 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-5d0dbfcf-7577-48c2-be80-363bab8504a8 req-ac32b51e-b5fc-42e9-890f-83cd8c7344cc service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:22.538120 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-5d0dbfcf-7577-48c2-be80-363bab8504a8 req-ac32b51e-b5fc-42e9-890f-83cd8c7344cc service nova] Creating event network-changed:d30dc884-4c47-4e80-bc36-38126af3d801 for instance 038abd42-6364-44c6-84e9-9590cdde6694 on n-h2-860863-1 Oct 10 19:02:22.571250 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-5d0dbfcf-7577-48c2-be80-363bab8504a8 req-ac32b51e-b5fc-42e9-890f-83cd8c7344cc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077692 Oct 10 19:02:22.574163 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1312/2909] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:22.585776 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0103bbd5-06fb-4064-831f-bcd5dfa71e09 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:22.586086 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0103bbd5-06fb-4064-831f-bcd5dfa71e09 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:22.600309 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0103bbd5-06fb-4064-831f-bcd5dfa71e09 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:22.602190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0103bbd5-06fb-4064-831f-bcd5dfa71e09 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:22.602190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0103bbd5-06fb-4064-831f-bcd5dfa71e09 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:22.602403 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e079172d-7bbb-4dba-9c0d-d73bca68dc4a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:22.606313 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:22.611235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0103bbd5-06fb-4064-831f-bcd5dfa71e09 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:22.611910 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0103bbd5-06fb-4064-831f-bcd5dfa71e09 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:22.618420 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0103bbd5-06fb-4064-831f-bcd5dfa71e09 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:22.716222 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e079172d-7bbb-4dba-9c0d-d73bca68dc4a tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1317 microversion: 2.1 time: 0.873481 Oct 10 19:02:22.718333 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1598/2910] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:21 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1317 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:22.729420 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6daadc38-3b3d-41e8-965b-84459aaf29d0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:22.730065 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6daadc38-3b3d-41e8-965b-84459aaf29d0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:22.749554 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6daadc38-3b3d-41e8-965b-84459aaf29d0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:22.751273 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6daadc38-3b3d-41e8-965b-84459aaf29d0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:22.753242 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6daadc38-3b3d-41e8-965b-84459aaf29d0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:22.756673 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6daadc38-3b3d-41e8-965b-84459aaf29d0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:22.758650 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6daadc38-3b3d-41e8-965b-84459aaf29d0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:22.761358 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6daadc38-3b3d-41e8-965b-84459aaf29d0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:22.867725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6daadc38-3b3d-41e8-965b-84459aaf29d0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:22.885772 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6daadc38-3b3d-41e8-965b-84459aaf29d0 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1268 microversion: 2.1 time: 0.166294 Oct 10 19:02:22.887383 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1599/2911] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:22 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:22.893139 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-18837e59-ad2a-4c8f-831c-4631cedc8862 req-fb385ae8-26ce-4aff-af33-e825633e974a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154d20fa-a1d2-4bfd-99ab-024ddf8ae67b", "name": "network-vif-deleted", "tag": "d76218a1-c511-4bbd-bdc9-d8d4fda923c7"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:22.920993 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-18837e59-ad2a-4c8f-831c-4631cedc8862 req-fb385ae8-26ce-4aff-af33-e825633e974a service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:22.921745 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-18837e59-ad2a-4c8f-831c-4631cedc8862 req-fb385ae8-26ce-4aff-af33-e825633e974a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:22.922179 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-18837e59-ad2a-4c8f-831c-4631cedc8862 req-fb385ae8-26ce-4aff-af33-e825633e974a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:22.934513 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-18837e59-ad2a-4c8f-831c-4631cedc8862 req-fb385ae8-26ce-4aff-af33-e825633e974a service nova] Creating event network-vif-deleted:d76218a1-c511-4bbd-bdc9-d8d4fda923c7 for instance 154d20fa-a1d2-4bfd-99ab-024ddf8ae67b on n-h1-860863-1 Oct 10 19:02:22.939681 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-18837e59-ad2a-4c8f-831c-4631cedc8862 req-fb385ae8-26ce-4aff-af33-e825633e974a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050549 Oct 10 19:02:22.941399 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1600/2912] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:22.947711 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2d9f34dc-3016-443b-8551-b1404b9356d9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:22.949058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2d9f34dc-3016-443b-8551-b1404b9356d9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:22.960858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d9f34dc-3016-443b-8551-b1404b9356d9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:22.961542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d9f34dc-3016-443b-8551-b1404b9356d9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:22.965780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d9f34dc-3016-443b-8551-b1404b9356d9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:22.965780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d9f34dc-3016-443b-8551-b1404b9356d9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:22.965780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d9f34dc-3016-443b-8551-b1404b9356d9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:22.965780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d9f34dc-3016-443b-8551-b1404b9356d9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:23.230991 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-0103bbd5-06fb-4064-831f-bcd5dfa71e09 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:23.251544 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0103bbd5-06fb-4064-831f-bcd5dfa71e09 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1324 microversion: 2.1 time: 0.669068 Oct 10 19:02:23.255424 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1313/2913] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:22 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1324 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:23.264181 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-410c6eca-e753-4a85-99ad-e96f51ba1511 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:23.265605 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-410c6eca-e753-4a85-99ad-e96f51ba1511 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:23.276755 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-410c6eca-e753-4a85-99ad-e96f51ba1511 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:23.277771 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-410c6eca-e753-4a85-99ad-e96f51ba1511 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:23.278449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-410c6eca-e753-4a85-99ad-e96f51ba1511 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:23.281801 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-410c6eca-e753-4a85-99ad-e96f51ba1511 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:23.281956 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-410c6eca-e753-4a85-99ad-e96f51ba1511 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:23.282280 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-410c6eca-e753-4a85-99ad-e96f51ba1511 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:23.367402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2d9f34dc-3016-443b-8551-b1404b9356d9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:23.382276 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2d9f34dc-3016-443b-8551-b1404b9356d9 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1503 microversion: 2.1 time: 0.439211 Oct 10 19:02:23.383209 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1601/2914] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:22 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1503 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:23.742237 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-cdc20b34-b8b2-42de-92b1-88fb48145410 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:23.742670 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-410c6eca-e753-4a85-99ad-e96f51ba1511 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:23.743196 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-cdc20b34-b8b2-42de-92b1-88fb48145410 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:23.749359 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdc20b34-b8b2-42de-92b1-88fb48145410 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:23.750087 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdc20b34-b8b2-42de-92b1-88fb48145410 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:23.751383 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdc20b34-b8b2-42de-92b1-88fb48145410 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:23.752280 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdc20b34-b8b2-42de-92b1-88fb48145410 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:23.752955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdc20b34-b8b2-42de-92b1-88fb48145410 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:23.753543 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-cdc20b34-b8b2-42de-92b1-88fb48145410 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:23.761631 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-410c6eca-e753-4a85-99ad-e96f51ba1511 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.503753 Oct 10 19:02:23.762673 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1314/2915] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:23 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:23.911278 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d6032bb3-5020-4738-b3c3-8d15dca0fb5a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:23.913201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d6032bb3-5020-4738-b3c3-8d15dca0fb5a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:23.922695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:23.925332 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d6032bb3-5020-4738-b3c3-8d15dca0fb5a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:23.926273 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d6032bb3-5020-4738-b3c3-8d15dca0fb5a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:23.927012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d6032bb3-5020-4738-b3c3-8d15dca0fb5a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:23.927893 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d6032bb3-5020-4738-b3c3-8d15dca0fb5a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:23.929290 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d6032bb3-5020-4738-b3c3-8d15dca0fb5a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:23.929911 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d6032bb3-5020-4738-b3c3-8d15dca0fb5a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:24.062320 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d6032bb3-5020-4738-b3c3-8d15dca0fb5a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:24.070107 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-cdc20b34-b8b2-42de-92b1-88fb48145410 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:24.071718 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d6032bb3-5020-4738-b3c3-8d15dca0fb5a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1266 microversion: 2.1 time: 0.164829 Oct 10 19:02:24.073262 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1315/2916] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:23 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:02:24.087583 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-cdc20b34-b8b2-42de-92b1-88fb48145410 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1317 microversion: 2.1 time: 0.349075 Oct 10 19:02:24.092372 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1602/2917] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:23 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:24.275909 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a02039cd-fa08-42b6-a1d8-f6f328258c6b tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:24.276522 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a02039cd-fa08-42b6-a1d8-f6f328258c6b tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:24.282746 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a02039cd-fa08-42b6-a1d8-f6f328258c6b tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:24.283236 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a02039cd-fa08-42b6-a1d8-f6f328258c6b tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:24.283667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a02039cd-fa08-42b6-a1d8-f6f328258c6b tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:24.284595 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a02039cd-fa08-42b6-a1d8-f6f328258c6b tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:24.285211 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a02039cd-fa08-42b6-a1d8-f6f328258c6b tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:24.285907 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a02039cd-fa08-42b6-a1d8-f6f328258c6b tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:24.408469 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2b840936-f3f4-4bdb-876a-f7c31c82c4b4 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:24.409732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2b840936-f3f4-4bdb-876a-f7c31c82c4b4 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:24.420257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2b840936-f3f4-4bdb-876a-f7c31c82c4b4 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:24.421157 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2b840936-f3f4-4bdb-876a-f7c31c82c4b4 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:24.422021 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2b840936-f3f4-4bdb-876a-f7c31c82c4b4 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:24.423128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2b840936-f3f4-4bdb-876a-f7c31c82c4b4 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:24.428805 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2b840936-f3f4-4bdb-876a-f7c31c82c4b4 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:24.433366 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2b840936-f3f4-4bdb-876a-f7c31c82c4b4 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:24.654928 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a02039cd-fa08-42b6-a1d8-f6f328258c6b tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:24.664873 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a02039cd-fa08-42b6-a1d8-f6f328258c6b tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1324 microversion: 2.1 time: 0.392346 Oct 10 19:02:24.677587 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1316/2918] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:24 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1324 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:24.785577 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3a08ac8e-757a-43bf-b512-784e6653279c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:24.787563 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3a08ac8e-757a-43bf-b512-784e6653279c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:24.796056 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3a08ac8e-757a-43bf-b512-784e6653279c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:24.796818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3a08ac8e-757a-43bf-b512-784e6653279c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:24.797821 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3a08ac8e-757a-43bf-b512-784e6653279c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:24.798788 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3a08ac8e-757a-43bf-b512-784e6653279c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:24.799236 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3a08ac8e-757a-43bf-b512-784e6653279c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:24.800272 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3a08ac8e-757a-43bf-b512-784e6653279c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:24.803915 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:24.942095 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2b840936-f3f4-4bdb-876a-f7c31c82c4b4 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:24.952277 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2b840936-f3f4-4bdb-876a-f7c31c82c4b4 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1503 microversion: 2.1 time: 0.548352 Oct 10 19:02:24.953183 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1603/2919] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:24 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1503 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:02:24.978515 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ba23c604-c158-4631-93e6-72546448ede0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:24.978968 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ba23c604-c158-4631-93e6-72546448ede0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:24.985955 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba23c604-c158-4631-93e6-72546448ede0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:24.986681 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba23c604-c158-4631-93e6-72546448ede0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:24.987956 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba23c604-c158-4631-93e6-72546448ede0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:24.989129 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba23c604-c158-4631-93e6-72546448ede0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:24.989798 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba23c604-c158-4631-93e6-72546448ede0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:24.990389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba23c604-c158-4631-93e6-72546448ede0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:25.023895 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ba23c604-c158-4631-93e6-72546448ede0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:02:25.167457 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3a08ac8e-757a-43bf-b512-784e6653279c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:25.175723 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3a08ac8e-757a-43bf-b512-784e6653279c tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.394565 Oct 10 19:02:25.176317 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1317/2920] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:24 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:25.181433 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-bad562dc-fb06-465c-b633-4d01a39d9147 req-eba0d13c-ca65-4aa9-9ecc-2229854fd57b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23a67bae-512b-46d3-ad95-f18d54be4a0c", "tag": "5c06c478-32f5-4c60-a392-6c8125163fad"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:25.194857 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-bad562dc-fb06-465c-b633-4d01a39d9147 req-eba0d13c-ca65-4aa9-9ecc-2229854fd57b service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:25.195251 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-bad562dc-fb06-465c-b633-4d01a39d9147 req-eba0d13c-ca65-4aa9-9ecc-2229854fd57b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:25.195705 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-bad562dc-fb06-465c-b633-4d01a39d9147 req-eba0d13c-ca65-4aa9-9ecc-2229854fd57b service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:25.208415 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-bad562dc-fb06-465c-b633-4d01a39d9147 req-eba0d13c-ca65-4aa9-9ecc-2229854fd57b service nova] Creating event network-changed:5c06c478-32f5-4c60-a392-6c8125163fad for instance 23a67bae-512b-46d3-ad95-f18d54be4a0c on n-h2-860863-1 Oct 10 19:02:25.213969 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-bad562dc-fb06-465c-b633-4d01a39d9147 req-eba0d13c-ca65-4aa9-9ecc-2229854fd57b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036157 Oct 10 19:02:25.214765 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1318/2921] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:25.219957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cbe60afa-b9ee-4d1a-af50-fc68a9bf4ee9 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:25.220873 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cbe60afa-b9ee-4d1a-af50-fc68a9bf4ee9 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:25.250989 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cbe60afa-b9ee-4d1a-af50-fc68a9bf4ee9 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:25.250989 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cbe60afa-b9ee-4d1a-af50-fc68a9bf4ee9 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:25.250989 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cbe60afa-b9ee-4d1a-af50-fc68a9bf4ee9 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:25.250989 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cbe60afa-b9ee-4d1a-af50-fc68a9bf4ee9 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:25.250989 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cbe60afa-b9ee-4d1a-af50-fc68a9bf4ee9 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:25.250989 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cbe60afa-b9ee-4d1a-af50-fc68a9bf4ee9 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:25.587802 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cbe60afa-b9ee-4d1a-af50-fc68a9bf4ee9 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:25.597173 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cbe60afa-b9ee-4d1a-af50-fc68a9bf4ee9 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1308 microversion: 2.1 time: 0.381336 Oct 10 19:02:25.597773 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1319/2922] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:25 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1308 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:25.613250 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-d492b62c-49dd-4dcf-b258-38b4d1e2e2a6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:25.613872 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-d492b62c-49dd-4dcf-b258-38b4d1e2e2a6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:25.629144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d492b62c-49dd-4dcf-b258-38b4d1e2e2a6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:25.629597 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d492b62c-49dd-4dcf-b258-38b4d1e2e2a6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:25.630211 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d492b62c-49dd-4dcf-b258-38b4d1e2e2a6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:25.631103 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d492b62c-49dd-4dcf-b258-38b4d1e2e2a6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:25.631722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d492b62c-49dd-4dcf-b258-38b4d1e2e2a6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:25.632308 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-d492b62c-49dd-4dcf-b258-38b4d1e2e2a6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:25.671549 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:25.774810 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ba23c604-c158-4631-93e6-72546448ede0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 204 len: 0 microversion: 2.42 time: 0.798635 Oct 10 19:02:25.780219 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1604/2923] 10.222.0.43 () {60 vars in 1280 bytes} [Mon Oct 10 19:02:24 2022] DELETE /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 10 19:02:25.786084 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9700d7a2-123c-4137-919c-bb444ebd0107 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:25.789786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9700d7a2-123c-4137-919c-bb444ebd0107 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:25.821198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9700d7a2-123c-4137-919c-bb444ebd0107 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:25.821198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9700d7a2-123c-4137-919c-bb444ebd0107 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:25.821198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9700d7a2-123c-4137-919c-bb444ebd0107 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:25.821198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9700d7a2-123c-4137-919c-bb444ebd0107 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:25.821198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9700d7a2-123c-4137-919c-bb444ebd0107 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:25.821198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9700d7a2-123c-4137-919c-bb444ebd0107 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:25.897456 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-d492b62c-49dd-4dcf-b258-38b4d1e2e2a6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:25.907002 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-d492b62c-49dd-4dcf-b258-38b4d1e2e2a6 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1317 microversion: 2.1 time: 0.308165 Oct 10 19:02:25.909316 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1320/2924] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:25 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:25.916834 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a0f3d4eb-bfb9-428d-8b63-f8d1b3d6456a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:25.917465 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a0f3d4eb-bfb9-428d-8b63-f8d1b3d6456a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:25.925855 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a0f3d4eb-bfb9-428d-8b63-f8d1b3d6456a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:25.926455 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a0f3d4eb-bfb9-428d-8b63-f8d1b3d6456a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:25.926898 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a0f3d4eb-bfb9-428d-8b63-f8d1b3d6456a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:25.927664 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a0f3d4eb-bfb9-428d-8b63-f8d1b3d6456a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:25.928122 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a0f3d4eb-bfb9-428d-8b63-f8d1b3d6456a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:25.928667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a0f3d4eb-bfb9-428d-8b63-f8d1b3d6456a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:26.138652 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9700d7a2-123c-4137-919c-bb444ebd0107 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:26.149466 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9700d7a2-123c-4137-919c-bb444ebd0107 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1324 microversion: 2.1 time: 0.367005 Oct 10 19:02:26.149668 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1605/2925] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:25 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:26.154140 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-90753d80-4b6a-415d-ace9-98b5b2acf267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:26.154756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-90753d80-4b6a-415d-ace9-98b5b2acf267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:26.180170 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-90753d80-4b6a-415d-ace9-98b5b2acf267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:26.180170 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-90753d80-4b6a-415d-ace9-98b5b2acf267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:26.180170 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-90753d80-4b6a-415d-ace9-98b5b2acf267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:26.180170 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-90753d80-4b6a-415d-ace9-98b5b2acf267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:26.180635 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-90753d80-4b6a-415d-ace9-98b5b2acf267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:26.180941 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-90753d80-4b6a-415d-ace9-98b5b2acf267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:26.285972 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=8 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:26.385981 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a0f3d4eb-bfb9-428d-8b63-f8d1b3d6456a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:26.399916 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a0f3d4eb-bfb9-428d-8b63-f8d1b3d6456a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:26.405487 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a0f3d4eb-bfb9-428d-8b63-f8d1b3d6456a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:26.406995 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a0f3d4eb-bfb9-428d-8b63-f8d1b3d6456a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 2958 microversion: 2.42 time: 0.496575 Oct 10 19:02:26.407586 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1321/2926] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:25 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 2958 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:26.416959 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a3d11367-19db-4c33-b003-42886aa374d6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:26.418315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a3d11367-19db-4c33-b003-42886aa374d6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:26.434706 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3d11367-19db-4c33-b003-42886aa374d6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:26.435322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3d11367-19db-4c33-b003-42886aa374d6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:26.435674 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3d11367-19db-4c33-b003-42886aa374d6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:26.436663 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3d11367-19db-4c33-b003-42886aa374d6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:26.437123 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3d11367-19db-4c33-b003-42886aa374d6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:26.437599 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a3d11367-19db-4c33-b003-42886aa374d6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:26.447257 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-90753d80-4b6a-415d-ace9-98b5b2acf267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:26.466907 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-90753d80-4b6a-415d-ace9-98b5b2acf267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1503 microversion: 2.1 time: 0.316286 Oct 10 19:02:26.472745 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1606/2927] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:26 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:26.620950 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ba6e9c21-c329-4530-8345-807305c24545 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:26.622144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ba6e9c21-c329-4530-8345-807305c24545 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:26.633673 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba6e9c21-c329-4530-8345-807305c24545 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:26.634783 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba6e9c21-c329-4530-8345-807305c24545 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:26.635506 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba6e9c21-c329-4530-8345-807305c24545 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:26.636908 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba6e9c21-c329-4530-8345-807305c24545 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:26.637946 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba6e9c21-c329-4530-8345-807305c24545 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:26.638593 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ba6e9c21-c329-4530-8345-807305c24545 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:26.664033 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a3d11367-19db-4c33-b003-42886aa374d6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:26.681833 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a3d11367-19db-4c33-b003-42886aa374d6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.267005 Oct 10 19:02:26.685543 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1322/2928] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:26 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:26.817933 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ba6e9c21-c329-4530-8345-807305c24545 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:26.827309 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ba6e9c21-c329-4530-8345-807305c24545 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1308 microversion: 2.1 time: 0.211179 Oct 10 19:02:26.840998 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1607/2929] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:26 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:02:26.943591 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-51a31a4c-80a1-4e11-8a74-544317a7fbbc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:26.947998 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-51a31a4c-80a1-4e11-8a74-544317a7fbbc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:26.967508 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51a31a4c-80a1-4e11-8a74-544317a7fbbc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:26.968053 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51a31a4c-80a1-4e11-8a74-544317a7fbbc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:26.968491 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51a31a4c-80a1-4e11-8a74-544317a7fbbc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:26.969275 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51a31a4c-80a1-4e11-8a74-544317a7fbbc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:26.969730 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51a31a4c-80a1-4e11-8a74-544317a7fbbc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:26.975454 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-51a31a4c-80a1-4e11-8a74-544317a7fbbc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:27.006614 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:27.171830 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7fc3f4fe-55d4-467b-8ff4-f5e72b797f20 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:27.172781 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7fc3f4fe-55d4-467b-8ff4-f5e72b797f20 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:27.180846 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7fc3f4fe-55d4-467b-8ff4-f5e72b797f20 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:27.181676 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7fc3f4fe-55d4-467b-8ff4-f5e72b797f20 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:27.182427 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7fc3f4fe-55d4-467b-8ff4-f5e72b797f20 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:27.183378 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7fc3f4fe-55d4-467b-8ff4-f5e72b797f20 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:27.184655 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7fc3f4fe-55d4-467b-8ff4-f5e72b797f20 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:27.185502 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7fc3f4fe-55d4-467b-8ff4-f5e72b797f20 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:27.216344 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-51a31a4c-80a1-4e11-8a74-544317a7fbbc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:27.227641 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-51a31a4c-80a1-4e11-8a74-544317a7fbbc tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1317 microversion: 2.1 time: 0.296000 Oct 10 19:02:27.243179 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1323/2930] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:26 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:27.254595 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-75024644-610e-48cd-8a40-85659eb265c3 req-5db45c33-ced6-4ce3-9551-ff8911da40ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ed690e-d123-4c67-8311-9f2f94919766", "tag": "f5d94b71-4083-42b7-82e3-39cfb8e92d9d"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:27.276489 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-75024644-610e-48cd-8a40-85659eb265c3 req-5db45c33-ced6-4ce3-9551-ff8911da40ac service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:27.281047 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-75024644-610e-48cd-8a40-85659eb265c3 req-5db45c33-ced6-4ce3-9551-ff8911da40ac service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:27.281714 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-75024644-610e-48cd-8a40-85659eb265c3 req-5db45c33-ced6-4ce3-9551-ff8911da40ac service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:27.294203 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-75024644-610e-48cd-8a40-85659eb265c3 req-5db45c33-ced6-4ce3-9551-ff8911da40ac service nova] Creating event network-changed:f5d94b71-4083-42b7-82e3-39cfb8e92d9d for instance f8ed690e-d123-4c67-8311-9f2f94919766 on n-h2-860863-1 Oct 10 19:02:27.300107 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-75024644-610e-48cd-8a40-85659eb265c3 req-5db45c33-ced6-4ce3-9551-ff8911da40ac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052554 Oct 10 19:02:27.301299 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1324/2931] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:27.440754 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7251cddc-50da-41d4-a9b7-590bdac78915 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:27.444017 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7251cddc-50da-41d4-a9b7-590bdac78915 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:27.457124 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7251cddc-50da-41d4-a9b7-590bdac78915 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:27.464683 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7251cddc-50da-41d4-a9b7-590bdac78915 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:27.464683 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7251cddc-50da-41d4-a9b7-590bdac78915 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:27.464683 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7251cddc-50da-41d4-a9b7-590bdac78915 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:27.464683 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7251cddc-50da-41d4-a9b7-590bdac78915 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:27.464683 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7251cddc-50da-41d4-a9b7-590bdac78915 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:27.647660 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-7fc3f4fe-55d4-467b-8ff4-f5e72b797f20 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:27.655751 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7fc3f4fe-55d4-467b-8ff4-f5e72b797f20 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1324 microversion: 2.1 time: 0.487925 Oct 10 19:02:27.656353 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1608/2932] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:27 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1324 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:02:27.669918 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a666f48a-6738-4ccc-acd0-0ad9fdd9c734 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:27.672243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a666f48a-6738-4ccc-acd0-0ad9fdd9c734 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:27.683433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a666f48a-6738-4ccc-acd0-0ad9fdd9c734 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:27.693455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a666f48a-6738-4ccc-acd0-0ad9fdd9c734 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:27.693455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a666f48a-6738-4ccc-acd0-0ad9fdd9c734 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:27.693455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a666f48a-6738-4ccc-acd0-0ad9fdd9c734 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:27.693455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a666f48a-6738-4ccc-acd0-0ad9fdd9c734 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:27.693455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a666f48a-6738-4ccc-acd0-0ad9fdd9c734 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:28.050611 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a666f48a-6738-4ccc-acd0-0ad9fdd9c734 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:28.065888 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a666f48a-6738-4ccc-acd0-0ad9fdd9c734 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1503 microversion: 2.1 time: 0.406897 Oct 10 19:02:28.069982 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1609/2933] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:27 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1503 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:28.079758 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-ee7233f7-3ee2-43c7-92aa-37cb731f9e7c req-177fa8e4-0271-43a5-932e-e07d1943045c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e33016a-8156-4050-bcbd-fdd7a29b865b", "name": "network-vif-unplugged", "status": "completed", "tag": "94d9fd5e-4a38-41be-9347-cbd7946570c6"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:28.094761 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-ee7233f7-3ee2-43c7-92aa-37cb731f9e7c req-177fa8e4-0271-43a5-932e-e07d1943045c service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:28.095470 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-ee7233f7-3ee2-43c7-92aa-37cb731f9e7c req-177fa8e4-0271-43a5-932e-e07d1943045c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:28.096127 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-ee7233f7-3ee2-43c7-92aa-37cb731f9e7c req-177fa8e4-0271-43a5-932e-e07d1943045c service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:28.126475 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-ee7233f7-3ee2-43c7-92aa-37cb731f9e7c req-177fa8e4-0271-43a5-932e-e07d1943045c service nova] Creating event network-vif-unplugged:94d9fd5e-4a38-41be-9347-cbd7946570c6 for instance 7e33016a-8156-4050-bcbd-fdd7a29b865b on n-h1-860863-1 Oct 10 19:02:28.132623 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-ee7233f7-3ee2-43c7-92aa-37cb731f9e7c req-177fa8e4-0271-43a5-932e-e07d1943045c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060104 Oct 10 19:02:28.134022 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1610/2934] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:28.139914 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-00fd90e9-e397-4c72-b9a0-2eac9c0a4a33 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:28.140959 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-00fd90e9-e397-4c72-b9a0-2eac9c0a4a33 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:28.149128 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00fd90e9-e397-4c72-b9a0-2eac9c0a4a33 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:28.149925 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00fd90e9-e397-4c72-b9a0-2eac9c0a4a33 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:28.150626 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00fd90e9-e397-4c72-b9a0-2eac9c0a4a33 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:28.151728 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00fd90e9-e397-4c72-b9a0-2eac9c0a4a33 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:28.152402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00fd90e9-e397-4c72-b9a0-2eac9c0a4a33 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:28.153066 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-00fd90e9-e397-4c72-b9a0-2eac9c0a4a33 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:28.318477 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7251cddc-50da-41d4-a9b7-590bdac78915 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:28.335554 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7251cddc-50da-41d4-a9b7-590bdac78915 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:28.352789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7251cddc-50da-41d4-a9b7-590bdac78915 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:28.352789 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7251cddc-50da-41d4-a9b7-590bdac78915 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 2958 microversion: 2.42 time: 0.903625 Oct 10 19:02:28.352789 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1325/2935] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:27 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 2958 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:28.362641 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-26d249fa-1f94-4035-8e4a-6c1e3a7d35a5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:28.363682 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-26d249fa-1f94-4035-8e4a-6c1e3a7d35a5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:28.371970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26d249fa-1f94-4035-8e4a-6c1e3a7d35a5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:28.372918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26d249fa-1f94-4035-8e4a-6c1e3a7d35a5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:28.373688 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26d249fa-1f94-4035-8e4a-6c1e3a7d35a5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:28.375729 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26d249fa-1f94-4035-8e4a-6c1e3a7d35a5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:28.376434 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26d249fa-1f94-4035-8e4a-6c1e3a7d35a5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:28.377416 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26d249fa-1f94-4035-8e4a-6c1e3a7d35a5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:28.719126 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-26d249fa-1f94-4035-8e4a-6c1e3a7d35a5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:28.728939 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-26d249fa-1f94-4035-8e4a-6c1e3a7d35a5 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1308 microversion: 2.1 time: 0.373024 Oct 10 19:02:28.744653 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1326/2936] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:28 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1308 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:28.749801 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-f2165ea6-7ad3-42f2-99cf-a7ca9a380afc req-fac89f24-695c-419d-b066-2231ad5aee3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038abd42-6364-44c6-84e9-9590cdde6694", "name": "network-vif-plugged", "status": "completed", "tag": "d30dc884-4c47-4e80-bc36-38126af3d801"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:28.750258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-00fd90e9-e397-4c72-b9a0-2eac9c0a4a33 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:28.772550 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-00fd90e9-e397-4c72-b9a0-2eac9c0a4a33 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.636839 Oct 10 19:02:28.776244 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1611/2937] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:28 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:28.778950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f2165ea6-7ad3-42f2-99cf-a7ca9a380afc req-fac89f24-695c-419d-b066-2231ad5aee3a service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:28.779164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f2165ea6-7ad3-42f2-99cf-a7ca9a380afc req-fac89f24-695c-419d-b066-2231ad5aee3a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:28.779600 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f2165ea6-7ad3-42f2-99cf-a7ca9a380afc req-fac89f24-695c-419d-b066-2231ad5aee3a service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:28.796165 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-de4180a1-87ff-4b5f-a5fb-a7df953a5a43 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:28.797303 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-de4180a1-87ff-4b5f-a5fb-a7df953a5a43 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:28.801021 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-f2165ea6-7ad3-42f2-99cf-a7ca9a380afc req-fac89f24-695c-419d-b066-2231ad5aee3a service nova] Creating event network-vif-plugged:d30dc884-4c47-4e80-bc36-38126af3d801 for instance 038abd42-6364-44c6-84e9-9590cdde6694 on n-h2-860863-1 Oct 10 19:02:28.805970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de4180a1-87ff-4b5f-a5fb-a7df953a5a43 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:28.810646 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-f2165ea6-7ad3-42f2-99cf-a7ca9a380afc req-fac89f24-695c-419d-b066-2231ad5aee3a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065854 Oct 10 19:02:28.810840 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de4180a1-87ff-4b5f-a5fb-a7df953a5a43 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:28.811092 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de4180a1-87ff-4b5f-a5fb-a7df953a5a43 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:28.811493 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1327/2938] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:28.812331 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de4180a1-87ff-4b5f-a5fb-a7df953a5a43 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:28.816844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de4180a1-87ff-4b5f-a5fb-a7df953a5a43 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:28.816844 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-de4180a1-87ff-4b5f-a5fb-a7df953a5a43 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:28.837456 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b23edb67-a25d-4de9-b14c-8ecca897fbf7 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:28.838321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b23edb67-a25d-4de9-b14c-8ecca897fbf7 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:28.853034 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b23edb67-a25d-4de9-b14c-8ecca897fbf7 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:28.853758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b23edb67-a25d-4de9-b14c-8ecca897fbf7 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:28.854384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b23edb67-a25d-4de9-b14c-8ecca897fbf7 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:28.855314 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b23edb67-a25d-4de9-b14c-8ecca897fbf7 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:28.856021 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b23edb67-a25d-4de9-b14c-8ecca897fbf7 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:28.856665 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b23edb67-a25d-4de9-b14c-8ecca897fbf7 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:29.093385 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b23edb67-a25d-4de9-b14c-8ecca897fbf7 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:29.103337 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b23edb67-a25d-4de9-b14c-8ecca897fbf7 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1324 microversion: 2.1 time: 0.290224 Oct 10 19:02:29.105040 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1328/2939] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:28 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1324 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:29.115814 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-481a9bd9-222f-4bd2-8dd7-c2764c79d318 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:29.116736 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-481a9bd9-222f-4bd2-8dd7-c2764c79d318 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:29.136481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-481a9bd9-222f-4bd2-8dd7-c2764c79d318 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:29.139511 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-481a9bd9-222f-4bd2-8dd7-c2764c79d318 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:29.139976 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-481a9bd9-222f-4bd2-8dd7-c2764c79d318 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:29.140737 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-481a9bd9-222f-4bd2-8dd7-c2764c79d318 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:29.141197 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-481a9bd9-222f-4bd2-8dd7-c2764c79d318 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:29.141627 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-481a9bd9-222f-4bd2-8dd7-c2764c79d318 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:29.289660 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-de4180a1-87ff-4b5f-a5fb-a7df953a5a43 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:29.300893 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-de4180a1-87ff-4b5f-a5fb-a7df953a5a43 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1317 microversion: 2.1 time: 0.522710 Oct 10 19:02:29.301492 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1612/2940] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:28 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:29.375971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9487ce91-19fd-4ccb-a9ab-c48e71378018 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:29.379401 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9487ce91-19fd-4ccb-a9ab-c48e71378018 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:29.389976 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9487ce91-19fd-4ccb-a9ab-c48e71378018 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:29.391776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9487ce91-19fd-4ccb-a9ab-c48e71378018 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:29.395910 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9487ce91-19fd-4ccb-a9ab-c48e71378018 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:29.397005 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9487ce91-19fd-4ccb-a9ab-c48e71378018 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:29.397667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9487ce91-19fd-4ccb-a9ab-c48e71378018 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:29.398429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9487ce91-19fd-4ccb-a9ab-c48e71378018 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:29.459809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-481a9bd9-222f-4bd2-8dd7-c2764c79d318 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:29.488496 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-481a9bd9-222f-4bd2-8dd7-c2764c79d318 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1503 microversion: 2.1 time: 0.377494 Oct 10 19:02:29.492457 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1329/2941] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:29 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:29.501900 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=6 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:29.751521 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c09ac425-aa39-4aab-a12e-f89bc3ae52fe tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:29.752492 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c09ac425-aa39-4aab-a12e-f89bc3ae52fe tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:29.763381 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c09ac425-aa39-4aab-a12e-f89bc3ae52fe tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:29.764138 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c09ac425-aa39-4aab-a12e-f89bc3ae52fe tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:29.764819 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c09ac425-aa39-4aab-a12e-f89bc3ae52fe tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:29.771649 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c09ac425-aa39-4aab-a12e-f89bc3ae52fe tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:29.772391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c09ac425-aa39-4aab-a12e-f89bc3ae52fe tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:29.772853 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c09ac425-aa39-4aab-a12e-f89bc3ae52fe tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:29.889940 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9487ce91-19fd-4ccb-a9ab-c48e71378018 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:29.907677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9487ce91-19fd-4ccb-a9ab-c48e71378018 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:29.911205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9487ce91-19fd-4ccb-a9ab-c48e71378018 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:29.912997 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9487ce91-19fd-4ccb-a9ab-c48e71378018 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 2958 microversion: 2.42 time: 0.540858 Oct 10 19:02:29.914724 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1613/2942] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:29 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 2958 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 19:02:29.921335 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-e2febebb-c25a-48fd-9da4-bf7b7e3d8c39 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:29.922226 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-e2febebb-c25a-48fd-9da4-bf7b7e3d8c39 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:29.931613 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2febebb-c25a-48fd-9da4-bf7b7e3d8c39 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:29.949734 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2febebb-c25a-48fd-9da4-bf7b7e3d8c39 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:29.952227 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2febebb-c25a-48fd-9da4-bf7b7e3d8c39 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:29.953230 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2febebb-c25a-48fd-9da4-bf7b7e3d8c39 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:29.954953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2febebb-c25a-48fd-9da4-bf7b7e3d8c39 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:29.957081 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-e2febebb-c25a-48fd-9da4-bf7b7e3d8c39 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:30.182751 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-e2febebb-c25a-48fd-9da4-bf7b7e3d8c39 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:30.192511 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-e2febebb-c25a-48fd-9da4-bf7b7e3d8c39 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.276063 Oct 10 19:02:30.196779 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1614/2943] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:29 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:30.219603 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c31ee2d0-63c4-4fee-a397-415779da09da tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:30.221281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c31ee2d0-63c4-4fee-a397-415779da09da tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:30.227872 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c31ee2d0-63c4-4fee-a397-415779da09da tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:30.231847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c31ee2d0-63c4-4fee-a397-415779da09da tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:30.231847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c31ee2d0-63c4-4fee-a397-415779da09da tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:30.231847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c31ee2d0-63c4-4fee-a397-415779da09da tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:30.231847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c31ee2d0-63c4-4fee-a397-415779da09da tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:30.231847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c31ee2d0-63c4-4fee-a397-415779da09da tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:30.235599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:30.253972 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-c09ac425-aa39-4aab-a12e-f89bc3ae52fe tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:30.270107 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c09ac425-aa39-4aab-a12e-f89bc3ae52fe tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1308 microversion: 2.1 time: 0.522457 Oct 10 19:02:30.274895 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1330/2944] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:29 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1308 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:02:30.281189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-2699b2ba-0af5-4589-9c66-20fa88f6a649 req-0ee63792-7320-4ee0-8ca0-067c2fb5bc8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e33016a-8156-4050-bcbd-fdd7a29b865b", "tag": "94d9fd5e-4a38-41be-9347-cbd7946570c6"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:30.312077 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-2699b2ba-0af5-4589-9c66-20fa88f6a649 req-0ee63792-7320-4ee0-8ca0-067c2fb5bc8d service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:30.314211 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-2699b2ba-0af5-4589-9c66-20fa88f6a649 req-0ee63792-7320-4ee0-8ca0-067c2fb5bc8d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:30.317178 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-2699b2ba-0af5-4589-9c66-20fa88f6a649 req-0ee63792-7320-4ee0-8ca0-067c2fb5bc8d service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:30.344737 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-2699b2ba-0af5-4589-9c66-20fa88f6a649 req-0ee63792-7320-4ee0-8ca0-067c2fb5bc8d service nova] Creating event network-changed:94d9fd5e-4a38-41be-9347-cbd7946570c6 for instance 7e33016a-8156-4050-bcbd-fdd7a29b865b on n-h1-860863-1 Oct 10 19:02:30.351295 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-2699b2ba-0af5-4589-9c66-20fa88f6a649 req-0ee63792-7320-4ee0-8ca0-067c2fb5bc8d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074901 Oct 10 19:02:30.352652 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1331/2945] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:30.358403 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f1cb3c6b-b531-48dd-9b04-1fc7c4aaf0ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:30.361886 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f1cb3c6b-b531-48dd-9b04-1fc7c4aaf0ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:30.368040 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1cb3c6b-b531-48dd-9b04-1fc7c4aaf0ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:30.368879 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1cb3c6b-b531-48dd-9b04-1fc7c4aaf0ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:30.369753 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1cb3c6b-b531-48dd-9b04-1fc7c4aaf0ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:30.370647 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1cb3c6b-b531-48dd-9b04-1fc7c4aaf0ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:30.372460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1cb3c6b-b531-48dd-9b04-1fc7c4aaf0ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:30.373520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f1cb3c6b-b531-48dd-9b04-1fc7c4aaf0ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:30.613358 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c31ee2d0-63c4-4fee-a397-415779da09da tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:30.622515 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c31ee2d0-63c4-4fee-a397-415779da09da tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1324 microversion: 2.1 time: 0.407364 Oct 10 19:02:30.623108 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1615/2946] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:30 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1324 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:30.628742 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c04242d9-2777-4db5-95b7-05e9902c2267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:30.629593 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c04242d9-2777-4db5-95b7-05e9902c2267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:30.635882 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c04242d9-2777-4db5-95b7-05e9902c2267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:30.636677 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c04242d9-2777-4db5-95b7-05e9902c2267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:30.637279 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c04242d9-2777-4db5-95b7-05e9902c2267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:30.638180 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c04242d9-2777-4db5-95b7-05e9902c2267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:30.638867 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c04242d9-2777-4db5-95b7-05e9902c2267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:30.639466 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c04242d9-2777-4db5-95b7-05e9902c2267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:30.651391 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f1cb3c6b-b531-48dd-9b04-1fc7c4aaf0ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:30.665618 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f1cb3c6b-b531-48dd-9b04-1fc7c4aaf0ce tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1317 microversion: 2.1 time: 0.311450 Oct 10 19:02:30.668765 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1332/2947] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:30 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:30.793243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=16 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:30.914473 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c04242d9-2777-4db5-95b7-05e9902c2267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:30.931065 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c04242d9-2777-4db5-95b7-05e9902c2267 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1503 microversion: 2.1 time: 0.306410 Oct 10 19:02:30.932264 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1616/2948] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:30 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:30.950473 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3f500ec5-3dd3-4541-993a-118720f351e0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:30.951820 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3f500ec5-3dd3-4541-993a-118720f351e0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:30.958260 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f500ec5-3dd3-4541-993a-118720f351e0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:30.958822 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f500ec5-3dd3-4541-993a-118720f351e0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:30.959390 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f500ec5-3dd3-4541-993a-118720f351e0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:30.960188 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f500ec5-3dd3-4541-993a-118720f351e0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:30.961358 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f500ec5-3dd3-4541-993a-118720f351e0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:30.961358 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3f500ec5-3dd3-4541-993a-118720f351e0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:31.228255 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-79085e23-bc19-4199-bc50-a91103633767 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:31.229321 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-79085e23-bc19-4199-bc50-a91103633767 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:31.241933 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79085e23-bc19-4199-bc50-a91103633767 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:31.242935 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79085e23-bc19-4199-bc50-a91103633767 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:31.243551 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79085e23-bc19-4199-bc50-a91103633767 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:31.244429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79085e23-bc19-4199-bc50-a91103633767 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:31.248444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79085e23-bc19-4199-bc50-a91103633767 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:31.249389 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-79085e23-bc19-4199-bc50-a91103633767 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:31.514758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3f500ec5-3dd3-4541-993a-118720f351e0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:31.528384 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3f500ec5-3dd3-4541-993a-118720f351e0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:31.534517 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3f500ec5-3dd3-4541-993a-118720f351e0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:31.543265 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3f500ec5-3dd3-4541-993a-118720f351e0 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 2937 microversion: 2.42 time: 0.589833 Oct 10 19:02:31.543265 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1333/2949] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:30 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 2937 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:31.547666 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8f3e84ff-60a7-4ef1-bfeb-cf0fe176ec1c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:31.548427 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8f3e84ff-60a7-4ef1-bfeb-cf0fe176ec1c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:31.570585 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f3e84ff-60a7-4ef1-bfeb-cf0fe176ec1c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:31.583784 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f3e84ff-60a7-4ef1-bfeb-cf0fe176ec1c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:31.583784 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f3e84ff-60a7-4ef1-bfeb-cf0fe176ec1c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:31.583784 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f3e84ff-60a7-4ef1-bfeb-cf0fe176ec1c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:31.583784 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f3e84ff-60a7-4ef1-bfeb-cf0fe176ec1c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:31.583784 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8f3e84ff-60a7-4ef1-bfeb-cf0fe176ec1c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:31.645134 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-79085e23-bc19-4199-bc50-a91103633767 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:31.675280 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-79085e23-bc19-4199-bc50-a91103633767 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.451036 Oct 10 19:02:31.679139 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1617/2950] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:31 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:31.702126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9d8084b6-dbc0-492a-9e31-95886c2f6d69 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:31.702126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9d8084b6-dbc0-492a-9e31-95886c2f6d69 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:31.719472 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d8084b6-dbc0-492a-9e31-95886c2f6d69 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:31.724004 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d8084b6-dbc0-492a-9e31-95886c2f6d69 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:31.724760 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d8084b6-dbc0-492a-9e31-95886c2f6d69 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:31.725822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d8084b6-dbc0-492a-9e31-95886c2f6d69 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:31.726446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d8084b6-dbc0-492a-9e31-95886c2f6d69 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:31.727169 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d8084b6-dbc0-492a-9e31-95886c2f6d69 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:32.079606 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8f3e84ff-60a7-4ef1-bfeb-cf0fe176ec1c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:32.081889 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9d8084b6-dbc0-492a-9e31-95886c2f6d69 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:32.090867 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9d8084b6-dbc0-492a-9e31-95886c2f6d69 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1521 microversion: 2.1 time: 0.409642 Oct 10 19:02:32.100603 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8f3e84ff-60a7-4ef1-bfeb-cf0fe176ec1c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1308 microversion: 2.1 time: 0.556933 Oct 10 19:02:32.103083 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1334/2952] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:31 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1308 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:32.120953 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1618/2952] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:31 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:32.120953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ca92184f-e987-4f46-8788-aca25606b888 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:32.120953 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-ca92184f-e987-4f46-8788-aca25606b888 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:32.127155 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-de8060be-7681-4fda-be09-48a681f70866 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:32.127398 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca92184f-e987-4f46-8788-aca25606b888 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:32.128641 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca92184f-e987-4f46-8788-aca25606b888 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:32.129124 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca92184f-e987-4f46-8788-aca25606b888 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:32.130086 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca92184f-e987-4f46-8788-aca25606b888 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:32.130228 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-de8060be-7681-4fda-be09-48a681f70866 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:32.130946 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca92184f-e987-4f46-8788-aca25606b888 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:32.131965 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-ca92184f-e987-4f46-8788-aca25606b888 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:32.139527 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-de8060be-7681-4fda-be09-48a681f70866 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:32.140021 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-de8060be-7681-4fda-be09-48a681f70866 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:32.158247 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-de8060be-7681-4fda-be09-48a681f70866 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:32.158247 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-de8060be-7681-4fda-be09-48a681f70866 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:32.158247 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-de8060be-7681-4fda-be09-48a681f70866 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:32.158247 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-de8060be-7681-4fda-be09-48a681f70866 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:32.363674 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-ca92184f-e987-4f46-8788-aca25606b888 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:32.377657 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ca92184f-e987-4f46-8788-aca25606b888 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1503 microversion: 2.1 time: 0.271123 Oct 10 19:02:32.378856 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1619/2953] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:32 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1503 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:32.383945 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-22277d39-c36b-409a-bcd9-eefa453059f1 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:32.384838 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-22277d39-c36b-409a-bcd9-eefa453059f1 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:32.392689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22277d39-c36b-409a-bcd9-eefa453059f1 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:32.393218 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22277d39-c36b-409a-bcd9-eefa453059f1 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:32.393689 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22277d39-c36b-409a-bcd9-eefa453059f1 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:32.394480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22277d39-c36b-409a-bcd9-eefa453059f1 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:32.395161 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22277d39-c36b-409a-bcd9-eefa453059f1 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:32.396205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-22277d39-c36b-409a-bcd9-eefa453059f1 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:32.426900 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-22277d39-c36b-409a-bcd9-eefa453059f1 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] HTTP exception thrown: Instance is not a member of specified network Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-22277d39-c36b-409a-bcd9-eefa453059f1 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Request method failure captured: Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694/ips/invalid HTTP/1.1 Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGwsFtEbAVzVwZ_nX0axpj30dhpFDTdwXbZAAanPPHU1fGOHFx_01BXSkSHGxUli7mFkebTTr8n_vMIdEStDLR4Jg19JZ069Gn3lXdxT5SX5n2rBP4ba9HPQOQ_5BTfbqPAR_Ct6jTQBYkM7yCYkpdw6k9F25rn6HqAMMevdrh8kzWM Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 5eb1c539ef954d02a72a38ad8d8061e5 Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-839915115 Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5eb1c539ef954d02a72a38ad8d8061e5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5eb1c539ef954d02a72a38ad8d8061e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5eb1c539ef954d02a72a38ad8d8061e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5eb1c539ef954d02a72a38ad8d8061e5"}]}] Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-839915115 Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 5eb1c539ef954d02a72a38ad8d8061e5 Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-839915115 Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServerAddressesNegativeTestJSON-839915115-project Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 2e80178dc7fa41f2bc7253dae37e7624 Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-839915115-project Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance is not a member of specified network Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'server_id': '038abd42-6364-44c6-84e9-9590cdde6694', 'id': 'invalid'} Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 10 19:02:32.444359 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:32.456083 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-22277d39-c36b-409a-bcd9-eefa453059f1 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Returning 404 to user: Instance is not a member of specified network {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:02:32.456083 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-22277d39-c36b-409a-bcd9-eefa453059f1 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.070557 Oct 10 19:02:32.456083 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1620/2954] 10.222.0.43 () {58 vars in 1272 bytes} [Mon Oct 10 19:02:32 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694/ips/invalid => generated 91 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 19:02:32.464309 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6edcccc8-0e24-400d-a54d-bd82fdf84af4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:32.464309 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6edcccc8-0e24-400d-a54d-bd82fdf84af4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Failed to fetch instance by id 999 {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 10 19:02:32.467002 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-6edcccc8-0e24-400d-a54d-bd82fdf84af4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] HTTP exception thrown: Instance 999 could not be found. Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6edcccc8-0e24-400d-a54d-bd82fdf84af4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Request method failure captured: Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGwsFtEbAVzVwZ_nX0axpj30dhpFDTdwXbZAAanPPHU1fGOHFx_01BXSkSHGxUli7mFkebTTr8n_vMIdEStDLR4Jg19JZ069Gn3lXdxT5SX5n2rBP4ba9HPQOQ_5BTfbqPAR_Ct6jTQBYkM7yCYkpdw6k9F25rn6HqAMMevdrh8kzWM Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 5eb1c539ef954d02a72a38ad8d8061e5 Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-839915115 Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5eb1c539ef954d02a72a38ad8d8061e5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5eb1c539ef954d02a72a38ad8d8061e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5eb1c539ef954d02a72a38ad8d8061e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5eb1c539ef954d02a72a38ad8d8061e5"}]}] Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-839915115 Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 5eb1c539ef954d02a72a38ad8d8061e5 Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-839915115 Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServerAddressesNegativeTestJSON-839915115-project Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 2e80178dc7fa41f2bc7253dae37e7624 Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-839915115-project Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 999 could not be found. Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'server_id': '999'} Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 10 19:02:32.472337 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:32.477976 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6edcccc8-0e24-400d-a54d-bd82fdf84af4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Returning 404 to user: Instance 999 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:02:32.480113 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6edcccc8-0e24-400d-a54d-bd82fdf84af4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.020674 Oct 10 19:02:32.485449 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1621/2955] 10.222.0.43 () {58 vars in 1149 bytes} [Mon Oct 10 19:02:32 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 10 19:02:32.495649 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-241cddf8-d37f-4e4e-8545-4fdced6bda48 req-39a50e07-f7c4-496b-90a3-741b410a1ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a67bae-512b-46d3-ad95-f18d54be4a0c", "name": "network-vif-plugged", "status": "completed", "tag": "5c06c478-32f5-4c60-a392-6c8125163fad"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:32.510001 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-241cddf8-d37f-4e4e-8545-4fdced6bda48 req-39a50e07-f7c4-496b-90a3-741b410a1ae0 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:32.510750 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-241cddf8-d37f-4e4e-8545-4fdced6bda48 req-39a50e07-f7c4-496b-90a3-741b410a1ae0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:32.511576 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-241cddf8-d37f-4e4e-8545-4fdced6bda48 req-39a50e07-f7c4-496b-90a3-741b410a1ae0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:32.524850 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-241cddf8-d37f-4e4e-8545-4fdced6bda48 req-39a50e07-f7c4-496b-90a3-741b410a1ae0 service nova] Creating event network-vif-plugged:5c06c478-32f5-4c60-a392-6c8125163fad for instance 23a67bae-512b-46d3-ad95-f18d54be4a0c on n-h2-860863-1 Oct 10 19:02:32.530972 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-241cddf8-d37f-4e4e-8545-4fdced6bda48 req-39a50e07-f7c4-496b-90a3-741b410a1ae0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044003 Oct 10 19:02:32.532041 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1622/2956] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:32.541595 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2278bf18-eced-4f50-86ce-6e7e2b3b380e tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:32.546919 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2278bf18-eced-4f50-86ce-6e7e2b3b380e tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:32.549249 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2278bf18-eced-4f50-86ce-6e7e2b3b380e tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:32.550582 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2278bf18-eced-4f50-86ce-6e7e2b3b380e tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:32.551244 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2278bf18-eced-4f50-86ce-6e7e2b3b380e tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:32.552497 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2278bf18-eced-4f50-86ce-6e7e2b3b380e tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:32.553599 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2278bf18-eced-4f50-86ce-6e7e2b3b380e tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:32.554249 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2278bf18-eced-4f50-86ce-6e7e2b3b380e tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:32.581853 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2278bf18-eced-4f50-86ce-6e7e2b3b380e tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Going to try to terminate instance {{(pid=127288) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:02:32.902164 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-de8060be-7681-4fda-be09-48a681f70866 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:32.910852 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-de8060be-7681-4fda-be09-48a681f70866 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1317 microversion: 2.1 time: 0.804938 Oct 10 19:02:32.911442 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1335/2957] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:32 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1317 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:32.924351 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-f8e24ece-0733-4b36-adc5-9d3cd31708c6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:32.925044 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-f8e24ece-0733-4b36-adc5-9d3cd31708c6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:32.941843 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8e24ece-0733-4b36-adc5-9d3cd31708c6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:32.942336 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8e24ece-0733-4b36-adc5-9d3cd31708c6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:32.942775 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8e24ece-0733-4b36-adc5-9d3cd31708c6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:32.943590 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8e24ece-0733-4b36-adc5-9d3cd31708c6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:32.944046 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8e24ece-0733-4b36-adc5-9d3cd31708c6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:32.944470 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-f8e24ece-0733-4b36-adc5-9d3cd31708c6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:33.016855 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2278bf18-eced-4f50-86ce-6e7e2b3b380e tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "DELETE /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 204 len: 0 microversion: 2.1 time: 0.480142 Oct 10 19:02:33.022979 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1623/2958] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:02:32 2022] DELETE /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:02:33.027909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-f35c4e81-2a48-40ad-b674-8ed196d712fd req-a04ec48e-25f7-4b37-9da9-c98bb6b7b459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-deleted", "tag": "0f2bd971-89f9-416b-bad4-152c02c746fb"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:33.039785 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f35c4e81-2a48-40ad-b674-8ed196d712fd req-a04ec48e-25f7-4b37-9da9-c98bb6b7b459 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:33.040924 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f35c4e81-2a48-40ad-b674-8ed196d712fd req-a04ec48e-25f7-4b37-9da9-c98bb6b7b459 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:33.041578 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-f35c4e81-2a48-40ad-b674-8ed196d712fd req-a04ec48e-25f7-4b37-9da9-c98bb6b7b459 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:33.055821 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-f35c4e81-2a48-40ad-b674-8ed196d712fd req-a04ec48e-25f7-4b37-9da9-c98bb6b7b459 service nova] Creating event network-vif-deleted:0f2bd971-89f9-416b-bad4-152c02c746fb for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 19:02:33.062293 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-f35c4e81-2a48-40ad-b674-8ed196d712fd req-a04ec48e-25f7-4b37-9da9-c98bb6b7b459 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039205 Oct 10 19:02:33.063584 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1624/2959] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:33.071628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6a691687-9f4b-400c-8a9d-fe8b57ec5139 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:33.072664 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6a691687-9f4b-400c-8a9d-fe8b57ec5139 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:33.081498 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6a691687-9f4b-400c-8a9d-fe8b57ec5139 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:33.082356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6a691687-9f4b-400c-8a9d-fe8b57ec5139 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:33.082974 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6a691687-9f4b-400c-8a9d-fe8b57ec5139 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:33.083893 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6a691687-9f4b-400c-8a9d-fe8b57ec5139 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:33.091015 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6a691687-9f4b-400c-8a9d-fe8b57ec5139 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:33.091015 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6a691687-9f4b-400c-8a9d-fe8b57ec5139 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:33.217195 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f8e24ece-0733-4b36-adc5-9d3cd31708c6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:33.230224 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f8e24ece-0733-4b36-adc5-9d3cd31708c6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:33.231887 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-f8e24ece-0733-4b36-adc5-9d3cd31708c6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:33.233202 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-f8e24ece-0733-4b36-adc5-9d3cd31708c6 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 2870 microversion: 2.42 time: 0.312839 Oct 10 19:02:33.233784 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1336/2960] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:32 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 2870 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:33.245499 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b8567a8a-271a-4547-a315-0fded65ab46c tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:33.248080 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b8567a8a-271a-4547-a315-0fded65ab46c tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:33.263659 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8567a8a-271a-4547-a315-0fded65ab46c tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:33.264047 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8567a8a-271a-4547-a315-0fded65ab46c tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:33.269019 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8567a8a-271a-4547-a315-0fded65ab46c tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:33.269992 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8567a8a-271a-4547-a315-0fded65ab46c tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:33.270619 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8567a8a-271a-4547-a315-0fded65ab46c tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:33.282648 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8567a8a-271a-4547-a315-0fded65ab46c tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:33.415816 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6a691687-9f4b-400c-8a9d-fe8b57ec5139 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:33.422491 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6a691687-9f4b-400c-8a9d-fe8b57ec5139 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.357321 Oct 10 19:02:33.427172 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1625/2961] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:33 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:33.444732 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-2d083640-487b-44d3-8d1f-4b282d03f83b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:33.445667 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-2d083640-487b-44d3-8d1f-4b282d03f83b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:33.453605 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d083640-487b-44d3-8d1f-4b282d03f83b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:33.454113 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d083640-487b-44d3-8d1f-4b282d03f83b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:33.454698 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d083640-487b-44d3-8d1f-4b282d03f83b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:33.455797 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d083640-487b-44d3-8d1f-4b282d03f83b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:33.456314 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d083640-487b-44d3-8d1f-4b282d03f83b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:33.457395 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-2d083640-487b-44d3-8d1f-4b282d03f83b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:33.595538 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b8567a8a-271a-4547-a315-0fded65ab46c tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:33.636820 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b8567a8a-271a-4547-a315-0fded65ab46c tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1527 microversion: 2.1 time: 0.396696 Oct 10 19:02:33.644669 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1337/2962] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:33 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1527 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:33.657195 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ec08a3db-5f05-42f3-ac2f-eda37a16b982 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:33.659975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-ec08a3db-5f05-42f3-ac2f-eda37a16b982 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:33.667843 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec08a3db-5f05-42f3-ac2f-eda37a16b982 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:33.668493 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec08a3db-5f05-42f3-ac2f-eda37a16b982 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:33.669165 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec08a3db-5f05-42f3-ac2f-eda37a16b982 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:33.670413 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec08a3db-5f05-42f3-ac2f-eda37a16b982 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:33.671908 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec08a3db-5f05-42f3-ac2f-eda37a16b982 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:33.672704 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-ec08a3db-5f05-42f3-ac2f-eda37a16b982 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:33.782663 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-2d083640-487b-44d3-8d1f-4b282d03f83b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:33.797234 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-2d083640-487b-44d3-8d1f-4b282d03f83b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1308 microversion: 2.1 time: 0.368733 Oct 10 19:02:33.798065 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1626/2963] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:33 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:33.935757 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d303e9b2-a6a3-4ba3-b53c-bc3b5fba2de3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:33.936787 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d303e9b2-a6a3-4ba3-b53c-bc3b5fba2de3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:33.946013 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d303e9b2-a6a3-4ba3-b53c-bc3b5fba2de3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:33.946510 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d303e9b2-a6a3-4ba3-b53c-bc3b5fba2de3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:33.948907 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d303e9b2-a6a3-4ba3-b53c-bc3b5fba2de3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:33.951037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d303e9b2-a6a3-4ba3-b53c-bc3b5fba2de3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:33.951694 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d303e9b2-a6a3-4ba3-b53c-bc3b5fba2de3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:33.952812 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d303e9b2-a6a3-4ba3-b53c-bc3b5fba2de3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:34.178171 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-ec08a3db-5f05-42f3-ac2f-eda37a16b982 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:34.189914 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ec08a3db-5f05-42f3-ac2f-eda37a16b982 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1503 microversion: 2.1 time: 0.542735 Oct 10 19:02:34.190965 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1338/2964] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:33 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1503 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:34.263735 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3514a8bc-9887-4df6-b608-b0c1eab7b57a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:34.263735 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3514a8bc-9887-4df6-b608-b0c1eab7b57a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:34.274281 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d303e9b2-a6a3-4ba3-b53c-bc3b5fba2de3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:34.279438 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3514a8bc-9887-4df6-b608-b0c1eab7b57a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:34.280030 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d303e9b2-a6a3-4ba3-b53c-bc3b5fba2de3 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1317 microversion: 2.1 time: 0.348041 Oct 10 19:02:34.280301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3514a8bc-9887-4df6-b608-b0c1eab7b57a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:34.281783 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3514a8bc-9887-4df6-b608-b0c1eab7b57a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:34.284364 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3514a8bc-9887-4df6-b608-b0c1eab7b57a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:34.285097 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3514a8bc-9887-4df6-b608-b0c1eab7b57a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:34.285698 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3514a8bc-9887-4df6-b608-b0c1eab7b57a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:34.294696 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1627/2965] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:33 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:34.454922 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b9a06d02-08af-42f7-8a32-98fd0243595f tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:34.462631 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b9a06d02-08af-42f7-8a32-98fd0243595f tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:34.463215 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b9a06d02-08af-42f7-8a32-98fd0243595f tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:34.463835 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b9a06d02-08af-42f7-8a32-98fd0243595f tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:34.464401 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b9a06d02-08af-42f7-8a32-98fd0243595f tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:34.465221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b9a06d02-08af-42f7-8a32-98fd0243595f tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:34.466228 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b9a06d02-08af-42f7-8a32-98fd0243595f tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:34.466860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b9a06d02-08af-42f7-8a32-98fd0243595f tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:34.666666 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3514a8bc-9887-4df6-b608-b0c1eab7b57a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:34.678293 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3514a8bc-9887-4df6-b608-b0c1eab7b57a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:34.680077 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3514a8bc-9887-4df6-b608-b0c1eab7b57a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:34.683217 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3514a8bc-9887-4df6-b608-b0c1eab7b57a tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 2664 microversion: 2.42 time: 0.422398 Oct 10 19:02:34.683217 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1339/2966] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:34 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 2664 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 10 19:02:34.701193 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-018855a9-9077-40dd-86d9-8c8daaaf5b26 req-71dab9b7-fffe-4a26-a26e-730c3ef693ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-unplugged", "status": "completed", "tag": "15af13d2-db21-43e2-bb38-312a65d341c0"}, {"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-unplugged", "status": "completed", "tag": "d3835300-20da-488f-97b2-b41044bdcd24"}, {"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-unplugged", "status": "completed", "tag": "973a75cc-00b3-43e5-a2d6-eaeb4c2f27ac"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:34.712139 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-018855a9-9077-40dd-86d9-8c8daaaf5b26 req-71dab9b7-fffe-4a26-a26e-730c3ef693ac service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:34.712879 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-018855a9-9077-40dd-86d9-8c8daaaf5b26 req-71dab9b7-fffe-4a26-a26e-730c3ef693ac service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:34.717946 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-018855a9-9077-40dd-86d9-8c8daaaf5b26 req-71dab9b7-fffe-4a26-a26e-730c3ef693ac service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:34.728039 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-018855a9-9077-40dd-86d9-8c8daaaf5b26 req-71dab9b7-fffe-4a26-a26e-730c3ef693ac service nova] Creating event network-vif-unplugged:15af13d2-db21-43e2-bb38-312a65d341c0 for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 19:02:34.728842 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-018855a9-9077-40dd-86d9-8c8daaaf5b26 req-71dab9b7-fffe-4a26-a26e-730c3ef693ac service nova] Creating event network-vif-unplugged:d3835300-20da-488f-97b2-b41044bdcd24 for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 19:02:34.729527 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-018855a9-9077-40dd-86d9-8c8daaaf5b26 req-71dab9b7-fffe-4a26-a26e-730c3ef693ac service nova] Creating event network-vif-unplugged:973a75cc-00b3-43e5-a2d6-eaeb4c2f27ac for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 19:02:34.737836 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-018855a9-9077-40dd-86d9-8c8daaaf5b26 req-71dab9b7-fffe-4a26-a26e-730c3ef693ac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.054119 Oct 10 19:02:34.738934 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1340/2967] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:34.745620 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b8b9e155-db92-4780-9fea-fa327dbd4133 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:34.747012 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b8b9e155-db92-4780-9fea-fa327dbd4133 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:34.758282 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8b9e155-db92-4780-9fea-fa327dbd4133 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:34.759593 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8b9e155-db92-4780-9fea-fa327dbd4133 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:34.760144 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8b9e155-db92-4780-9fea-fa327dbd4133 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:34.761580 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8b9e155-db92-4780-9fea-fa327dbd4133 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:34.762115 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8b9e155-db92-4780-9fea-fa327dbd4133 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:34.763943 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8b9e155-db92-4780-9fea-fa327dbd4133 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:35.051606 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b9a06d02-08af-42f7-8a32-98fd0243595f tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:35.056520 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b8b9e155-db92-4780-9fea-fa327dbd4133 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:35.065465 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b9a06d02-08af-42f7-8a32-98fd0243595f tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.613961 Oct 10 19:02:35.066434 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b8b9e155-db92-4780-9fea-fa327dbd4133 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1527 microversion: 2.1 time: 0.326128 Oct 10 19:02:35.067426 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1341/2968] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:34 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1527 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:35.070571 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1628/2969] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:34 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:35.072507 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7848b6bd-9c9d-4f8e-8e57-81372c7d7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:35.073221 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7848b6bd-9c9d-4f8e-8e57-81372c7d7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:35.079878 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7848b6bd-9c9d-4f8e-8e57-81372c7d7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:35.086366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7848b6bd-9c9d-4f8e-8e57-81372c7d7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:35.086366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7848b6bd-9c9d-4f8e-8e57-81372c7d7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:35.086366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7848b6bd-9c9d-4f8e-8e57-81372c7d7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:35.086366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7848b6bd-9c9d-4f8e-8e57-81372c7d7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:35.086366 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7848b6bd-9c9d-4f8e-8e57-81372c7d7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:35.146643 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-1dd01281-66aa-4cfc-93b0-1c6635fba0db req-c144b8d7-5441-41b6-955a-6844eb56dee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-deleted", "tag": "99d576b1-bb4c-4046-a5bb-d295c4cf071a"}, {"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-deleted", "tag": "15af13d2-db21-43e2-bb38-312a65d341c0"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:35.158467 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1dd01281-66aa-4cfc-93b0-1c6635fba0db req-c144b8d7-5441-41b6-955a-6844eb56dee0 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:35.158950 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1dd01281-66aa-4cfc-93b0-1c6635fba0db req-c144b8d7-5441-41b6-955a-6844eb56dee0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:35.159446 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-1dd01281-66aa-4cfc-93b0-1c6635fba0db req-c144b8d7-5441-41b6-955a-6844eb56dee0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:35.172388 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-1dd01281-66aa-4cfc-93b0-1c6635fba0db req-c144b8d7-5441-41b6-955a-6844eb56dee0 service nova] Creating event network-vif-deleted:99d576b1-bb4c-4046-a5bb-d295c4cf071a for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 19:02:35.173302 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-1dd01281-66aa-4cfc-93b0-1c6635fba0db req-c144b8d7-5441-41b6-955a-6844eb56dee0 service nova] Creating event network-vif-deleted:15af13d2-db21-43e2-bb38-312a65d341c0 for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 19:02:35.179747 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-1dd01281-66aa-4cfc-93b0-1c6635fba0db req-c144b8d7-5441-41b6-955a-6844eb56dee0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037873 Oct 10 19:02:35.182308 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1629/2970] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:35.218712 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-360b18c9-396d-443b-8dc9-7be607b2283d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:35.219682 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-360b18c9-396d-443b-8dc9-7be607b2283d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:35.226425 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-360b18c9-396d-443b-8dc9-7be607b2283d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:35.227117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-360b18c9-396d-443b-8dc9-7be607b2283d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:35.227780 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-360b18c9-396d-443b-8dc9-7be607b2283d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:35.228581 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-360b18c9-396d-443b-8dc9-7be607b2283d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:35.229144 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-360b18c9-396d-443b-8dc9-7be607b2283d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:35.229627 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-360b18c9-396d-443b-8dc9-7be607b2283d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:35.444940 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-7848b6bd-9c9d-4f8e-8e57-81372c7d7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:35.450692 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=100 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:35.456441 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7848b6bd-9c9d-4f8e-8e57-81372c7d7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1308 microversion: 2.1 time: 0.387818 Oct 10 19:02:35.457904 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1342/2971] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:35 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1308 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:35.463695 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-742b5abe-a53c-4e0e-844c-38196e3bdf2c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:35.464655 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-742b5abe-a53c-4e0e-844c-38196e3bdf2c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:35.473140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-742b5abe-a53c-4e0e-844c-38196e3bdf2c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:35.474140 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-742b5abe-a53c-4e0e-844c-38196e3bdf2c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:35.475175 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-742b5abe-a53c-4e0e-844c-38196e3bdf2c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:35.479068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-742b5abe-a53c-4e0e-844c-38196e3bdf2c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:35.479068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-742b5abe-a53c-4e0e-844c-38196e3bdf2c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:35.479068 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-742b5abe-a53c-4e0e-844c-38196e3bdf2c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:35.647117 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-360b18c9-396d-443b-8dc9-7be607b2283d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:35.660741 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-360b18c9-396d-443b-8dc9-7be607b2283d tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1503 microversion: 2.1 time: 0.448360 Oct 10 19:02:35.661607 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1630/2972] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:35 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1503 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:35.701574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-742b5abe-a53c-4e0e-844c-38196e3bdf2c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:35.711522 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-742b5abe-a53c-4e0e-844c-38196e3bdf2c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1317 microversion: 2.1 time: 0.251937 Oct 10 19:02:35.712323 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1343/2973] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:35 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:35.734644 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d82e070a-0d9b-4619-9f78-3784bd0240ec tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:35.737349 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d82e070a-0d9b-4619-9f78-3784bd0240ec tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:35.744337 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d82e070a-0d9b-4619-9f78-3784bd0240ec tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:35.744977 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d82e070a-0d9b-4619-9f78-3784bd0240ec tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:35.745536 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d82e070a-0d9b-4619-9f78-3784bd0240ec tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:35.746435 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d82e070a-0d9b-4619-9f78-3784bd0240ec tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:35.746988 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d82e070a-0d9b-4619-9f78-3784bd0240ec tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:35.747846 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d82e070a-0d9b-4619-9f78-3784bd0240ec tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:36.030954 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-b8ebd6dd-9e55-4a98-a771-aa07543c6bbf req-d9f1eeeb-e250-4010-acaa-289f489e3a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038abd42-6364-44c6-84e9-9590cdde6694", "name": "network-vif-deleted", "tag": "d30dc884-4c47-4e80-bc36-38126af3d801"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:36.041162 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-b8ebd6dd-9e55-4a98-a771-aa07543c6bbf req-d9f1eeeb-e250-4010-acaa-289f489e3a03 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:36.041937 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-b8ebd6dd-9e55-4a98-a771-aa07543c6bbf req-d9f1eeeb-e250-4010-acaa-289f489e3a03 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:36.042551 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-b8ebd6dd-9e55-4a98-a771-aa07543c6bbf req-d9f1eeeb-e250-4010-acaa-289f489e3a03 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:36.060978 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-b8ebd6dd-9e55-4a98-a771-aa07543c6bbf req-d9f1eeeb-e250-4010-acaa-289f489e3a03 service nova] Creating event network-vif-deleted:d30dc884-4c47-4e80-bc36-38126af3d801 for instance 038abd42-6364-44c6-84e9-9590cdde6694 on n-h2-860863-1 Oct 10 19:02:36.071967 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-b8ebd6dd-9e55-4a98-a771-aa07543c6bbf req-d9f1eeeb-e250-4010-acaa-289f489e3a03 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045570 Oct 10 19:02:36.072840 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1344/2974] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 19:02:36.098424 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-496aa562-cec4-43b9-b81a-dbef76bd65f4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:36.099160 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-496aa562-cec4-43b9-b81a-dbef76bd65f4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:36.114673 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-496aa562-cec4-43b9-b81a-dbef76bd65f4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:36.115430 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-496aa562-cec4-43b9-b81a-dbef76bd65f4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:36.116056 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-496aa562-cec4-43b9-b81a-dbef76bd65f4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:36.117043 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-496aa562-cec4-43b9-b81a-dbef76bd65f4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:36.117655 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-496aa562-cec4-43b9-b81a-dbef76bd65f4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:36.118245 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-496aa562-cec4-43b9-b81a-dbef76bd65f4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:36.123450 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d82e070a-0d9b-4619-9f78-3784bd0240ec tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:36.135225 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d82e070a-0d9b-4619-9f78-3784bd0240ec tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:36.136851 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d82e070a-0d9b-4619-9f78-3784bd0240ec tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:36.144372 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d82e070a-0d9b-4619-9f78-3784bd0240ec tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 2394 microversion: 2.42 time: 0.429916 Oct 10 19:02:36.144517 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1631/2975] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:35 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 2394 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:36.149463 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9c722a5a-c1e9-4ef2-8226-ccd4421161aa tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:36.154961 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9c722a5a-c1e9-4ef2-8226-ccd4421161aa tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:36.168322 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c722a5a-c1e9-4ef2-8226-ccd4421161aa tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:36.173153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c722a5a-c1e9-4ef2-8226-ccd4421161aa tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:36.173153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c722a5a-c1e9-4ef2-8226-ccd4421161aa tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:36.173153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c722a5a-c1e9-4ef2-8226-ccd4421161aa tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:36.173153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c722a5a-c1e9-4ef2-8226-ccd4421161aa tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:36.173153 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9c722a5a-c1e9-4ef2-8226-ccd4421161aa tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:36.229157 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-496aa562-cec4-43b9-b81a-dbef76bd65f4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:36.240401 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-496aa562-cec4-43b9-b81a-dbef76bd65f4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1485 microversion: 2.1 time: 0.145164 Oct 10 19:02:36.241739 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1345/2976] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:36 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1485 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:36.485322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-95d1d321-402f-4053-b3e7-2471a2966834 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:36.485958 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-95d1d321-402f-4053-b3e7-2471a2966834 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:36.494310 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-95d1d321-402f-4053-b3e7-2471a2966834 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:36.494863 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-95d1d321-402f-4053-b3e7-2471a2966834 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:36.495900 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-95d1d321-402f-4053-b3e7-2471a2966834 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:36.496667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-95d1d321-402f-4053-b3e7-2471a2966834 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:36.497120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-95d1d321-402f-4053-b3e7-2471a2966834 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:36.497543 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-95d1d321-402f-4053-b3e7-2471a2966834 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:36.609243 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-9c722a5a-c1e9-4ef2-8226-ccd4421161aa tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:36.621058 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9c722a5a-c1e9-4ef2-8226-ccd4421161aa tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.475123 Oct 10 19:02:36.622438 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1632/2977] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:36 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:36.672474 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-95d1d321-402f-4053-b3e7-2471a2966834 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:36.681750 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-95d1d321-402f-4053-b3e7-2471a2966834 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1308 microversion: 2.1 time: 0.201891 Oct 10 19:02:36.682921 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1346/2978] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:36 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1308 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:36.687306 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b17d2737-e995-4e58-b646-739335d45c45 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:36.688494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b17d2737-e995-4e58-b646-739335d45c45 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:36.696238 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b17d2737-e995-4e58-b646-739335d45c45 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:36.697133 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b17d2737-e995-4e58-b646-739335d45c45 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:36.697756 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b17d2737-e995-4e58-b646-739335d45c45 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:36.698809 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b17d2737-e995-4e58-b646-739335d45c45 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:36.699476 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b17d2737-e995-4e58-b646-739335d45c45 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:36.700059 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b17d2737-e995-4e58-b646-739335d45c45 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:36.723864 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:36.746669 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-47973c0c-22ec-471e-9e4c-00ebf38eacd5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:36.747618 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-47973c0c-22ec-471e-9e4c-00ebf38eacd5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:36.756159 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47973c0c-22ec-471e-9e4c-00ebf38eacd5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:36.757313 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47973c0c-22ec-471e-9e4c-00ebf38eacd5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:36.762379 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47973c0c-22ec-471e-9e4c-00ebf38eacd5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:36.762379 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47973c0c-22ec-471e-9e4c-00ebf38eacd5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:36.762379 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47973c0c-22ec-471e-9e4c-00ebf38eacd5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:36.762379 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-47973c0c-22ec-471e-9e4c-00ebf38eacd5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:36.935657 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-47973c0c-22ec-471e-9e4c-00ebf38eacd5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:36.945075 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-47973c0c-22ec-471e-9e4c-00ebf38eacd5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1508 microversion: 2.1 time: 0.208578 Oct 10 19:02:36.945704 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1347/2979] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:36 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:36.951368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-89b3f044-df74-4eef-af8b-44c4e9106af8 req-032c91c1-6a17-4959-9ce4-7ec027313255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ed690e-d123-4c67-8311-9f2f94919766", "name": "network-vif-plugged", "status": "completed", "tag": "f5d94b71-4083-42b7-82e3-39cfb8e92d9d"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:36.966701 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-89b3f044-df74-4eef-af8b-44c4e9106af8 req-032c91c1-6a17-4959-9ce4-7ec027313255 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:36.967209 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-89b3f044-df74-4eef-af8b-44c4e9106af8 req-032c91c1-6a17-4959-9ce4-7ec027313255 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:36.967718 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-89b3f044-df74-4eef-af8b-44c4e9106af8 req-032c91c1-6a17-4959-9ce4-7ec027313255 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:36.980946 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-89b3f044-df74-4eef-af8b-44c4e9106af8 req-032c91c1-6a17-4959-9ce4-7ec027313255 service nova] Creating event network-vif-plugged:f5d94b71-4083-42b7-82e3-39cfb8e92d9d for instance f8ed690e-d123-4c67-8311-9f2f94919766 on n-h2-860863-1 Oct 10 19:02:36.989602 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-89b3f044-df74-4eef-af8b-44c4e9106af8 req-032c91c1-6a17-4959-9ce4-7ec027313255 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039104 Oct 10 19:02:36.989602 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1348/2980] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:36.995028 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4896ea16-472a-4d2f-960c-f30cc57e2433 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:36.995809 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4896ea16-472a-4d2f-960c-f30cc57e2433 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:37.002778 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4896ea16-472a-4d2f-960c-f30cc57e2433 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.003266 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4896ea16-472a-4d2f-960c-f30cc57e2433 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.003707 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4896ea16-472a-4d2f-960c-f30cc57e2433 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.004818 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4896ea16-472a-4d2f-960c-f30cc57e2433 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.005319 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4896ea16-472a-4d2f-960c-f30cc57e2433 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.005751 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4896ea16-472a-4d2f-960c-f30cc57e2433 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.225897 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4896ea16-472a-4d2f-960c-f30cc57e2433 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:37.234888 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4896ea16-472a-4d2f-960c-f30cc57e2433 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1508 microversion: 2.1 time: 0.245684 Oct 10 19:02:37.236152 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1349/2981] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:36 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:37.241168 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e64bbe99-4eed-49da-927f-0a0bbe385241 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:37.242042 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e64bbe99-4eed-49da-927f-0a0bbe385241 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:37.248234 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e64bbe99-4eed-49da-927f-0a0bbe385241 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.248985 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e64bbe99-4eed-49da-927f-0a0bbe385241 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.249580 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e64bbe99-4eed-49da-927f-0a0bbe385241 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.250320 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e64bbe99-4eed-49da-927f-0a0bbe385241 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.250939 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e64bbe99-4eed-49da-927f-0a0bbe385241 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.251536 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e64bbe99-4eed-49da-927f-0a0bbe385241 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.395986 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e64bbe99-4eed-49da-927f-0a0bbe385241 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:37.405348 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e64bbe99-4eed-49da-927f-0a0bbe385241 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:37.406653 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e64bbe99-4eed-49da-927f-0a0bbe385241 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:37.407837 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e64bbe99-4eed-49da-927f-0a0bbe385241 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 2348 microversion: 2.42 time: 0.170497 Oct 10 19:02:37.408406 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1350/2982] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:37 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 2348 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:37.413922 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4e8ea2f4-f1c2-4ee1-9974-5e12181b6c67 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:37.416564 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4e8ea2f4-f1c2-4ee1-9974-5e12181b6c67 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:37.422730 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4e8ea2f4-f1c2-4ee1-9974-5e12181b6c67 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.423259 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4e8ea2f4-f1c2-4ee1-9974-5e12181b6c67 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.423635 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4e8ea2f4-f1c2-4ee1-9974-5e12181b6c67 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.424360 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4e8ea2f4-f1c2-4ee1-9974-5e12181b6c67 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.424913 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4e8ea2f4-f1c2-4ee1-9974-5e12181b6c67 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.425397 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4e8ea2f4-f1c2-4ee1-9974-5e12181b6c67 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.433402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b17d2737-e995-4e58-b646-739335d45c45 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:37.469185 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b17d2737-e995-4e58-b646-739335d45c45 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1503 microversion: 2.1 time: 0.788374 Oct 10 19:02:37.486511 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1633/2983] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:36 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1503 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:02:37.491824 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0b1c4456-9161-41ea-9c3e-1de4e351cea4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:37.492455 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0b1c4456-9161-41ea-9c3e-1de4e351cea4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:37.511126 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b1c4456-9161-41ea-9c3e-1de4e351cea4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.511686 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b1c4456-9161-41ea-9c3e-1de4e351cea4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.512766 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b1c4456-9161-41ea-9c3e-1de4e351cea4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.513546 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b1c4456-9161-41ea-9c3e-1de4e351cea4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.514111 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b1c4456-9161-41ea-9c3e-1de4e351cea4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.514660 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b1c4456-9161-41ea-9c3e-1de4e351cea4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.590398 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b1c4456-9161-41ea-9c3e-1de4e351cea4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.590971 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b1c4456-9161-41ea-9c3e-1de4e351cea4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.591518 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0b1c4456-9161-41ea-9c3e-1de4e351cea4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.592062 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-0b1c4456-9161-41ea-9c3e-1de4e351cea4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lazy-loading 'fault' on Instance uuid 038abd42-6364-44c6-84e9-9590cdde6694 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:02:37.601817 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4e8ea2f4-f1c2-4ee1-9974-5e12181b6c67 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "PUT /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1080 microversion: 2.1 time: 0.191731 Oct 10 19:02:37.605723 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1351/2984] 10.222.0.43 () {60 vars in 1256 bytes} [Mon Oct 10 19:02:37 2022] PUT /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1080 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:37.619479 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-8dc71524-6796-4813-aea0-946c3294e7d1 req-19c85eb7-bf11-4d8c-a302-4625948e9b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-deleted", "tag": "d3835300-20da-488f-97b2-b41044bdcd24"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:37.630943 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-8dc71524-6796-4813-aea0-946c3294e7d1 req-19c85eb7-bf11-4d8c-a302-4625948e9b94 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.632361 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-8dc71524-6796-4813-aea0-946c3294e7d1 req-19c85eb7-bf11-4d8c-a302-4625948e9b94 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.632361 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-8dc71524-6796-4813-aea0-946c3294e7d1 req-19c85eb7-bf11-4d8c-a302-4625948e9b94 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.647818 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-8dc71524-6796-4813-aea0-946c3294e7d1 req-19c85eb7-bf11-4d8c-a302-4625948e9b94 service nova] Creating event network-vif-deleted:d3835300-20da-488f-97b2-b41044bdcd24 for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 19:02:37.653662 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-8dc71524-6796-4813-aea0-946c3294e7d1 req-19c85eb7-bf11-4d8c-a302-4625948e9b94 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046622 Oct 10 19:02:37.654450 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1352/2985] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:37.659978 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b64fcb02-a7ee-44a5-bd23-46bf813df166 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:37.661141 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b64fcb02-a7ee-44a5-bd23-46bf813df166 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:37.668021 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b64fcb02-a7ee-44a5-bd23-46bf813df166 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.668505 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b64fcb02-a7ee-44a5-bd23-46bf813df166 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.668982 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b64fcb02-a7ee-44a5-bd23-46bf813df166 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.669932 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b64fcb02-a7ee-44a5-bd23-46bf813df166 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.670322 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b64fcb02-a7ee-44a5-bd23-46bf813df166 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.670750 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b64fcb02-a7ee-44a5-bd23-46bf813df166 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.747036 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0b1c4456-9161-41ea-9c3e-1de4e351cea4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e80178dc7fa41f2bc7253dae37e7624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb1c539ef954d02a72a38ad8d8061e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:37.764582 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0b1c4456-9161-41ea-9c3e-1de4e351cea4 tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 200 len: 1314 microversion: 2.1 time: 0.276435 Oct 10 19:02:37.766825 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1634/2986] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:37 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:37.780577 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-bcbd98df-05e9-4ebc-bb9b-234e16cff9fc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:37.784801 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-bcbd98df-05e9-4ebc-bb9b-234e16cff9fc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:37.791875 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bcbd98df-05e9-4ebc-bb9b-234e16cff9fc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.792704 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bcbd98df-05e9-4ebc-bb9b-234e16cff9fc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.793370 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bcbd98df-05e9-4ebc-bb9b-234e16cff9fc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.794285 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bcbd98df-05e9-4ebc-bb9b-234e16cff9fc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.794951 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bcbd98df-05e9-4ebc-bb9b-234e16cff9fc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.795496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-bcbd98df-05e9-4ebc-bb9b-234e16cff9fc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.875760 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b64fcb02-a7ee-44a5-bd23-46bf813df166 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:37.884850 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b64fcb02-a7ee-44a5-bd23-46bf813df166 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1506 microversion: 2.1 time: 0.228990 Oct 10 19:02:37.885611 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1353/2987] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:37 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:37.890954 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6ce38c46-ddc4-42f6-be36-5c33a5b53897 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:37.891833 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6ce38c46-ddc4-42f6-be36-5c33a5b53897 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:37.910897 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6ce38c46-ddc4-42f6-be36-5c33a5b53897 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.912951 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6ce38c46-ddc4-42f6-be36-5c33a5b53897 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.916914 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6ce38c46-ddc4-42f6-be36-5c33a5b53897 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:37.916914 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6ce38c46-ddc4-42f6-be36-5c33a5b53897 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:37.916914 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6ce38c46-ddc4-42f6-be36-5c33a5b53897 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:37.916914 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6ce38c46-ddc4-42f6-be36-5c33a5b53897 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:38.030002 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-bcbd98df-05e9-4ebc-bb9b-234e16cff9fc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:38.040076 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-bcbd98df-05e9-4ebc-bb9b-234e16cff9fc tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.269551 Oct 10 19:02:38.061295 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1635/2988] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:37 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:38.076412 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-140628db-04a9-4251-9218-e05815a96176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:38.079082 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-140628db-04a9-4251-9218-e05815a96176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:38.097040 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-140628db-04a9-4251-9218-e05815a96176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:38.097633 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-140628db-04a9-4251-9218-e05815a96176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:38.098089 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-140628db-04a9-4251-9218-e05815a96176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:38.101558 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-140628db-04a9-4251-9218-e05815a96176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:38.102052 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-140628db-04a9-4251-9218-e05815a96176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:38.108290 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-140628db-04a9-4251-9218-e05815a96176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:38.228950 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-6ce38c46-ddc4-42f6-be36-5c33a5b53897 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:38.236237 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6ce38c46-ddc4-42f6-be36-5c33a5b53897 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1308 microversion: 2.1 time: 0.349068 Oct 10 19:02:38.241064 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1354/2989] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:37 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1308 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:38.437115 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-4a725524-fa69-44c7-9df0-ae882b76cf62 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:38.438137 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-4a725524-fa69-44c7-9df0-ae882b76cf62 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:38.445063 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a725524-fa69-44c7-9df0-ae882b76cf62 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:38.446193 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a725524-fa69-44c7-9df0-ae882b76cf62 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:38.447162 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a725524-fa69-44c7-9df0-ae882b76cf62 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:38.448349 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a725524-fa69-44c7-9df0-ae882b76cf62 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:38.449286 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a725524-fa69-44c7-9df0-ae882b76cf62 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:38.449929 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-4a725524-fa69-44c7-9df0-ae882b76cf62 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:38.518265 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-140628db-04a9-4251-9218-e05815a96176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:38.527679 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-140628db-04a9-4251-9218-e05815a96176 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1506 microversion: 2.1 time: 0.462662 Oct 10 19:02:38.528624 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1636/2990] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:38 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:38.534786 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c6964063-ad96-4aae-b28d-6e3dbf5e72ab tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:38.535596 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-c6964063-ad96-4aae-b28d-6e3dbf5e72ab tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:38.542719 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6964063-ad96-4aae-b28d-6e3dbf5e72ab tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:38.543429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6964063-ad96-4aae-b28d-6e3dbf5e72ab tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:38.544054 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6964063-ad96-4aae-b28d-6e3dbf5e72ab tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:38.544974 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6964063-ad96-4aae-b28d-6e3dbf5e72ab tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:38.545628 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6964063-ad96-4aae-b28d-6e3dbf5e72ab tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:38.546198 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-c6964063-ad96-4aae-b28d-6e3dbf5e72ab tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:38.837200 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4a725524-fa69-44c7-9df0-ae882b76cf62 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:38.861752 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4a725524-fa69-44c7-9df0-ae882b76cf62 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:38.864137 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-4a725524-fa69-44c7-9df0-ae882b76cf62 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:38.868229 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-4a725524-fa69-44c7-9df0-ae882b76cf62 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 2056 microversion: 2.42 time: 0.433675 Oct 10 19:02:38.876580 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1355/2991] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:38 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 2056 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:38.881638 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-7c8b5f03-35b6-4fca-8e3f-faf353462c56 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:38.889055 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-7c8b5f03-35b6-4fca-8e3f-faf353462c56 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:38.895953 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7c8b5f03-35b6-4fca-8e3f-faf353462c56 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:38.896839 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7c8b5f03-35b6-4fca-8e3f-faf353462c56 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:38.897463 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7c8b5f03-35b6-4fca-8e3f-faf353462c56 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:38.898319 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7c8b5f03-35b6-4fca-8e3f-faf353462c56 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:38.899166 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7c8b5f03-35b6-4fca-8e3f-faf353462c56 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:38.900090 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-7c8b5f03-35b6-4fca-8e3f-faf353462c56 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:38.970777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-c6964063-ad96-4aae-b28d-6e3dbf5e72ab tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:38.980431 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c6964063-ad96-4aae-b28d-6e3dbf5e72ab tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1503 microversion: 2.1 time: 0.450482 Oct 10 19:02:39.005588 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1637/2992] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:38 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1503 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:39.038491 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9d64db19-a0ee-4c2e-8011-4a80df40769a tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:39.042477 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-9d64db19-a0ee-4c2e-8011-4a80df40769a tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] [instance: 038abd42-6364-44c6-84e9-9590cdde6694] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:39.051375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d64db19-a0ee-4c2e-8011-4a80df40769a tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.052135 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d64db19-a0ee-4c2e-8011-4a80df40769a tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.052890 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d64db19-a0ee-4c2e-8011-4a80df40769a tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:39.053917 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d64db19-a0ee-4c2e-8011-4a80df40769a tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.054580 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d64db19-a0ee-4c2e-8011-4a80df40769a tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.055278 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-9d64db19-a0ee-4c2e-8011-4a80df40769a tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:39.072378 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-9d64db19-a0ee-4c2e-8011-4a80df40769a tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] HTTP exception thrown: Instance 038abd42-6364-44c6-84e9-9590cdde6694 could not be found. Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9d64db19-a0ee-4c2e-8011-4a80df40769a tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Request method failure captured: Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 HTTP/1.1 Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGwsFtEbAVzVwZ_nX0axpj30dhpFDTdwXbZAAanPPHU1fGOHFx_01BXSkSHGxUli7mFkebTTr8n_vMIdEStDLR4Jg19JZ069Gn3lXdxT5SX5n2rBP4ba9HPQOQ_5BTfbqPAR_Ct6jTQBYkM7yCYkpdw6k9F25rn6HqAMMevdrh8kzWM Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: 5eb1c539ef954d02a72a38ad8d8061e5 Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-839915115 Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5eb1c539ef954d02a72a38ad8d8061e5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5eb1c539ef954d02a72a38ad8d8061e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5eb1c539ef954d02a72a38ad8d8061e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5eb1c539ef954d02a72a38ad8d8061e5"}]}] Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-839915115 Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: 5eb1c539ef954d02a72a38ad8d8061e5 Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-839915115 Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServerAddressesNegativeTestJSON-839915115-project Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: 2e80178dc7fa41f2bc7253dae37e7624 Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-839915115-project Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 038abd42-6364-44c6-84e9-9590cdde6694 could not be found. Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '038abd42-6364-44c6-84e9-9590cdde6694'} Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 038abd42-6364-44c6-84e9-9590cdde6694 could not be found. Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 038abd42-6364-44c6-84e9-9590cdde6694 could not be found. Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:39.074559 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:39.085613 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:39.085613 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:39.085613 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:39.085613 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:39.085613 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:02:39.085613 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:02:39.085613 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 038abd42-6364-44c6-84e9-9590cdde6694 could not be found. Oct 10 19:02:39.085613 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:39.085613 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-9d64db19-a0ee-4c2e-8011-4a80df40769a tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] Returning 404 to user: Instance 038abd42-6364-44c6-84e9-9590cdde6694 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:02:39.085613 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-9d64db19-a0ee-4c2e-8011-4a80df40769a tempest-ServerAddressesNegativeTestJSON-839915115 tempest-ServerAddressesNegativeTestJSON-839915115-project] 10.222.0.43 "GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694" status: 404 len: 111 microversion: 2.1 time: 0.071736 Oct 10 19:02:39.085613 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1638/2993] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:39 2022] GET /compute/v2.1/servers/038abd42-6364-44c6-84e9-9590cdde6694 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:02:39.090822 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-75591c3b-11ad-4228-9d47-4cbec02901bf tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:39.091725 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-75591c3b-11ad-4228-9d47-4cbec02901bf tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:39.101058 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75591c3b-11ad-4228-9d47-4cbec02901bf tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.103089 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75591c3b-11ad-4228-9d47-4cbec02901bf tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.104467 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75591c3b-11ad-4228-9d47-4cbec02901bf tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:39.106400 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75591c3b-11ad-4228-9d47-4cbec02901bf tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.107860 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75591c3b-11ad-4228-9d47-4cbec02901bf tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.109781 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-75591c3b-11ad-4228-9d47-4cbec02901bf tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:39.157117 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-7c8b5f03-35b6-4fca-8e3f-faf353462c56 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "PUT /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1082 microversion: 2.1 time: 0.279098 Oct 10 19:02:39.172450 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1356/2994] 10.222.0.43 () {60 vars in 1256 bytes} [Mon Oct 10 19:02:38 2022] PUT /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1082 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:39.196867 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e2cc48d1-a9db-4032-8a9c-fd876d88725d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:39.199762 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e2cc48d1-a9db-4032-8a9c-fd876d88725d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:39.217176 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2cc48d1-a9db-4032-8a9c-fd876d88725d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.217675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2cc48d1-a9db-4032-8a9c-fd876d88725d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.221281 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2cc48d1-a9db-4032-8a9c-fd876d88725d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:39.223393 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2cc48d1-a9db-4032-8a9c-fd876d88725d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.226912 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2cc48d1-a9db-4032-8a9c-fd876d88725d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.227575 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e2cc48d1-a9db-4032-8a9c-fd876d88725d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:39.459173 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e2cc48d1-a9db-4032-8a9c-fd876d88725d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:39.486375 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e2cc48d1-a9db-4032-8a9c-fd876d88725d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1508 microversion: 2.1 time: 0.299907 Oct 10 19:02:39.490429 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1357/2995] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:39 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1508 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:39.502875 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cc22d597-9cfd-47a2-b7a5-a85063cac80b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:39.505079 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cc22d597-9cfd-47a2-b7a5-a85063cac80b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:39.514847 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc22d597-9cfd-47a2-b7a5-a85063cac80b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.515916 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc22d597-9cfd-47a2-b7a5-a85063cac80b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.516222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc22d597-9cfd-47a2-b7a5-a85063cac80b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:39.517432 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc22d597-9cfd-47a2-b7a5-a85063cac80b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.518080 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc22d597-9cfd-47a2-b7a5-a85063cac80b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.518654 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cc22d597-9cfd-47a2-b7a5-a85063cac80b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:39.527142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-75591c3b-11ad-4228-9d47-4cbec02901bf tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:39.546546 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-75591c3b-11ad-4228-9d47-4cbec02901bf tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.461392 Oct 10 19:02:39.555339 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1639/2996] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:39 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:39.563496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d01a93a7-6ede-40d0-ad7e-fe1769276b00 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:39.567375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-d01a93a7-6ede-40d0-ad7e-fe1769276b00 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:39.585702 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d01a93a7-6ede-40d0-ad7e-fe1769276b00 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.588696 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d01a93a7-6ede-40d0-ad7e-fe1769276b00 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.589472 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d01a93a7-6ede-40d0-ad7e-fe1769276b00 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:39.590448 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d01a93a7-6ede-40d0-ad7e-fe1769276b00 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.591234 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d01a93a7-6ede-40d0-ad7e-fe1769276b00 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.593177 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-d01a93a7-6ede-40d0-ad7e-fe1769276b00 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:39.831481 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cc22d597-9cfd-47a2-b7a5-a85063cac80b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:39.845071 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cc22d597-9cfd-47a2-b7a5-a85063cac80b tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1488 microversion: 2.1 time: 0.351569 Oct 10 19:02:39.847904 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1358/2997] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:39 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1488 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:39.866485 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-7b32110e-6ed4-41a8-8c1b-4e221597d8e9 req-76dcd32d-4232-4c10-93aa-4889cd412bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e826b78-f676-478a-bccf-8d36547f2582", "name": "network-vif-deleted", "tag": "973a75cc-00b3-43e5-a2d6-eaeb4c2f27ac"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:39.867375 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-d01a93a7-6ede-40d0-ad7e-fe1769276b00 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:39.879805 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d01a93a7-6ede-40d0-ad7e-fe1769276b00 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1508 microversion: 2.1 time: 0.322796 Oct 10 19:02:39.881132 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1640/2998] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:39 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:39.886684 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-7dec0f0b-6875-4d2d-a370-fc05195e7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:39.887429 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-7dec0f0b-6875-4d2d-a370-fc05195e7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:39.893776 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7dec0f0b-6875-4d2d-a370-fc05195e7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.894496 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7dec0f0b-6875-4d2d-a370-fc05195e7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.894758 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7b32110e-6ed4-41a8-8c1b-4e221597d8e9 req-76dcd32d-4232-4c10-93aa-4889cd412bc0 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.895371 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7dec0f0b-6875-4d2d-a370-fc05195e7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:39.895508 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7b32110e-6ed4-41a8-8c1b-4e221597d8e9 req-76dcd32d-4232-4c10-93aa-4889cd412bc0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.895976 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-7b32110e-6ed4-41a8-8c1b-4e221597d8e9 req-76dcd32d-4232-4c10-93aa-4889cd412bc0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:39.896652 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7dec0f0b-6875-4d2d-a370-fc05195e7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.897308 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7dec0f0b-6875-4d2d-a370-fc05195e7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.897934 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-7dec0f0b-6875-4d2d-a370-fc05195e7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:39.929787 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-7b32110e-6ed4-41a8-8c1b-4e221597d8e9 req-76dcd32d-4232-4c10-93aa-4889cd412bc0 service nova] Creating event network-vif-deleted:973a75cc-00b3-43e5-a2d6-eaeb4c2f27ac for instance 2e826b78-f676-478a-bccf-8d36547f2582 on n-h1-860863-1 Oct 10 19:02:39.930615 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.objects.instance [None req-7dec0f0b-6875-4d2d-a370-fc05195e7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lazy-loading 'flavor' on Instance uuid f8ed690e-d123-4c67-8311-9f2f94919766 {{(pid=127288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:02:39.935020 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-7b32110e-6ed4-41a8-8c1b-4e221597d8e9 req-76dcd32d-4232-4c10-93aa-4889cd412bc0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085374 Oct 10 19:02:39.939237 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1359/2999] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:39.944865 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9bc28bb6-257d-4212-927a-86f9e1652e92 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:39.945820 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9bc28bb6-257d-4212-927a-86f9e1652e92 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:39.953899 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9bc28bb6-257d-4212-927a-86f9e1652e92 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.954609 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9bc28bb6-257d-4212-927a-86f9e1652e92 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.955316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9bc28bb6-257d-4212-927a-86f9e1652e92 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:39.956224 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9bc28bb6-257d-4212-927a-86f9e1652e92 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:39.956901 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9bc28bb6-257d-4212-927a-86f9e1652e92 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:39.957882 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9bc28bb6-257d-4212-927a-86f9e1652e92 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:40.055921 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9bc28bb6-257d-4212-927a-86f9e1652e92 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:40.063095 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:40.076608 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9bc28bb6-257d-4212-927a-86f9e1652e92 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:40.079171 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9bc28bb6-257d-4212-927a-86f9e1652e92 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:40.080558 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9bc28bb6-257d-4212-927a-86f9e1652e92 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1605 microversion: 2.42 time: 0.139749 Oct 10 19:02:40.081332 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1360/3000] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:39 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1605 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:40.086926 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-6f2e329e-a12a-48cc-9665-aa1404483716 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:40.088452 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6f2e329e-a12a-48cc-9665-aa1404483716 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:40.094708 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f2e329e-a12a-48cc-9665-aa1404483716 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:40.095203 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f2e329e-a12a-48cc-9665-aa1404483716 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:40.095721 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f2e329e-a12a-48cc-9665-aa1404483716 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:40.097008 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f2e329e-a12a-48cc-9665-aa1404483716 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:40.097461 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f2e329e-a12a-48cc-9665-aa1404483716 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:40.097998 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-6f2e329e-a12a-48cc-9665-aa1404483716 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:40.139850 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-6f2e329e-a12a-48cc-9665-aa1404483716 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:02:40.316911 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-7dec0f0b-6875-4d2d-a370-fc05195e7d7f tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "POST /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766/action" status: 202 len: 0 microversion: 2.1 time: 0.434173 Oct 10 19:02:40.318609 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1641/3001] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:02:39 2022] POST /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 10 19:02:40.327030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-43be0080-d180-4119-8d7d-aeee36cb9812 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:40.328121 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-43be0080-d180-4119-8d7d-aeee36cb9812 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:40.336237 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43be0080-d180-4119-8d7d-aeee36cb9812 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:40.337090 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43be0080-d180-4119-8d7d-aeee36cb9812 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:40.337764 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43be0080-d180-4119-8d7d-aeee36cb9812 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:40.338709 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43be0080-d180-4119-8d7d-aeee36cb9812 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:40.339326 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43be0080-d180-4119-8d7d-aeee36cb9812 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:40.339956 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-43be0080-d180-4119-8d7d-aeee36cb9812 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:40.552494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-43be0080-d180-4119-8d7d-aeee36cb9812 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee224c527494aec81a29103a3c3332e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d12307b731846928ce877a98bce8c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:40.558237 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-6f2e329e-a12a-48cc-9665-aa1404483716 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 204 len: 0 microversion: 2.1 time: 0.459019 Oct 10 19:02:40.562012 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-43be0080-d180-4119-8d7d-aeee36cb9812 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1478 microversion: 2.1 time: 0.241802 Oct 10 19:02:40.562570 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1361/3002] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:02:40 2022] DELETE /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:02:40.580994 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-9d29c89e-98b4-485f-bf10-a75d7946728a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:40.580994 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-9d29c89e-98b4-485f-bf10-a75d7946728a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:40.580994 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:40.582437 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9d29c89e-98b4-485f-bf10-a75d7946728a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:40.583027 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9d29c89e-98b4-485f-bf10-a75d7946728a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:40.583808 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9d29c89e-98b4-485f-bf10-a75d7946728a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:40.583954 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1642/3003] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:40 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1478 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:40.584717 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9d29c89e-98b4-485f-bf10-a75d7946728a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:40.585226 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9d29c89e-98b4-485f-bf10-a75d7946728a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:40.593045 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-9d29c89e-98b4-485f-bf10-a75d7946728a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:40.595687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-909142459", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4179f58a-185a-4f50-87fd-c38520f67586"}], "security_groups": [{"name": "tempest-securitygroup--1412484094"}], "key_name": "tempest-keypair-158845923", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "0c00bfba-ba33-49e8-bd5c-b948b6905c84", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:40.798119 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] validate_networks() for [('4179f58a-185a-4f50-87fd-c38520f67586', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 19:02:40.998033 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-9d29c89e-98b4-485f-bf10-a75d7946728a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:41.007811 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-9d29c89e-98b4-485f-bf10-a75d7946728a tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1496 microversion: 2.1 time: 0.443243 Oct 10 19:02:41.014523 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1362/3004] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:40 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1496 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:41.029377 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-be752a54-6044-48f9-8022-9d5e86a49c30 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:41.029952 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-be752a54-6044-48f9-8022-9d5e86a49c30 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:41.036368 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be752a54-6044-48f9-8022-9d5e86a49c30 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:41.042482 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be752a54-6044-48f9-8022-9d5e86a49c30 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:41.043041 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be752a54-6044-48f9-8022-9d5e86a49c30 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:41.043780 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be752a54-6044-48f9-8022-9d5e86a49c30 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:41.044242 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be752a54-6044-48f9-8022-9d5e86a49c30 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:41.044693 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-be752a54-6044-48f9-8022-9d5e86a49c30 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:41.095369 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-be752a54-6044-48f9-8022-9d5e86a49c30 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Going to try to terminate instance {{(pid=127289) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 10 19:02:41.210011 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.compute.api [None req-be752a54-6044-48f9-8022-9d5e86a49c30 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Instance is already in deleting state, ignoring this request Oct 10 19:02:41.211251 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-be752a54-6044-48f9-8022-9d5e86a49c30 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 204 len: 0 microversion: 2.1 time: 0.195612 Oct 10 19:02:41.215971 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1363/3005] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:02:41 2022] DELETE /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 10 19:02:41.221870 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-124c45e6-e34c-40e5-9c34-5bb115663d74 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:41.222750 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-124c45e6-e34c-40e5-9c34-5bb115663d74 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:41.229203 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-124c45e6-e34c-40e5-9c34-5bb115663d74 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:41.230406 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-124c45e6-e34c-40e5-9c34-5bb115663d74 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:41.230406 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-124c45e6-e34c-40e5-9c34-5bb115663d74 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:41.230862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-124c45e6-e34c-40e5-9c34-5bb115663d74 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:41.231316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-124c45e6-e34c-40e5-9c34-5bb115663d74 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:41.231738 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-124c45e6-e34c-40e5-9c34-5bb115663d74 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:41.461501 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-124c45e6-e34c-40e5-9c34-5bb115663d74 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:41.470783 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-124c45e6-e34c-40e5-9c34-5bb115663d74 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.252725 Oct 10 19:02:41.473123 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1364/3006] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:41 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:41.493181 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-29eec93f-db0c-4246-ad2e-f586dfb2719b tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Calling method '.version_select at 0x7f318d0f3ee0>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:41.497318 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29eec93f-db0c-4246-ad2e-f586dfb2719b tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:41.498034 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29eec93f-db0c-4246-ad2e-f586dfb2719b tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:41.498660 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-29eec93f-db0c-4246-ad2e-f586dfb2719b tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:41.508914 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-29eec93f-db0c-4246-ad2e-f586dfb2719b tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 784 microversion: 2.1 time: 0.025088 Oct 10 19:02:41.519274 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1365/3007] 10.222.0.43 () {58 vars in 1143 bytes} [Mon Oct 10 19:02:41 2022] GET /compute/v2.1/os-migrations => generated 784 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:41.519667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-cd36f3c9-d25c-42d0-bdcd-6dedae8a799c tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:41.520324 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-cd36f3c9-d25c-42d0-bdcd-6dedae8a799c tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:41.547983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd36f3c9-d25c-42d0-bdcd-6dedae8a799c tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:41.548482 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd36f3c9-d25c-42d0-bdcd-6dedae8a799c tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:41.548956 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd36f3c9-d25c-42d0-bdcd-6dedae8a799c tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:41.550253 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd36f3c9-d25c-42d0-bdcd-6dedae8a799c tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:41.550709 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd36f3c9-d25c-42d0-bdcd-6dedae8a799c tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:41.551132 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-cd36f3c9-d25c-42d0-bdcd-6dedae8a799c tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:41.660190 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cd36f3c9-d25c-42d0-bdcd-6dedae8a799c tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:41.681312 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cd36f3c9-d25c-42d0-bdcd-6dedae8a799c tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:41.683203 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-cd36f3c9-d25c-42d0-bdcd-6dedae8a799c tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:41.684934 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-cd36f3c9-d25c-42d0-bdcd-6dedae8a799c tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1605 microversion: 2.42 time: 0.174418 Oct 10 19:02:41.686039 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1366/3008] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:41 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1605 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:41.691494 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-fd181387-23d4-4fbc-a705-0745a76f42e5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:41.692457 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-fd181387-23d4-4fbc-a705-0745a76f42e5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:41.700449 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd181387-23d4-4fbc-a705-0745a76f42e5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:41.704229 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd181387-23d4-4fbc-a705-0745a76f42e5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:41.704709 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd181387-23d4-4fbc-a705-0745a76f42e5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:41.705975 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd181387-23d4-4fbc-a705-0745a76f42e5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:41.706428 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd181387-23d4-4fbc-a705-0745a76f42e5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:41.706846 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-fd181387-23d4-4fbc-a705-0745a76f42e5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:41.947770 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Getting quotas for project 6482edb6681449208592d3bb035d7e8a. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 19:02:41.956690 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Getting quotas for user 0c1f0c5ec9fe47768424f04a8f721e46 and project 6482edb6681449208592d3bb035d7e8a. Resources: dict_keys(['metadata_items']) {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 19:02:41.974399 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 19:02:41.975113 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 19:02:41.975790 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 19:02:41.976210 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 19:02:41.977648 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 19:02:41.988156 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:41.989679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:41.990142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:41.991411 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:41.991895 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:41.992310 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:42.034865 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-fd181387-23d4-4fbc-a705-0745a76f42e5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:42.049143 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-fd181387-23d4-4fbc-a705-0745a76f42e5 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1514 microversion: 2.1 time: 0.361802 Oct 10 19:02:42.049942 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1367/3009] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:41 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1514 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:42.066147 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Getting quotas for project 6482edb6681449208592d3bb035d7e8a. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 19:02:42.071439 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:42.074710 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-c152bccb-9e49-4404-b884-a1fe8539139d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:42.077262 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-c152bccb-9e49-4404-b884-a1fe8539139d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] [instance: 7e33016a-8156-4050-bcbd-fdd7a29b865b] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:42.084150 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Getting quotas for user 0c1f0c5ec9fe47768424f04a8f721e46 and project 6482edb6681449208592d3bb035d7e8a. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 19:02:42.088385 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c152bccb-9e49-4404-b884-a1fe8539139d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:42.092676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c152bccb-9e49-4404-b884-a1fe8539139d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:42.092676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c152bccb-9e49-4404-b884-a1fe8539139d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:42.092676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c152bccb-9e49-4404-b884-a1fe8539139d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:42.092676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c152bccb-9e49-4404-b884-a1fe8539139d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:42.092676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-c152bccb-9e49-4404-b884-a1fe8539139d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:42.161542 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 19:02:42.166039 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] [instance: d12519a5-adbf-410a-b837-02b9cc314e3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0c00bfba-ba33-49e8-bd5c-b948b6905c84',volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 19:02:42.437628 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-c152bccb-9e49-4404-b884-a1fe8539139d tempest-LiveMigrationTest-1441838602 tempest-LiveMigrationTest-1441838602-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b" status: 200 len: 1629 microversion: 2.1 time: 0.372490 Oct 10 19:02:42.438765 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1368/3010] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:42 2022] GET /compute/v2.1/servers/7e33016a-8156-4050-bcbd-fdd7a29b865b => generated 1629 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:42.450364 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e5a38241-d745-4b43-a858-9a8f0047fc59 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:42.450983 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e5a38241-d745-4b43-a858-9a8f0047fc59 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:42.463377 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e5a38241-d745-4b43-a858-9a8f0047fc59 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:42.463377 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e5a38241-d745-4b43-a858-9a8f0047fc59 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:42.463377 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e5a38241-d745-4b43-a858-9a8f0047fc59 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:42.463722 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e5a38241-d745-4b43-a858-9a8f0047fc59 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:42.464096 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e5a38241-d745-4b43-a858-9a8f0047fc59 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:42.464471 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e5a38241-d745-4b43-a858-9a8f0047fc59 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:42.673958 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e5a38241-d745-4b43-a858-9a8f0047fc59 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76ba48b4475d429f884546750a467e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2cfdbce62b4c72b773d5312d02ab40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:42.685322 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e5a38241-d745-4b43-a858-9a8f0047fc59 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766" status: 200 len: 1479 microversion: 2.1 time: 0.245109 Oct 10 19:02:42.686808 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1369/3011] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:42 2022] GET /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766 => generated 1479 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:42.695425 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-ffe9698e-1834-4d58-ab68-14d2597e5a45 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Action: 'create', calling method: .version_select at 0x7f318dbdcee0>, body: {"keypair": {"name": "tempest-keypair-723037458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUlDHTdZILvXKLWoZYYjbjmT6ECoi0V9A/Z0ToQmloAZjYh9l+c5BpWrViHYLo0dx4UNdVjgSi4KY2gP3OhzkqxZa0mZTVh/qi1kd+VSjJ28k44ftI9DCxYI8hkHq+uYw=="}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:42.711222 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-ffe9698e-1834-4d58-ab68-14d2597e5a45 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Getting quotas for project 9d12307b731846928ce877a98bce8c10. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 19:02:42.717267 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.quota [None req-ffe9698e-1834-4d58-ab68-14d2597e5a45 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Getting quotas for user 3ee224c527494aec81a29103a3c3332e and project 9d12307b731846928ce877a98bce8c10. Resources: {'key_pairs'} {{(pid=127289) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 19:02:42.780285 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-586273a7-455f-453e-87fb-c4f025573849 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.194771 Oct 10 19:02:42.782074 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1643/3012] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 19:02:40 2022] POST /compute/v2.1/servers => generated 407 bytes in 2197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 10 19:02:42.794351 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-b17e27db-0eec-4bec-a157-5f1d8d30be70 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:42.797276 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-b17e27db-0eec-4bec-a157-5f1d8d30be70 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:42.816895 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b17e27db-0eec-4bec-a157-5f1d8d30be70 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:42.823221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b17e27db-0eec-4bec-a157-5f1d8d30be70 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:42.823221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b17e27db-0eec-4bec-a157-5f1d8d30be70 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:42.823221 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b17e27db-0eec-4bec-a157-5f1d8d30be70 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:42.824254 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b17e27db-0eec-4bec-a157-5f1d8d30be70 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:42.824744 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-b17e27db-0eec-4bec-a157-5f1d8d30be70 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:42.845267 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-ffe9698e-1834-4d58-ab68-14d2597e5a45 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.157245 Oct 10 19:02:42.847078 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1370/3013] 10.222.0.43 () {60 vars in 1159 bytes} [Mon Oct 10 19:02:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:42.852321 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-41d04d0d-ed17-48c2-9aec-217a06623f12 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:42.854510 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-41d04d0d-ed17-48c2-9aec-217a06623f12 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:42.872029 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41d04d0d-ed17-48c2-9aec-217a06623f12 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:42.872816 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41d04d0d-ed17-48c2-9aec-217a06623f12 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:42.873417 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41d04d0d-ed17-48c2-9aec-217a06623f12 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:42.874309 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41d04d0d-ed17-48c2-9aec-217a06623f12 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:42.875882 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41d04d0d-ed17-48c2-9aec-217a06623f12 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:42.876508 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-41d04d0d-ed17-48c2-9aec-217a06623f12 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:42.999888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-41d04d0d-ed17-48c2-9aec-217a06623f12 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:43.014129 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-41d04d0d-ed17-48c2-9aec-217a06623f12 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:43.019343 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-41d04d0d-ed17-48c2-9aec-217a06623f12 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:43.023219 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-41d04d0d-ed17-48c2-9aec-217a06623f12 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1605 microversion: 2.42 time: 0.174753 Oct 10 19:02:43.036579 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1371/3014] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:42 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1605 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:43.036579 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b331d645-9dc0-4c0a-a480-a5d77aeb45a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1559072700"}} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:43.037353 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b331d645-9dc0-4c0a-a480-a5d77aeb45a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] [instance: f8ed690e-d123-4c67-8311-9f2f94919766] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:43.051382 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b331d645-9dc0-4c0a-a480-a5d77aeb45a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:43.051927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b331d645-9dc0-4c0a-a480-a5d77aeb45a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:43.052315 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b331d645-9dc0-4c0a-a480-a5d77aeb45a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:43.057003 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b331d645-9dc0-4c0a-a480-a5d77aeb45a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:43.059246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b331d645-9dc0-4c0a-a480-a5d77aeb45a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:43.059246 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b331d645-9dc0-4c0a-a480-a5d77aeb45a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:43.476703 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-b17e27db-0eec-4bec-a157-5f1d8d30be70 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:43.492237 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-b17e27db-0eec-4bec-a157-5f1d8d30be70 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.708731 Oct 10 19:02:43.493179 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1644/3015] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:42 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:43.503568 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-72cbfb6b-b647-4804-a725-6a0f2bcb0192 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:43.504277 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-72cbfb6b-b647-4804-a725-6a0f2bcb0192 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] [instance: d12519a5-adbf-410a-b837-02b9cc314e3a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:43.598555 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-72cbfb6b-b647-4804-a725-6a0f2bcb0192 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1f0c5ec9fe47768424f04a8f721e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6482edb6681449208592d3bb035d7e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:43.606709 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-72cbfb6b-b647-4804-a725-6a0f2bcb0192 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] 10.222.0.43 "GET /compute/v2.1/servers/d12519a5-adbf-410a-b837-02b9cc314e3a" status: 200 len: 1120 microversion: 2.1 time: 0.112387 Oct 10 19:02:43.610512 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1645/3016] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:43 2022] GET /compute/v2.1/servers/d12519a5-adbf-410a-b837-02b9cc314e3a => generated 1120 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:43.622056 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-70bbee0d-5fd1-49f5-b83c-427bf290f41c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:43.623795 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-70bbee0d-5fd1-49f5-b83c-427bf290f41c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:43.648356 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-70bbee0d-5fd1-49f5-b83c-427bf290f41c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:43.649565 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-70bbee0d-5fd1-49f5-b83c-427bf290f41c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:43.650195 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-70bbee0d-5fd1-49f5-b83c-427bf290f41c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:43.651142 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-70bbee0d-5fd1-49f5-b83c-427bf290f41c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:43.651765 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-70bbee0d-5fd1-49f5-b83c-427bf290f41c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:43.652348 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-70bbee0d-5fd1-49f5-b83c-427bf290f41c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:43.841349 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-70bbee0d-5fd1-49f5-b83c-427bf290f41c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:43.847126 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-70bbee0d-5fd1-49f5-b83c-427bf290f41c tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1472 microversion: 2.1 time: 0.234694 Oct 10 19:02:43.848140 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1646/3017] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:43 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1472 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:43.854151 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-36ef03d9-b1d3-45c9-a396-23bab9e3b927 req-343c8271-1400-4de0-975d-60b795f98765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a67bae-512b-46d3-ad95-f18d54be4a0c", "name": "network-vif-deleted", "tag": "5c06c478-32f5-4c60-a392-6c8125163fad"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:43.865258 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-36ef03d9-b1d3-45c9-a396-23bab9e3b927 req-343c8271-1400-4de0-975d-60b795f98765 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:43.866037 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-36ef03d9-b1d3-45c9-a396-23bab9e3b927 req-343c8271-1400-4de0-975d-60b795f98765 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:43.866474 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-36ef03d9-b1d3-45c9-a396-23bab9e3b927 req-343c8271-1400-4de0-975d-60b795f98765 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:43.879276 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-36ef03d9-b1d3-45c9-a396-23bab9e3b927 req-343c8271-1400-4de0-975d-60b795f98765 service nova] Creating event network-vif-deleted:5c06c478-32f5-4c60-a392-6c8125163fad for instance 23a67bae-512b-46d3-ad95-f18d54be4a0c on n-h2-860863-1 Oct 10 19:02:43.884705 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-36ef03d9-b1d3-45c9-a396-23bab9e3b927 req-343c8271-1400-4de0-975d-60b795f98765 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035015 Oct 10 19:02:43.885504 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1647/3018] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:43.943442 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b331d645-9dc0-4c0a-a480-a5d77aeb45a6 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "POST /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766/action" status: 202 len: 0 microversion: 2.1 time: 0.918262 Oct 10 19:02:43.947091 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1372/3019] 10.222.0.43 () {60 vars in 1278 bytes} [Mon Oct 10 19:02:43 2022] POST /compute/v2.1/servers/f8ed690e-d123-4c67-8311-9f2f94919766/action => generated 0 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 10 19:02:43.962551 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-c71a4742-c196-4696-b04f-ecc9bcafb9dc tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318deb71f0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:44.042385 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-c71a4742-c196-4696-b04f-ecc9bcafb9dc tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/949ef2d3-c68f-4a28-8c55-59f81041525a" status: 200 len: 1440 microversion: 2.1 time: 0.086951 Oct 10 19:02:44.043459 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1648/3020] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:02:43 2022] GET /compute/v2.1/images/949ef2d3-c68f-4a28-8c55-59f81041525a => generated 1440 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:44.062588 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-337029fa-9234-43f5-9282-b21845df9537 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:44.064598 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-337029fa-9234-43f5-9282-b21845df9537 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:44.081805 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-337029fa-9234-43f5-9282-b21845df9537 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:44.082654 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-337029fa-9234-43f5-9282-b21845df9537 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:44.083316 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-337029fa-9234-43f5-9282-b21845df9537 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:44.085312 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-337029fa-9234-43f5-9282-b21845df9537 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:44.085970 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-337029fa-9234-43f5-9282-b21845df9537 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:44.086573 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-337029fa-9234-43f5-9282-b21845df9537 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:44.294441 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-337029fa-9234-43f5-9282-b21845df9537 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:44.301132 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-337029fa-9234-43f5-9282-b21845df9537 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:44.302678 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-337029fa-9234-43f5-9282-b21845df9537 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:44.303953 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-337029fa-9234-43f5-9282-b21845df9537 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1605 microversion: 2.42 time: 0.247693 Oct 10 19:02:44.316946 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1373/3021] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:44 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1605 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:44.516016 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-a6e97380-a046-40d0-bac3-178dd0ad75a1 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:44.517726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-a6e97380-a046-40d0-bac3-178dd0ad75a1 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:44.527537 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6e97380-a046-40d0-bac3-178dd0ad75a1 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:44.527537 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6e97380-a046-40d0-bac3-178dd0ad75a1 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:44.527537 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6e97380-a046-40d0-bac3-178dd0ad75a1 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:44.528402 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6e97380-a046-40d0-bac3-178dd0ad75a1 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:44.529052 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6e97380-a046-40d0-bac3-178dd0ad75a1 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:44.529642 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-a6e97380-a046-40d0-bac3-178dd0ad75a1 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:44.648070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-05da478b-05b3-4ad0-9885-3d5750409444 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:44.648070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-05da478b-05b3-4ad0-9885-3d5750409444 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] [instance: d12519a5-adbf-410a-b837-02b9cc314e3a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:44.648070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05da478b-05b3-4ad0-9885-3d5750409444 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:44.648070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05da478b-05b3-4ad0-9885-3d5750409444 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:44.648070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05da478b-05b3-4ad0-9885-3d5750409444 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:44.648070 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05da478b-05b3-4ad0-9885-3d5750409444 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:44.654981 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05da478b-05b3-4ad0-9885-3d5750409444 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:44.656910 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-05da478b-05b3-4ad0-9885-3d5750409444 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:44.740261 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-05da478b-05b3-4ad0-9885-3d5750409444 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1f0c5ec9fe47768424f04a8f721e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6482edb6681449208592d3bb035d7e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:44.744309 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:44.748961 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-05da478b-05b3-4ad0-9885-3d5750409444 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] 10.222.0.43 "GET /compute/v2.1/servers/d12519a5-adbf-410a-b837-02b9cc314e3a" status: 200 len: 1170 microversion: 2.1 time: 0.116074 Oct 10 19:02:44.756522 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1374/3022] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:44 2022] GET /compute/v2.1/servers/d12519a5-adbf-410a-b837-02b9cc314e3a => generated 1170 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:44.870608 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e3f883af-51d2-4b11-928a-19787a3a07bb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:44.871235 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-e3f883af-51d2-4b11-928a-19787a3a07bb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:44.880150 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3f883af-51d2-4b11-928a-19787a3a07bb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:44.880675 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3f883af-51d2-4b11-928a-19787a3a07bb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:44.893918 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3f883af-51d2-4b11-928a-19787a3a07bb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:44.894692 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3f883af-51d2-4b11-928a-19787a3a07bb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:44.895342 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3f883af-51d2-4b11-928a-19787a3a07bb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:44.895955 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3f883af-51d2-4b11-928a-19787a3a07bb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:44.956396 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3f883af-51d2-4b11-928a-19787a3a07bb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:44.957136 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3f883af-51d2-4b11-928a-19787a3a07bb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:44.957655 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-a6e97380-a046-40d0-bac3-178dd0ad75a1 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:44.959914 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-e3f883af-51d2-4b11-928a-19787a3a07bb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:44.960644 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.objects.instance [None req-e3f883af-51d2-4b11-928a-19787a3a07bb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lazy-loading 'fault' on Instance uuid 23a67bae-512b-46d3-ad95-f18d54be4a0c {{(pid=127289) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 10 19:02:44.972373 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-a6e97380-a046-40d0-bac3-178dd0ad75a1 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.458521 Oct 10 19:02:44.991594 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1649/3023] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:44 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:45.014640 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-e3f883af-51d2-4b11-928a-19787a3a07bb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83cb923e3064ac7aeb1bd6883415e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2cfbbf586f5441e80930980df18d471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:45.025553 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e3f883af-51d2-4b11-928a-19787a3a07bb tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 200 len: 1307 microversion: 2.1 time: 0.158838 Oct 10 19:02:45.030544 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1375/3024] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:44 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 1307 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:45.059514 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6af8e184-acdc-4941-a84d-97f9689dfc19 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f319227ef70>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:45.105665 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6af8e184-acdc-4941-a84d-97f9689dfc19 tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/949ef2d3-c68f-4a28-8c55-59f81041525a" status: 200 len: 1440 microversion: 2.1 time: 0.050324 Oct 10 19:02:45.109705 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1650/3025] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:02:45 2022] GET /compute/v2.1/images/949ef2d3-c68f-4a28-8c55-59f81041525a => generated 1440 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:45.351279 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-8e5bc4a9-d2e1-452d-be7e-e0f7230fad2e tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:45.351279 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-8e5bc4a9-d2e1-452d-be7e-e0f7230fad2e tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:45.361603 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8e5bc4a9-d2e1-452d-be7e-e0f7230fad2e tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:45.362554 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8e5bc4a9-d2e1-452d-be7e-e0f7230fad2e tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:45.363400 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8e5bc4a9-d2e1-452d-be7e-e0f7230fad2e tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:45.364460 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8e5bc4a9-d2e1-452d-be7e-e0f7230fad2e tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:45.365943 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8e5bc4a9-d2e1-452d-be7e-e0f7230fad2e tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:45.366800 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-8e5bc4a9-d2e1-452d-be7e-e0f7230fad2e tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:45.563987 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8e5bc4a9-d2e1-452d-be7e-e0f7230fad2e tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:45.580927 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8e5bc4a9-d2e1-452d-be7e-e0f7230fad2e tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:45.587679 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-8e5bc4a9-d2e1-452d-be7e-e0f7230fad2e tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:45.588969 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-8e5bc4a9-d2e1-452d-be7e-e0f7230fad2e tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1605 microversion: 2.42 time: 0.262769 Oct 10 19:02:45.589574 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1376/3026] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:45 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1605 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:45.779259 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-0f7991dd-9941-4f76-9781-45a0e42a52fc tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:45.779894 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-0f7991dd-9941-4f76-9781-45a0e42a52fc tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] [instance: d12519a5-adbf-410a-b837-02b9cc314e3a] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:45.791909 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f7991dd-9941-4f76-9781-45a0e42a52fc tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:45.792321 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f7991dd-9941-4f76-9781-45a0e42a52fc tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:45.792785 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f7991dd-9941-4f76-9781-45a0e42a52fc tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:45.793508 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f7991dd-9941-4f76-9781-45a0e42a52fc tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:45.793968 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f7991dd-9941-4f76-9781-45a0e42a52fc tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:45.794398 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-0f7991dd-9941-4f76-9781-45a0e42a52fc tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.001592 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-10504196-23a0-4c3f-a862-a1c41e0b5ec7 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:46.002694 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-10504196-23a0-4c3f-a862-a1c41e0b5ec7 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:46.013804 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10504196-23a0-4c3f-a862-a1c41e0b5ec7 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:46.014888 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10504196-23a0-4c3f-a862-a1c41e0b5ec7 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:46.019284 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10504196-23a0-4c3f-a862-a1c41e0b5ec7 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.020181 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10504196-23a0-4c3f-a862-a1c41e0b5ec7 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:46.020788 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10504196-23a0-4c3f-a862-a1c41e0b5ec7 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:46.021234 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-10504196-23a0-4c3f-a862-a1c41e0b5ec7 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.108926 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-0f7991dd-9941-4f76-9781-45a0e42a52fc tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1f0c5ec9fe47768424f04a8f721e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6482edb6681449208592d3bb035d7e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:46.122937 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-0f7991dd-9941-4f76-9781-45a0e42a52fc tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] 10.222.0.43 "GET /compute/v2.1/servers/d12519a5-adbf-410a-b837-02b9cc314e3a" status: 200 len: 1218 microversion: 2.1 time: 0.347256 Oct 10 19:02:46.123862 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1651/3027] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:45 2022] GET /compute/v2.1/servers/d12519a5-adbf-410a-b837-02b9cc314e3a => generated 1218 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:46.130634 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8e295d86-d6f0-4815-b769-c8232652720e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:46.131253 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-8e295d86-d6f0-4815-b769-c8232652720e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 23a67bae-512b-46d3-ad95-f18d54be4a0c] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:46.148970 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e295d86-d6f0-4815-b769-c8232652720e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:46.149468 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e295d86-d6f0-4815-b769-c8232652720e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:46.149904 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e295d86-d6f0-4815-b769-c8232652720e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.150624 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e295d86-d6f0-4815-b769-c8232652720e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:46.151078 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e295d86-d6f0-4815-b769-c8232652720e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:46.151506 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-8e295d86-d6f0-4815-b769-c8232652720e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.198417 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-8e295d86-d6f0-4815-b769-c8232652720e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] HTTP exception thrown: Instance 23a67bae-512b-46d3-ad95-f18d54be4a0c could not be found. Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8e295d86-d6f0-4815-b769-c8232652720e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Request method failure captured: Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c HTTP/1.1 Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGuQhFJW167aiUx5qeXpApialpmKZ6tf8Iqf0Ldm-X6dxRTLeELkNVExot5gS6KBycX0HZrkubr_xi8Jcem9qifHomy-qebysgjbs7buWNwaQBdVTqp04284F6_aupE4SLHXLg5iWbdWoNj00PnDmpK1-b_keL3cEnLJAi1cC3TOdsw Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: e2cfbbf586f5441e80930980df18d471 Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e2cfbbf586f5441e80930980df18d471", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e2cfbbf586f5441e80930980df18d471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e2cfbbf586f5441e80930980df18d471"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e2cfbbf586f5441e80930980df18d471"}]}] Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: e2cfbbf586f5441e80930980df18d471 Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServerDiskConfigTestJSON-192377708-project Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: b83cb923e3064ac7aeb1bd6883415e9f Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServerDiskConfigTestJSON-192377708-project Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance 23a67bae-512b-46d3-ad95-f18d54be4a0c could not be found. Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': '23a67bae-512b-46d3-ad95-f18d54be4a0c'} Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23a67bae-512b-46d3-ad95-f18d54be4a0c could not be found. Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23a67bae-512b-46d3-ad95-f18d54be4a0c could not be found. Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:46.204967 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.210742 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.210742 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:46.210742 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:46.210742 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:02:46.210742 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:02:46.210742 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23a67bae-512b-46d3-ad95-f18d54be4a0c could not be found. Oct 10 19:02:46.210742 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.210742 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8e295d86-d6f0-4815-b769-c8232652720e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Returning 404 to user: Instance 23a67bae-512b-46d3-ad95-f18d54be4a0c could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:02:46.210742 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8e295d86-d6f0-4815-b769-c8232652720e tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c" status: 404 len: 111 microversion: 2.1 time: 0.083539 Oct 10 19:02:46.216566 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1652/3028] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:46 2022] GET /compute/v2.1/servers/23a67bae-512b-46d3-ad95-f18d54be4a0c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:02:46.228233 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-ef144999-474a-41db-9b3f-6e82f9b0208c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f31922f9dc0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:46.321591 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-ef144999-474a-41db-9b3f-6e82f9b0208c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/949ef2d3-c68f-4a28-8c55-59f81041525a" status: 200 len: 1440 microversion: 2.1 time: 0.101001 Oct 10 19:02:46.323976 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1653/3029] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:02:46 2022] GET /compute/v2.1/images/949ef2d3-c68f-4a28-8c55-59f81041525a => generated 1440 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:46.338252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-acf2e941-7f1f-4fb8-86ed-a23844de9647 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:46.341537 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-acf2e941-7f1f-4fb8-86ed-a23844de9647 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:46.356077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acf2e941-7f1f-4fb8-86ed-a23844de9647 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:46.357123 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acf2e941-7f1f-4fb8-86ed-a23844de9647 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:46.361819 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acf2e941-7f1f-4fb8-86ed-a23844de9647 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.365353 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acf2e941-7f1f-4fb8-86ed-a23844de9647 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:46.368181 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acf2e941-7f1f-4fb8-86ed-a23844de9647 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:46.369469 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-acf2e941-7f1f-4fb8-86ed-a23844de9647 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.429900 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-acf2e941-7f1f-4fb8-86ed-a23844de9647 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] HTTP exception thrown: Instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 could not be found. Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-acf2e941-7f1f-4fb8-86ed-a23844de9647 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Request method failure captured: Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: request: DELETE /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 HTTP/1.1 Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGuQhFJW167aiUx5qeXpApialpmKZ6tf8Iqf0Ldm-X6dxRTLeELkNVExot5gS6KBycX0HZrkubr_xi8Jcem9qifHomy-qebysgjbs7buWNwaQBdVTqp04284F6_aupE4SLHXLg5iWbdWoNj00PnDmpK1-b_keL3cEnLJAi1cC3TOdsw Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: e2cfbbf586f5441e80930980df18d471 Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e2cfbbf586f5441e80930980df18d471", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e2cfbbf586f5441e80930980df18d471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e2cfbbf586f5441e80930980df18d471"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e2cfbbf586f5441e80930980df18d471"}]}] Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: e2cfbbf586f5441e80930980df18d471 Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServerDiskConfigTestJSON-192377708-project Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: b83cb923e3064ac7aeb1bd6883415e9f Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServerDiskConfigTestJSON-192377708-project Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 could not be found. Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'f5cc13ed-22f0-4a0a-a65f-208bd80d70b2'} Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 could not be found. Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:02:46.431763 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:02:46.436461 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 could not be found. Oct 10 19:02:46.436461 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.436461 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:46.436461 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.436461 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.436461 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:46.436461 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:46.436461 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:02:46.436461 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:02:46.436461 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 could not be found. Oct 10 19:02:46.436461 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.436461 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-acf2e941-7f1f-4fb8-86ed-a23844de9647 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Returning 404 to user: Instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:02:46.445781 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-acf2e941-7f1f-4fb8-86ed-a23844de9647 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 404 len: 111 microversion: 2.1 time: 0.120376 Oct 10 19:02:46.446480 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1654/3030] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:02:46 2022] DELETE /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:02:46.459177 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6cd1edf3-f06b-4c4a-b2e8-f328a1c014f7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:46.463547 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6cd1edf3-f06b-4c4a-b2e8-f328a1c014f7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: f5cc13ed-22f0-4a0a-a65f-208bd80d70b2] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:46.487831 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cd1edf3-f06b-4c4a-b2e8-f328a1c014f7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:46.490987 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cd1edf3-f06b-4c4a-b2e8-f328a1c014f7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:46.491847 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cd1edf3-f06b-4c4a-b2e8-f328a1c014f7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.493187 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cd1edf3-f06b-4c4a-b2e8-f328a1c014f7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:46.493833 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cd1edf3-f06b-4c4a-b2e8-f328a1c014f7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:46.495789 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cd1edf3-f06b-4c4a-b2e8-f328a1c014f7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.536926 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-10504196-23a0-4c3f-a862-a1c41e0b5ec7 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:46.550135 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.wsgi [None req-6cd1edf3-f06b-4c4a-b2e8-f328a1c014f7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] HTTP exception thrown: Instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 could not be found. Oct 10 19:02:46.553912 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-10504196-23a0-4c3f-a862-a1c41e0b5ec7 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.556962 Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6cd1edf3-f06b-4c4a-b2e8-f328a1c014f7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Request method failure captured: Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: request: GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 HTTP/1.1 Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: Accept: application/json Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: Accept-Encoding: identity Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: Connection: close Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: Content-Length: 0 Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: Content-Type: application/json Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: Host: 10.222.0.43 Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: Openstack-System-Scope: None Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: User-Agent: python-urllib3/1.26.12 Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Auth-Token: gAAAAABjRGuQhFJW167aiUx5qeXpApialpmKZ6tf8Iqf0Ldm-X6dxRTLeELkNVExot5gS6KBycX0HZrkubr_xi8Jcem9qifHomy-qebysgjbs7buWNwaQBdVTqp04284F6_aupE4SLHXLg5iWbdWoNj00PnDmpK1-b_keL3cEnLJAi1cC3TOdsw Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Id: None Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Domain-Name: None Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Identity-Status: Confirmed Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Is-Admin-Project: True Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Id: default Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Domain-Name: Default Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Id: e2cfbbf586f5441e80930980df18d471 Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Project-Name: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Role: member,reader Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Roles: member,reader Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e2cfbbf586f5441e80930980df18d471", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e2cfbbf586f5441e80930980df18d471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e2cfbbf586f5441e80930980df18d471"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e2cfbbf586f5441e80930980df18d471"}]}] Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Id: e2cfbbf586f5441e80930980df18d471 Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-User: tempest-ServerDiskConfigTestJSON-192377708-project Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Id: default Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-User-Domain-Name: Default Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-User-Id: b83cb923e3064ac7aeb1bd6883415e9f Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: X-User-Name: tempest-ServerDiskConfigTestJSON-192377708-project Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: method: > Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: exception: Instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 could not be found. Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: action_args: {'id': 'f5cc13ed-22f0-4a0a-a65f-208bd80d70b2'} Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 could not be found. Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 could not be found. Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:46.555699 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.560583 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.560583 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:46.560583 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:46.560583 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:02:46.560583 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:02:46.560583 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 could not be found. Oct 10 19:02:46.560583 n-d-860863-1 devstack@n-api.service[127288]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.566091 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1377/3031] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:45 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:46.569433 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6cd1edf3-f06b-4c4a-b2e8-f328a1c014f7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Returning 404 to user: Instance f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 could not be found. {{(pid=127288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:02:46.572661 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6cd1edf3-f06b-4c4a-b2e8-f328a1c014f7 tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2" status: 404 len: 111 microversion: 2.1 time: 0.117924 Oct 10 19:02:46.572661 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1655/3032] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:46 2022] GET /compute/v2.1/servers/f5cc13ed-22f0-4a0a-a65f-208bd80d70b2 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:02:46.579467 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-19e66af7-2a62-48d3-90ef-f336c57f67fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:46.582312 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-19e66af7-2a62-48d3-90ef-f336c57f67fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:46.596667 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19e66af7-2a62-48d3-90ef-f336c57f67fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:46.603676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19e66af7-2a62-48d3-90ef-f336c57f67fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:46.603676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19e66af7-2a62-48d3-90ef-f336c57f67fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.603676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19e66af7-2a62-48d3-90ef-f336c57f67fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:46.603676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19e66af7-2a62-48d3-90ef-f336c57f67fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:46.603676 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-19e66af7-2a62-48d3-90ef-f336c57f67fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.615300 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-6cb6f088-1849-4706-83b6-c09df59791ad tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:46.615924 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-6cb6f088-1849-4706-83b6-c09df59791ad tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:46.630367 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cb6f088-1849-4706-83b6-c09df59791ad tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:46.631205 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cb6f088-1849-4706-83b6-c09df59791ad tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:46.631326 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cb6f088-1849-4706-83b6-c09df59791ad tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.632077 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cb6f088-1849-4706-83b6-c09df59791ad tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:46.632480 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cb6f088-1849-4706-83b6-c09df59791ad tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:46.633003 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-6cb6f088-1849-4706-83b6-c09df59791ad tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.635500 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-19e66af7-2a62-48d3-90ef-f336c57f67fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] HTTP exception thrown: Instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 could not be found. Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-19e66af7-2a62-48d3-90ef-f336c57f67fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Request method failure captured: Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: request: DELETE /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 HTTP/1.1 Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGuQhFJW167aiUx5qeXpApialpmKZ6tf8Iqf0Ldm-X6dxRTLeELkNVExot5gS6KBycX0HZrkubr_xi8Jcem9qifHomy-qebysgjbs7buWNwaQBdVTqp04284F6_aupE4SLHXLg5iWbdWoNj00PnDmpK1-b_keL3cEnLJAi1cC3TOdsw Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: e2cfbbf586f5441e80930980df18d471 Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e2cfbbf586f5441e80930980df18d471", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e2cfbbf586f5441e80930980df18d471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e2cfbbf586f5441e80930980df18d471"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e2cfbbf586f5441e80930980df18d471"}]}] Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: e2cfbbf586f5441e80930980df18d471 Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServerDiskConfigTestJSON-192377708-project Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: b83cb923e3064ac7aeb1bd6883415e9f Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServerDiskConfigTestJSON-192377708-project Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 could not be found. Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '625d4b03-2441-4576-a0e2-6c266b24b1e9'} Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 could not be found. Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:02:46.638867 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:02:46.644213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 could not be found. Oct 10 19:02:46.644213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.644213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:46.644213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.644213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.644213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:46.644213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:46.644213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:02:46.644213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:02:46.644213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 could not be found. Oct 10 19:02:46.644213 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.644213 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-19e66af7-2a62-48d3-90ef-f336c57f67fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Returning 404 to user: Instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:02:46.645484 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:02:46.645647 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-19e66af7-2a62-48d3-90ef-f336c57f67fd tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "DELETE /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 404 len: 111 microversion: 2.1 time: 0.065177 Oct 10 19:02:46.645647 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1378/3033] 10.222.0.43 () {58 vars in 1239 bytes} [Mon Oct 10 19:02:46 2022] DELETE /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:02:46.655596 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0236f060-7e33-4ecd-9044-c406eb0ba18d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:46.656876 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-0236f060-7e33-4ecd-9044-c406eb0ba18d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] [instance: 625d4b03-2441-4576-a0e2-6c266b24b1e9] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:46.671804 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0236f060-7e33-4ecd-9044-c406eb0ba18d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:46.676234 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0236f060-7e33-4ecd-9044-c406eb0ba18d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:46.678919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0236f060-7e33-4ecd-9044-c406eb0ba18d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.679789 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0236f060-7e33-4ecd-9044-c406eb0ba18d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:46.680524 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0236f060-7e33-4ecd-9044-c406eb0ba18d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:46.682233 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-0236f060-7e33-4ecd-9044-c406eb0ba18d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:46.740048 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.wsgi [None req-0236f060-7e33-4ecd-9044-c406eb0ba18d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] HTTP exception thrown: Instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 could not be found. Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0236f060-7e33-4ecd-9044-c406eb0ba18d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Request method failure captured: Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: request: GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 HTTP/1.1 Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: Accept: application/json Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: Accept-Encoding: identity Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: Connection: close Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: Content-Length: 0 Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: Content-Type: application/json Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: Host: 10.222.0.43 Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: Openstack-System-Scope: None Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: User-Agent: python-urllib3/1.26.12 Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Auth-Token: gAAAAABjRGuQhFJW167aiUx5qeXpApialpmKZ6tf8Iqf0Ldm-X6dxRTLeELkNVExot5gS6KBycX0HZrkubr_xi8Jcem9qifHomy-qebysgjbs7buWNwaQBdVTqp04284F6_aupE4SLHXLg5iWbdWoNj00PnDmpK1-b_keL3cEnLJAi1cC3TOdsw Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Id: None Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Domain-Name: None Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Identity-Status: Confirmed Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Is-Admin-Project: True Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Id: default Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Domain-Name: Default Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Id: e2cfbbf586f5441e80930980df18d471 Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Project-Name: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Role: member,reader Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Roles: member,reader Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e2cfbbf586f5441e80930980df18d471", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e2cfbbf586f5441e80930980df18d471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e2cfbbf586f5441e80930980df18d471"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e2cfbbf586f5441e80930980df18d471"}]}] Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Id: e2cfbbf586f5441e80930980df18d471 Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-192377708 Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-User: tempest-ServerDiskConfigTestJSON-192377708-project Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Id: default Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-User-Domain-Name: Default Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-User-Id: b83cb923e3064ac7aeb1bd6883415e9f Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: X-User-Name: tempest-ServerDiskConfigTestJSON-192377708-project Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: method: > Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: exception: Instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 could not be found. Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: action_args: {'id': '625d4b03-2441-4576-a0e2-6c266b24b1e9'} Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 could not be found. Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 could not be found. Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 10 19:02:46.744269 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.748379 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 10 19:02:46.748379 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 10 19:02:46.748379 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 10 19:02:46.748379 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 10 19:02:46.748379 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 10 19:02:46.748379 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 could not be found. Oct 10 19:02:46.748379 n-d-860863-1 devstack@n-api.service[127289]: ERROR nova.api.openstack.wsgi Oct 10 19:02:46.755914 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-0236f060-7e33-4ecd-9044-c406eb0ba18d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] Returning 404 to user: Instance 625d4b03-2441-4576-a0e2-6c266b24b1e9 could not be found. {{(pid=127289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 10 19:02:46.757094 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-0236f060-7e33-4ecd-9044-c406eb0ba18d tempest-ServerDiskConfigTestJSON-192377708 tempest-ServerDiskConfigTestJSON-192377708-project] 10.222.0.43 "GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9" status: 404 len: 111 microversion: 2.1 time: 0.107850 Oct 10 19:02:46.758281 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1379/3034] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:46 2022] GET /compute/v2.1/servers/625d4b03-2441-4576-a0e2-6c266b24b1e9 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 10 19:02:46.809104 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6cb6f088-1849-4706-83b6-c09df59791ad tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:46.826879 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6cb6f088-1849-4706-83b6-c09df59791ad tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:46.834494 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-6cb6f088-1849-4706-83b6-c09df59791ad tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:46.836106 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-6cb6f088-1849-4706-83b6-c09df59791ad tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1605 microversion: 2.42 time: 0.225144 Oct 10 19:02:46.837279 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1656/3035] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:46 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1605 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:47.151202 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-59480614-8f88-4691-8144-93b6e33d8930 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:47.152127 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-59480614-8f88-4691-8144-93b6e33d8930 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] [instance: d12519a5-adbf-410a-b837-02b9cc314e3a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:47.163421 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-59480614-8f88-4691-8144-93b6e33d8930 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:47.164086 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-59480614-8f88-4691-8144-93b6e33d8930 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:47.164957 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-59480614-8f88-4691-8144-93b6e33d8930 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:47.165787 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-59480614-8f88-4691-8144-93b6e33d8930 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:47.167786 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-59480614-8f88-4691-8144-93b6e33d8930 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:47.171574 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-59480614-8f88-4691-8144-93b6e33d8930 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:47.339767 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-8335dc7c-3c2b-46ee-b113-dfb9a30fa7ca tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318dd97280>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:47.410399 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-59480614-8f88-4691-8144-93b6e33d8930 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1f0c5ec9fe47768424f04a8f721e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6482edb6681449208592d3bb035d7e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:47.411788 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-8335dc7c-3c2b-46ee-b113-dfb9a30fa7ca tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/949ef2d3-c68f-4a28-8c55-59f81041525a" status: 200 len: 1440 microversion: 2.1 time: 0.076516 Oct 10 19:02:47.434165 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1657/3036] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:02:47 2022] GET /compute/v2.1/images/949ef2d3-c68f-4a28-8c55-59f81041525a => generated 1440 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:47.434286 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-59480614-8f88-4691-8144-93b6e33d8930 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] 10.222.0.43 "GET /compute/v2.1/servers/d12519a5-adbf-410a-b837-02b9cc314e3a" status: 200 len: 1236 microversion: 2.1 time: 0.274757 Oct 10 19:02:47.434286 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1380/3037] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:47 2022] GET /compute/v2.1/servers/d12519a5-adbf-410a-b837-02b9cc314e3a => generated 1236 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:47.582277 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-4af0320d-13b0-4970-a4b6-acf7944e53e0 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:47.583640 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-4af0320d-13b0-4970-a4b6-acf7944e53e0 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127288) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:47.600723 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4af0320d-13b0-4970-a4b6-acf7944e53e0 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:47.602328 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4af0320d-13b0-4970-a4b6-acf7944e53e0 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:47.604640 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4af0320d-13b0-4970-a4b6-acf7944e53e0 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:47.605679 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4af0320d-13b0-4970-a4b6-acf7944e53e0 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:47.606545 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4af0320d-13b0-4970-a4b6-acf7944e53e0 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:47.607644 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-4af0320d-13b0-4970-a4b6-acf7944e53e0 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:47.864629 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-26ca6c72-abd2-4a5f-a1d2-5942078c0fb8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:47.865875 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-26ca6c72-abd2-4a5f-a1d2-5942078c0fb8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:47.886019 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26ca6c72-abd2-4a5f-a1d2-5942078c0fb8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:47.890968 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26ca6c72-abd2-4a5f-a1d2-5942078c0fb8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:47.891414 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26ca6c72-abd2-4a5f-a1d2-5942078c0fb8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:47.895094 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26ca6c72-abd2-4a5f-a1d2-5942078c0fb8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:47.897930 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26ca6c72-abd2-4a5f-a1d2-5942078c0fb8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:47.898545 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-26ca6c72-abd2-4a5f-a1d2-5942078c0fb8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:48.643339 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.policy [None req-4af0320d-13b0-4970-a4b6-acf7944e53e0 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127288) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:48.648120 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-26ca6c72-abd2-4a5f-a1d2-5942078c0fb8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:48.671472 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-26ca6c72-abd2-4a5f-a1d2-5942078c0fb8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:48.674646 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-4af0320d-13b0-4970-a4b6-acf7944e53e0 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 1.096597 Oct 10 19:02:48.674775 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-26ca6c72-abd2-4a5f-a1d2-5942078c0fb8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:48.675786 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-26ca6c72-abd2-4a5f-a1d2-5942078c0fb8 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1605 microversion: 2.42 time: 0.816871 Oct 10 19:02:48.676791 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1381/3038] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:47 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1605 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:48.681379 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-c0efb596-99f1-4ee8-834f-100a4ced0156 req-25c65366-8890-4fed-a22f-f3b6d267f221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ed690e-d123-4c67-8311-9f2f94919766", "name": "network-vif-plugged", "status": "completed", "tag": "f5d94b71-4083-42b7-82e3-39cfb8e92d9d"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:48.689332 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1658/3039] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:47 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:48.693301 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-c0efb596-99f1-4ee8-834f-100a4ced0156 req-25c65366-8890-4fed-a22f-f3b6d267f221 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:48.693781 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-c0efb596-99f1-4ee8-834f-100a4ced0156 req-25c65366-8890-4fed-a22f-f3b6d267f221 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:48.694201 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-c0efb596-99f1-4ee8-834f-100a4ced0156 req-25c65366-8890-4fed-a22f-f3b6d267f221 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:48.700805 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-d88a94ff-42e8-4e3d-a704-fbd51cee5a9e tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318dd774c0>' {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:48.726693 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-c0efb596-99f1-4ee8-834f-100a4ced0156 req-25c65366-8890-4fed-a22f-f3b6d267f221 service nova] Creating event network-vif-plugged:f5d94b71-4083-42b7-82e3-39cfb8e92d9d for instance f8ed690e-d123-4c67-8311-9f2f94919766 on n-h2-860863-1 Oct 10 19:02:48.742234 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-c0efb596-99f1-4ee8-834f-100a4ced0156 req-25c65366-8890-4fed-a22f-f3b6d267f221 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064031 Oct 10 19:02:48.743143 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1382/3040] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:48.748459 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-a8c957f3-305f-4b7a-8b50-7b8580ca8d5f tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:48.755703 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-a8c957f3-305f-4b7a-8b50-7b8580ca8d5f tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] [instance: d12519a5-adbf-410a-b837-02b9cc314e3a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:48.762218 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a8c957f3-305f-4b7a-8b50-7b8580ca8d5f tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:48.765117 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a8c957f3-305f-4b7a-8b50-7b8580ca8d5f tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:48.766536 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a8c957f3-305f-4b7a-8b50-7b8580ca8d5f tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:48.766536 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a8c957f3-305f-4b7a-8b50-7b8580ca8d5f tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:48.766830 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a8c957f3-305f-4b7a-8b50-7b8580ca8d5f tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:48.769148 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-a8c957f3-305f-4b7a-8b50-7b8580ca8d5f tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:48.827875 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-d88a94ff-42e8-4e3d-a704-fbd51cee5a9e tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/949ef2d3-c68f-4a28-8c55-59f81041525a" status: 200 len: 1440 microversion: 2.1 time: 0.136187 Oct 10 19:02:48.831117 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1659/3041] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:02:48 2022] GET /compute/v2.1/images/949ef2d3-c68f-4a28-8c55-59f81041525a => generated 1440 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:48.988030 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1749838475", "imageRef": "b0a280ee-26ee-4c9a-8155-4326e368ccc9", "flavorRef": "452", "networks": [{"uuid": "8fe474f1-4c55-4478-ae57-c7d795da4502"}], "security_groups": [{"name": "tempest-securitygroup--1402454925"}], "key_name": "tempest-keypair-723037458", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:49.215825 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.network.neutron [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] validate_networks() for [('8fe474f1-4c55-4478-ae57-c7d795da4502', None, None, None, None, None)] {{(pid=127288) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 10 19:02:49.261285 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-a8c957f3-305f-4b7a-8b50-7b8580ca8d5f tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1f0c5ec9fe47768424f04a8f721e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6482edb6681449208592d3bb035d7e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:49.270166 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-a8c957f3-305f-4b7a-8b50-7b8580ca8d5f tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] 10.222.0.43 "GET /compute/v2.1/servers/d12519a5-adbf-410a-b837-02b9cc314e3a" status: 200 len: 1304 microversion: 2.1 time: 0.525605 Oct 10 19:02:49.270757 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1383/3042] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:48 2022] GET /compute/v2.1/servers/d12519a5-adbf-410a-b837-02b9cc314e3a => generated 1304 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:49.696839 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-543f156d-d114-4333-9783-8aeaf136bfe6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:49.696839 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-543f156d-d114-4333-9783-8aeaf136bfe6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] [instance: 2c42d068-855b-4bd5-8269-ba4ac1d9949d] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:49.706825 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-543f156d-d114-4333-9783-8aeaf136bfe6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:49.712557 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-543f156d-d114-4333-9783-8aeaf136bfe6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:49.715492 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-543f156d-d114-4333-9783-8aeaf136bfe6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:49.717046 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-543f156d-d114-4333-9783-8aeaf136bfe6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:49.720426 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-543f156d-d114-4333-9783-8aeaf136bfe6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:49.724078 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-543f156d-d114-4333-9783-8aeaf136bfe6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:50.025708 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-543f156d-d114-4333-9783-8aeaf136bfe6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '807e5d15f2cd4a2890bce3ce2c9edfba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df728c13f03436ba9a26693457ca1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:50.036261 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-543f156d-d114-4333-9783-8aeaf136bfe6 tempest-ServerRescueTestJSON-342536624 tempest-ServerRescueTestJSON-342536624-project] 10.222.0.43 "GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d" status: 200 len: 1506 microversion: 2.1 time: 0.344424 Oct 10 19:02:50.038010 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1384/3043] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:49 2022] GET /compute/v2.1/servers/2c42d068-855b-4bd5-8269-ba4ac1d9949d => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 10 19:02:50.044189 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-3667d1aa-e665-48b9-a1e7-a3475de18941 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:50.045154 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-3667d1aa-e665-48b9-a1e7-a3475de18941 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] [instance: 2e826b78-f676-478a-bccf-8d36547f2582] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:50.053998 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3667d1aa-e665-48b9-a1e7-a3475de18941 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:50.056298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3667d1aa-e665-48b9-a1e7-a3475de18941 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:50.056298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3667d1aa-e665-48b9-a1e7-a3475de18941 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:50.056298 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3667d1aa-e665-48b9-a1e7-a3475de18941 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:50.056919 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3667d1aa-e665-48b9-a1e7-a3475de18941 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:50.057602 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-3667d1aa-e665-48b9-a1e7-a3475de18941 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:50.211923 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3667d1aa-e665-48b9-a1e7-a3475de18941 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:50.248231 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3667d1aa-e665-48b9-a1e7-a3475de18941 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:50.254664 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-3667d1aa-e665-48b9-a1e7-a3475de18941 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '06d30b5629a7494db2b96ac955f6f385', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1267edbe51de42fbacc5c5d59c91e224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:50.258021 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-3667d1aa-e665-48b9-a1e7-a3475de18941 tempest-TaggedBootDevicesTest_v242-638087519 tempest-TaggedBootDevicesTest_v242-638087519-project] 10.222.0.43 "GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582" status: 200 len: 1605 microversion: 2.42 time: 0.218801 Oct 10 19:02:50.282986 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1385/3044] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Oct 10 19:02:50 2022] GET /compute/v2.1/servers/2e826b78-f676-478a-bccf-8d36547f2582 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 10 19:02:50.288405 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-e4ecb0dc-d496-461b-9a3e-9a5ec27f6a6c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] Calling method '.version_select at 0x7f318d09ac10>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:50.398408 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-e4ecb0dc-d496-461b-9a3e-9a5ec27f6a6c tempest-ImagesTestJSON-1943616357 tempest-ImagesTestJSON-1943616357-project] 10.222.0.43 "GET /compute/v2.1/images/949ef2d3-c68f-4a28-8c55-59f81041525a" status: 200 len: 1440 microversion: 2.1 time: 0.113701 Oct 10 19:02:50.402188 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1386/3045] 10.222.0.43 () {58 vars in 1233 bytes} [Mon Oct 10 19:02:50 2022] GET /compute/v2.1/images/949ef2d3-c68f-4a28-8c55-59f81041525a => generated 1440 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:50.416049 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [None req-b8d05856-e754-44b2-8be1-5e20644009b9 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Calling method '>' {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 10 19:02:50.417058 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.compute.api [None req-b8d05856-e754-44b2-8be1-5e20644009b9 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] [instance: d12519a5-adbf-410a-b837-02b9cc314e3a] Fetching instance by UUID {{(pid=127289) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 10 19:02:50.439297 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8d05856-e754-44b2-8be1-5e20644009b9 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:50.439903 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8d05856-e754-44b2-8be1-5e20644009b9 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:50.440276 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8d05856-e754-44b2-8be1-5e20644009b9 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:50.455862 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8d05856-e754-44b2-8be1-5e20644009b9 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:50.456503 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8d05856-e754-44b2-8be1-5e20644009b9 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:50.457105 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [None req-b8d05856-e754-44b2-8be1-5e20644009b9 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:50.735772 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.policy [None req-b8d05856-e754-44b2-8be1-5e20644009b9 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1f0c5ec9fe47768424f04a8f721e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6482edb6681449208592d3bb035d7e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127289) authorize /opt/stack/nova/nova/policy.py:199}} Oct 10 19:02:50.752714 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [None req-b8d05856-e754-44b2-8be1-5e20644009b9 tempest-ServersTestBootFromVolume-1274320779 tempest-ServersTestBootFromVolume-1274320779-project] 10.222.0.43 "GET /compute/v2.1/servers/d12519a5-adbf-410a-b837-02b9cc314e3a" status: 200 len: 1304 microversion: 2.1 time: 0.346467 Oct 10 19:02:50.753580 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1387/3046] 10.222.0.43 () {58 vars in 1236 bytes} [Mon Oct 10 19:02:50 2022] GET /compute/v2.1/servers/d12519a5-adbf-410a-b837-02b9cc314e3a => generated 1304 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 10 19:02:50.823817 n-d-860863-1 devstack@n-api.service[127288]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 10 19:02:50.824863 n-d-860863-1 devstack@n-api.service[127288]: Mon Oct 10 19:02:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.43) !!! Oct 10 19:02:50.962858 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Flavor limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 10 19:02:50.963381 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Image limits 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 10 19:02:50.966687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Flavor pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 10 19:02:50.966687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Image pref 0:0:0 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 10 19:02:50.966687 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.virt.hardware [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 10 19:02:50.995726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:50.995726 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:50.998252 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:50.999518 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:51.001597 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:51.002640 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:51.059871 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Getting quotas for project 9d12307b731846928ce877a98bce8c10. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 10 19:02:51.068028 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.quota [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Getting quotas for user 3ee224c527494aec81a29103a3c3332e and project 9d12307b731846928ce877a98bce8c10. Resources: {'ram', 'cores', 'instances'} {{(pid=127288) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 10 19:02:51.087777 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] Going to run 1 instances... {{(pid=127288) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 10 19:02:51.092007 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.compute.api [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] [instance: 3bebe630-2a19-48a2-adc3-72187cb819a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0a280ee-26ee-4c9a-8155-4326e368ccc9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 10 19:02:51.254471 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [None req-48b1571a-3872-4b77-b608-930358728e99 tempest-LiveMigrationTest-62876481 tempest-LiveMigrationTest-62876481-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.270604 Oct 10 19:02:51.260486 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1660/3047] 10.222.0.43 () {60 vars in 1147 bytes} [Mon Oct 10 19:02:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 2277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 10 19:02:51.873346 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-00f4d2d9-7d65-4c1e-9b2a-6a33d68ebee8 req-49ec6817-107c-4be9-b90c-2dd1c12a0040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d12519a5-adbf-410a-b837-02b9cc314e3a", "tag": "0c843043-9b51-4090-ab7b-fcf710cfc86b"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:51.892811 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-00f4d2d9-7d65-4c1e-9b2a-6a33d68ebee8 req-49ec6817-107c-4be9-b90c-2dd1c12a0040 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:51.893548 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-00f4d2d9-7d65-4c1e-9b2a-6a33d68ebee8 req-49ec6817-107c-4be9-b90c-2dd1c12a0040 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:51.901382 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-00f4d2d9-7d65-4c1e-9b2a-6a33d68ebee8 req-49ec6817-107c-4be9-b90c-2dd1c12a0040 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:51.921385 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-00f4d2d9-7d65-4c1e-9b2a-6a33d68ebee8 req-49ec6817-107c-4be9-b90c-2dd1c12a0040 service nova] Creating event network-changed:0c843043-9b51-4090-ab7b-fcf710cfc86b for instance d12519a5-adbf-410a-b837-02b9cc314e3a on n-h1-860863-1 Oct 10 19:02:51.928908 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-00f4d2d9-7d65-4c1e-9b2a-6a33d68ebee8 req-49ec6817-107c-4be9-b90c-2dd1c12a0040 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058953 Oct 10 19:02:51.930295 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1388/3048] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:02:56.720245 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-73c2f6a2-6fe6-475b-ad3c-2a0497e4a45a req-e3be9b73-ef3f-4d63-9b65-7e0a2b38c508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bebe630-2a19-48a2-adc3-72187cb819a5", "tag": "29ac1022-e7c6-426a-8b92-e8c172e0fe69"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:02:56.764444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-73c2f6a2-6fe6-475b-ad3c-2a0497e4a45a req-e3be9b73-ef3f-4d63-9b65-7e0a2b38c508 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:02:56.764444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-73c2f6a2-6fe6-475b-ad3c-2a0497e4a45a req-e3be9b73-ef3f-4d63-9b65-7e0a2b38c508 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:02:56.764444 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-73c2f6a2-6fe6-475b-ad3c-2a0497e4a45a req-e3be9b73-ef3f-4d63-9b65-7e0a2b38c508 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:02:56.793116 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-73c2f6a2-6fe6-475b-ad3c-2a0497e4a45a req-e3be9b73-ef3f-4d63-9b65-7e0a2b38c508 service nova] Creating event network-changed:29ac1022-e7c6-426a-8b92-e8c172e0fe69 for instance 3bebe630-2a19-48a2-adc3-72187cb819a5 on n-h2-860863-1 Oct 10 19:02:56.801707 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-73c2f6a2-6fe6-475b-ad3c-2a0497e4a45a req-e3be9b73-ef3f-4d63-9b65-7e0a2b38c508 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086375 Oct 10 19:02:56.802330 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1661/3049] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 10 19:03:01.920325 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell0:SELECT=4 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:03:01.921691 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:03:01.925900 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-f0b7b18b-507a-4206-a663-d84439241e0c req-485dddeb-129b-46bb-922c-0cefbf38ff98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bebe630-2a19-48a2-adc3-72187cb819a5", "name": "network-vif-plugged", "status": "completed", "tag": "29ac1022-e7c6-426a-8b92-e8c172e0fe69"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:03:01.930609 n-d-860863-1 devstack@n-api.service[127289]: DEBUG dbcounter [-] [127289] Writing DB stats nova_cell1:SELECT=64 {{(pid=127289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:03:01.935874 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f0b7b18b-507a-4206-a663-d84439241e0c req-485dddeb-129b-46bb-922c-0cefbf38ff98 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:03:01.936351 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f0b7b18b-507a-4206-a663-d84439241e0c req-485dddeb-129b-46bb-922c-0cefbf38ff98 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:03:01.936814 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-f0b7b18b-507a-4206-a663-d84439241e0c req-485dddeb-129b-46bb-922c-0cefbf38ff98 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:03:01.947765 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-f0b7b18b-507a-4206-a663-d84439241e0c req-485dddeb-129b-46bb-922c-0cefbf38ff98 service nova] Creating event network-vif-plugged:29ac1022-e7c6-426a-8b92-e8c172e0fe69 for instance 3bebe630-2a19-48a2-adc3-72187cb819a5 on n-h2-860863-1 Oct 10 19:03:01.952806 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-f0b7b18b-507a-4206-a663-d84439241e0c req-485dddeb-129b-46bb-922c-0cefbf38ff98 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033665 Oct 10 19:03:01.953340 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1389/3050] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:03:05.805742 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=4 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:03:05.806550 n-d-860863-1 devstack@n-api.service[127288]: DEBUG dbcounter [-] [127288] Writing DB stats nova_cell0:SELECT=18 {{(pid=127288) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 10 19:03:05.810856 n-d-860863-1 devstack@n-api.service[127288]: DEBUG nova.api.openstack.wsgi [req-95b30314-53a5-4aaf-aebf-5bfb06dd6b89 req-b34d562b-4296-4e06-8ff0-24451fa1e2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ed690e-d123-4c67-8311-9f2f94919766", "name": "network-vif-unplugged", "status": "completed", "tag": "f5d94b71-4083-42b7-82e3-39cfb8e92d9d"}]} {{(pid=127288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:03:05.821096 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-95b30314-53a5-4aaf-aebf-5bfb06dd6b89 req-b34d562b-4296-4e06-8ff0-24451fa1e2ae service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:03:05.821571 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-95b30314-53a5-4aaf-aebf-5bfb06dd6b89 req-b34d562b-4296-4e06-8ff0-24451fa1e2ae service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:03:05.822003 n-d-860863-1 devstack@n-api.service[127288]: DEBUG oslo_concurrency.lockutils [req-95b30314-53a5-4aaf-aebf-5bfb06dd6b89 req-b34d562b-4296-4e06-8ff0-24451fa1e2ae service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:03:05.832698 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.compute.server_external_events [req-95b30314-53a5-4aaf-aebf-5bfb06dd6b89 req-b34d562b-4296-4e06-8ff0-24451fa1e2ae service nova] Creating event network-vif-unplugged:f5d94b71-4083-42b7-82e3-39cfb8e92d9d for instance f8ed690e-d123-4c67-8311-9f2f94919766 on n-h2-860863-1 Oct 10 19:03:05.837624 n-d-860863-1 devstack@n-api.service[127288]: INFO nova.api.openstack.requestlog [req-95b30314-53a5-4aaf-aebf-5bfb06dd6b89 req-b34d562b-4296-4e06-8ff0-24451fa1e2ae service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033209 Oct 10 19:03:05.838225 n-d-860863-1 devstack@n-api.service[127288]: [pid: 127288|app: 0|req: 1662/3051] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 10 19:03:13.178769 n-d-860863-1 devstack@n-api.service[127289]: DEBUG nova.api.openstack.wsgi [req-c8d8cf5c-8793-4d23-a1c1-9985895dc499 req-f24cd41c-b92c-4d45-9ce9-43ca440b4ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12519a5-adbf-410a-b837-02b9cc314e3a", "name": "network-vif-plugged", "status": "completed", "tag": "0c843043-9b51-4090-ab7b-fcf710cfc86b"}]} {{(pid=127289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 10 19:03:13.191860 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-c8d8cf5c-8793-4d23-a1c1-9985895dc499 req-f24cd41c-b92c-4d45-9ce9-43ca440b4ff0 service nova] Acquiring lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 10 19:03:13.192329 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-c8d8cf5c-8793-4d23-a1c1-9985895dc499 req-f24cd41c-b92c-4d45-9ce9-43ca440b4ff0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 10 19:03:13.194800 n-d-860863-1 devstack@n-api.service[127289]: DEBUG oslo_concurrency.lockutils [req-c8d8cf5c-8793-4d23-a1c1-9985895dc499 req-f24cd41c-b92c-4d45-9ce9-43ca440b4ff0 service nova] Lock "1649e55c-2282-4aa8-b943-d6661d4bffa2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 10 19:03:13.203508 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.compute.server_external_events [req-c8d8cf5c-8793-4d23-a1c1-9985895dc499 req-f24cd41c-b92c-4d45-9ce9-43ca440b4ff0 service nova] Creating event network-vif-plugged:0c843043-9b51-4090-ab7b-fcf710cfc86b for instance d12519a5-adbf-410a-b837-02b9cc314e3a on n-h1-860863-1 Oct 10 19:03:13.208614 n-d-860863-1 devstack@n-api.service[127289]: INFO nova.api.openstack.requestlog [req-c8d8cf5c-8793-4d23-a1c1-9985895dc499 req-f24cd41c-b92c-4d45-9ce9-43ca440b4ff0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034378 Oct 10 19:03:13.209134 n-d-860863-1 devstack@n-api.service[127289]: [pid: 127289|app: 0|req: 1390/3052] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Oct 10 19:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0)